-- Logs begin at Mon 2022-08-22 16:07:24 UTC, end at Mon 2022-08-22 17:58:34 UTC. -- Aug 22 16:59:52.498219 n-d-854030-1 systemd[1]: Starting Devstack devstack@n-api.service... Aug 22 16:59:52.507662 n-d-854030-1 devstack@n-api.service[107008]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 22 16:59:52.511433 n-d-854030-1 devstack@n-api.service[107008]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 16:59:52 2022] *** Aug 22 16:59:52.511433 n-d-854030-1 devstack@n-api.service[107008]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 16:59:52.511433 n-d-854030-1 devstack@n-api.service[107008]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 16:59:52.511433 n-d-854030-1 devstack@n-api.service[107008]: nodename: n-d-854030-1 Aug 22 16:59:52.511433 n-d-854030-1 devstack@n-api.service[107008]: machine: x86_64 Aug 22 16:59:52.511433 n-d-854030-1 devstack@n-api.service[107008]: clock source: unix Aug 22 16:59:52.511433 n-d-854030-1 devstack@n-api.service[107008]: pcre jit disabled Aug 22 16:59:52.511433 n-d-854030-1 devstack@n-api.service[107008]: detected number of CPU cores: 4 Aug 22 16:59:52.511433 n-d-854030-1 devstack@n-api.service[107008]: current working directory: / Aug 22 16:59:52.511433 n-d-854030-1 devstack@n-api.service[107008]: detected binary path: /usr/bin/uwsgi-core Aug 22 16:59:52.511433 n-d-854030-1 devstack@n-api.service[107008]: your processes number limit is 47680 Aug 22 16:59:52.511433 n-d-854030-1 devstack@n-api.service[107008]: your memory page size is 4096 bytes Aug 22 16:59:52.511433 n-d-854030-1 devstack@n-api.service[107008]: detected max file descriptor number: 2048 Aug 22 16:59:52.511433 n-d-854030-1 devstack@n-api.service[107008]: lock engine: pthread robust mutexes Aug 22 16:59:52.511433 n-d-854030-1 devstack@n-api.service[107008]: thunder lock: enabled Aug 22 16:59:52.511433 n-d-854030-1 devstack@n-api.service[107008]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 22 16:59:52.511433 n-d-854030-1 devstack@n-api.service[107008]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 16:59:52.551018 n-d-854030-1 devstack@n-api.service[107008]: Python main interpreter initialized at 0x55fb821a39c0 Aug 22 16:59:52.551018 n-d-854030-1 devstack@n-api.service[107008]: python threads support enabled Aug 22 16:59:52.551018 n-d-854030-1 devstack@n-api.service[107008]: your server socket listen backlog is limited to 100 connections Aug 22 16:59:52.551018 n-d-854030-1 devstack@n-api.service[107008]: your mercy for graceful operations on workers is 90 seconds Aug 22 16:59:52.551469 n-d-854030-1 devstack@n-api.service[107008]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 16:59:52.551469 n-d-854030-1 devstack@n-api.service[107008]: *** Operational MODE: preforking *** Aug 22 16:59:52.551722 n-d-854030-1 devstack@n-api.service[107008]: *** uWSGI is running in multiple interpreter mode *** Aug 22 16:59:52.551722 n-d-854030-1 devstack@n-api.service[107008]: spawned uWSGI master process (pid: 107008) Aug 22 16:59:52.551938 n-d-854030-1 systemd[1]: Started Devstack devstack@n-api.service. Aug 22 16:59:52.553352 n-d-854030-1 devstack@n-api.service[107008]: spawned uWSGI worker 1 (pid: 107009, cores: 1) Aug 22 16:59:52.553352 n-d-854030-1 devstack@n-api.service[107008]: spawned uWSGI worker 2 (pid: 107010, cores: 1) Aug 22 16:59:52.553352 n-d-854030-1 devstack@n-api.service[107008]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 16:59:53.225157 n-d-854030-1 devstack@n-api.service[107010]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 16:59:53.225784 n-d-854030-1 devstack@n-api.service[107009]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 16:59:54.323440 n-d-854030-1 devstack@n-api.service[107010]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 16:59:54.323440 n-d-854030-1 devstack@n-api.service[107010]: from cryptography.utils import int_from_bytes Aug 22 16:59:54.324122 n-d-854030-1 devstack@n-api.service[107010]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 16:59:54.324122 n-d-854030-1 devstack@n-api.service[107010]: from cryptography.utils import int_from_bytes Aug 22 16:59:54.328280 n-d-854030-1 devstack@n-api.service[107009]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 16:59:54.328280 n-d-854030-1 devstack@n-api.service[107009]: from cryptography.utils import int_from_bytes Aug 22 16:59:54.328737 n-d-854030-1 devstack@n-api.service[107009]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 16:59:54.328737 n-d-854030-1 devstack@n-api.service[107009]: from cryptography.utils import int_from_bytes Aug 22 16:59:56.819625 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 16:59:56.820264 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 16:59:56.820360 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 16:59:56.820731 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 16:59:56.820986 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 16:59:56.821398 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.821729 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.822052 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.822372 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.822790 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.823018 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.823342 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.823586 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 16:59:56.823940 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.824028 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 16:59:56.824103 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.824247 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.824403 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 16:59:56.824557 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.824710 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 16:59:56.824885 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854030-1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.824982 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 16:59:56.825240 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.825459 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.825580 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.825901 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.826029 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.826225 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.826363 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.826536 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.826692 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.826861 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.827016 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.827178 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.827340 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.827641 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.827747 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.827963 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.828152 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.828335 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.828526 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.828704 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.828881 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.829046 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.829236 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.829434 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854030-1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.829631 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.829816 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.829988 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.830208 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.830387 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.830557 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.830710 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.830923 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.831099 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.831269 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.831444 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.831614 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.831775 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854030-1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.831941 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.832124 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.832296 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.832476 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.832639 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.832810 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.832980 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.833192 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.833364 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.833529 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.833705 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.833859 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.834050 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.834222 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.834692 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.834852 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.835015 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.835173 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.835352 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.835533 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.835707 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.835863 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.836027 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.836177 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.836325 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854030-1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.836488 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.836644 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.836797 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.836951 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.837123 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.837274 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.837434 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.837580 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.837757 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.837914 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.838073 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.838223 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.838377 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.838524 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.838671 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.838826 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.838972 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.839118 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.839279 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.839431 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.839578 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.839731 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.839878 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.840043 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.840191 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.840191 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.840497 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.840646 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.840793 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.841716 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.841880 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.842030 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.842177 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.842344 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.842507 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.842655 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.842811 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.842966 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.843112 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.843112 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.843399 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.843399 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.843694 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.843840 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.843993 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.844154 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.844324 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.844502 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.844838 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.844992 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.845168 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.845331 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.845486 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.845635 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.845783 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.845930 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.846076 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.846237 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.96 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.846391 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.846538 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.96 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.846692 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.846839 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.846984 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.847143 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.847291 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.847437 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.847582 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.847729 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.847883 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.848029 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.848242 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.848411 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.848559 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.848707 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.848863 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.849016 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.849228 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.849375 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.849521 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.849665 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.849894 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.850043 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.850189 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.850335 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.850493 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.96 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.850640 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.850800 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.96 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.850954 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.851099 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.851245 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.851392 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.851547 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.851747 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.852159 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.852313 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.852465 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.852616 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.852777 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.852925 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.853073 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.853257 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.853413 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.853559 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.853715 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.853860 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.854007 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.854152 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.854312 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.854473 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.854636 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.854970 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.855133 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.855281 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.855428 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.855575 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.855730 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.855884 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.856040 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.856200 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.856359 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.856514 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.857630 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.857802 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.857962 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.858120 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.858279 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.858443 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.858593 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.858750 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.858913 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.859075 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.859233 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.859393 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.859544 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.859695 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.859852 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.860002 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.860151 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.860313 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.860471 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.860622 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.860787 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.861003 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.861226 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.861425 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.861621 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.861805 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.861986 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.862158 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.862327 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.862487 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.862635 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.862790 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.862942 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.863089 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.863246 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.863405 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.863552 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.863700 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.863847 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.864005 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.864154 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.864330 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.864486 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.864633 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.864780 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.865182 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.865357 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.865511 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.865670 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.865829 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.865981 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.866144 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.866318 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.866478 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.866632 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.866783 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.866934 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.867084 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.867243 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.867399 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.867557 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.867715 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.867873 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.868035 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.868199 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.868356 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.868508 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.868661 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.868812 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.868971 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.869147 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.869308 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.869457 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.869605 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.869754 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.869921 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.870068 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.870221 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.870368 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.870515 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.870663 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.870821 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.870970 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.871124 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.871272 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.871419 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.871567 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.871723 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.871883 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.872038 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.872227 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.872406 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 16:59:56.872572 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.872724 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.872878 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.873035 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.873200 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.873362 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.873563 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.873715 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.873872 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.874019 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.874168 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.874320 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.874494 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.874652 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.874799 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.874948 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.875293 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.875460 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.875624 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.875776 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.875934 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.876086 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.876238 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.876396 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.876396 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.876705 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.876705 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.876992 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.876992 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.877317 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.877475 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.877633 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.877789 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.877935 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.878085 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.878318 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.878475 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.878630 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.878785 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.878932 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.879088 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.879246 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.879395 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.879542 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.879689 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.879852 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.880007 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.880168 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.880319 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.880483 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.880636 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.880793 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.880943 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.881146 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.881299 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.881447 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.881608 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.881824 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.882003 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.882152 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.882309 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.882470 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.882632 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.882782 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.882938 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.883092 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.883239 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.883394 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.883557 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.883728 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.883889 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.884044 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.884190 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.884338 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.884496 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.884661 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.884817 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.884972 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.885173 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.885471 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.885625 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.885789 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.885948 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.886100 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.886251 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.886401 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.886552 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.886717 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.886869 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.887035 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.887186 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.887337 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.887495 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.887656 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.887934 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.888091 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.888243 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.888395 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.888555 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.888716 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.888873 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.889039 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.889229 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.889379 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.889527 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.889686 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.889834 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.889982 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.890138 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.890286 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.890444 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.890591 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.890742 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.890895 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.891044 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.891191 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.891347 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.891496 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.891646 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.891794 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.891950 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.892097 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.892266 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.892414 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.892576 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.892761 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.892761 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.893059 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.893250 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.893401 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.893550 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.893711 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.893892 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.894054 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.894202 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.894349 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.894497 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.894669 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.894834 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.895001 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.895160 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.895318 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.895667 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.895827 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.895981 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.896139 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.896291 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.896440 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.896592 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.896742 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.896893 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.897057 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.897250 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.897399 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.897548 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.897696 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.897862 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.898012 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.898160 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.898308 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.898456 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.898604 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.898761 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.898916 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.899068 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.899215 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.899370 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.899533 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.899770 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.899942 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.900103 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.900254 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.900405 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.900554 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.900714 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.900866 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.901023 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.901262 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.901412 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.901577 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.901726 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.901873 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.902032 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.902181 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.902181 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.902545 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.902717 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.902887 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.903035 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.903190 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.903340 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.904033 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.904214 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.904365 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.904513 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.904662 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.904829 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.905123 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.905281 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.905444 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.905760 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.905918 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.906084 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.906236 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.906395 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.906556 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.906709 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.906860 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.907019 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.907176 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.907327 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.907480 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.907630 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.907781 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.907940 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.908096 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.908247 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.908397 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.908557 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.908708 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.908872 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.909024 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.909199 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.909347 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.909495 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.909656 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.909806 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.909959 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.910107 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.910254 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.910254 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.910553 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.910710 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.910893 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.911056 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.911203 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.911353 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.911510 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.911662 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.911817 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.911971 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.912126 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.912275 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.912430 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.912591 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.912740 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.912905 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.913096 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.913255 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.913416 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.913573 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.913724 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.913872 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.914026 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.914200 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.914360 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.914515 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.914678 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.914844 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.914998 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.915158 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.915310 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.915461 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.915612 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.915776 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.916069 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.916234 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.916393 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.916554 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.916712 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.916878 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.917031 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.917289 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.917440 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.917596 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.917744 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.917896 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.918058 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.918208 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.918368 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.918517 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.918664 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.918819 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.918983 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.920016 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.920182 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.920340 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.920511 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.920675 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.920837 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.920989 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.921237 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.921388 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.921535 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.921683 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.921849 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.921997 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.922146 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.922293 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.922439 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.922595 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.922743 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.922892 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.923051 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.923220 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.923369 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.923525 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.923682 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.923830 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.923981 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.924129 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.924307 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.924480 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.924629 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.924778 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.924938 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.925131 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.925291 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.925454 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.925615 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.925787 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.926088 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.926244 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.926406 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.926564 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.926715 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.926867 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.927017 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.927167 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.927327 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.927485 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.927637 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.927801 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.927958 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.928116 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.928277 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.928430 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.928580 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.928732 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.928881 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.929032 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.929223 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.929373 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.929533 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.929681 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.929829 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.929976 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.930136 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.930337 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.930485 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.930634 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.930788 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.930945 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.931094 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.931241 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.931394 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.931545 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.931699 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.931860 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.932009 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.932156 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.932311 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.932458 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.932607 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.932874 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.933058 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.933058 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.933395 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.933549 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.933700 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.933936 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.934095 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.934253 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.934427 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.934593 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.934964 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.935129 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.935278 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.935427 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.935574 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.935723 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.935885 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.936186 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.936341 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.936539 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.936721 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.936877 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.937031 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.937281 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.937438 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.937595 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.937741 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.937741 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.938022 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.938187 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.938335 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.938481 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.938628 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.938773 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.938920 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.939079 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.939227 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.939374 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.939519 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.939667 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.939826 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.939981 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.940129 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.940274 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.940420 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.940581 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.940736 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.940884 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.941044 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.941241 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.941403 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.954690 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.954845 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.954948 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.955033 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.955114 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.955114 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.955315 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.955397 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.955487 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.955569 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.955656 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.955737 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.955737 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.955895 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.955986 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.956070 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.956149 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.956227 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.956227 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.956465 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.956565 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.956655 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.956736 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.956870 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.956961 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.957053 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.957208 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.957289 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.957369 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.957448 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.957526 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.957620 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.957710 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.957798 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.957886 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.957967 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.958046 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.958134 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.958216 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.958294 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.958373 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.958451 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.958543 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.958625 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.958625 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.958778 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.958861 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.958939 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.959027 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.959135 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.959256 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.959338 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.959469 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.959553 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.959644 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.959734 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.959817 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.959896 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.959974 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.960053 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.960140 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.960222 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.960308 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.960389 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.960474 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.960562 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.960644 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.960731 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.960819 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.960900 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.960979 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.961066 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.961186 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.961279 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.961361 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.961440 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.961520 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.961612 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.961694 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.961773 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.961859 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.961940 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.962019 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.962106 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.962186 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.962265 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.962344 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.962422 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.962509 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.962590 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.962668 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.962758 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.962839 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.962917 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.963005 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.963085 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.963164 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.963243 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.963322 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.963408 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.963497 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.963578 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.963665 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.963747 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.963877 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.963960 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.964206 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.964367 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.964453 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.964533 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.964612 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.964612 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.964769 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.964849 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.964975 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.965064 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.965166 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.965261 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.965343 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.965430 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.965510 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.965588 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.965667 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.965754 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.965842 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.966440 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.966518 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.966639 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.966737 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.966869 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.966988 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.967084 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.967174 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.967263 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.967351 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.967431 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.967510 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.967596 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.967676 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.967754 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.967841 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.967928 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.968016 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.968096 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.968175 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.968253 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.968344 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.968425 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.968504 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.968583 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.968661 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.968739 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.968827 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.968907 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.968985 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.969070 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.969233 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.969327 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.969417 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.969498 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.969578 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.969663 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.969743 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.969830 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.969911 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.969998 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.970077 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.970156 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.970266 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.970498 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.970599 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.970682 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.970750 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.970878 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.970963 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.971057 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.971139 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.971218 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.971304 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.971384 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.971463 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.971550 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.971631 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.971717 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.971798 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.971884 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.971972 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.972054 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.972133 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.972212 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.972291 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.972370 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.972458 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.972539 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.972618 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.972704 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.972791 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.972878 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.972965 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.973054 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.973188 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.973270 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.973362 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.973444 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.973533 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.973615 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.973694 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.973780 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.973860 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.973948 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.974028 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.974114 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.974194 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.974274 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.974342 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.974416 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.974416 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.974551 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.974624 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.974691 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.974691 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.974818 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.974893 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.974961 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.975026 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.975140 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.975227 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.975315 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.975452 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.975544 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.975625 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.975711 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.975804 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.975886 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.975965 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.976043 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.976122 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.976208 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.976296 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.976377 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.976456 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.976535 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.976662 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.976755 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.977115 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.977234 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.977334 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.977418 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.977497 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.977576 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.977666 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.977747 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.977827 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.977906 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.977984 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.978073 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.978154 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.978233 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.978313 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.978392 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.978471 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.978559 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.978642 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.978722 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.978801 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.978880 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.978959 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.979045 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.979133 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.979220 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.979300 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.979379 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.979465 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.979554 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.979637 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.979716 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.979795 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.979874 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.980011 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.980096 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.980175 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.980255 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.980334 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.980413 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.980501 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.980590 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.980669 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.980749 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.980841 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.980930 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.981119 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.981119 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.981284 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.981365 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.981445 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.981552 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.981662 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.982302 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.982411 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.982411 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.982564 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.982662 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.982765 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.982856 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.982945 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.983034 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.983121 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.983212 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.983294 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.983382 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.983465 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.983552 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.983633 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.983712 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.983799 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.983888 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.983976 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.984057 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.984225 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.984318 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.984538 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.984639 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.984844 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.984945 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.985192 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.985331 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.985503 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.985612 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.985811 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.985900 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.986121 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.986209 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.986421 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.986518 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.986730 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.986821 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.987045 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.987151 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.987350 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.987448 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.987655 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.987755 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.987977 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.988066 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.988283 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.988373 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.988605 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.988693 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.988918 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.989006 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.989268 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.989360 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.989595 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.989694 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.989897 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.990058 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.990211 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.990301 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.990514 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.990602 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.990816 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.990914 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.991117 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.991204 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.991424 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.991520 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.991729 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.991826 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.992037 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.992126 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.992343 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.992477 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.992644 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.992743 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.992942 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.993031 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.993286 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.993380 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.993587 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.993677 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.993904 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.993993 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.994212 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.994301 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.994531 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.994621 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.994847 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.994935 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.995148 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.995236 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.995462 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.995557 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.995760 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.995856 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.996062 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.996150 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.996362 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.996452 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.996662 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.996750 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.996969 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.997134 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.997366 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.997487 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.997800 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.997996 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.998139 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.998276 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.998412 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.998585 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.998717 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.998895 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.999025 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.999227 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.999368 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.999580 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.999720 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.999846 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:56.999971 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.000166 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.000298 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.000488 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.000618 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.000790 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.000929 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.001105 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.001239 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.001423 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.001567 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.001728 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.001873 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.002031 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.002161 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.002332 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.002461 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.002636 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.002776 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.002935 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.003072 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.003235 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.003372 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.003534 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.003676 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.003851 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.003982 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.004150 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.004288 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.004465 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.004602 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.004765 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.004901 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.005063 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.005209 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.005392 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.005671 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.005801 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.006066 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.006215 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.006343 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.006476 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.006604 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.006729 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.006913 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.007044 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.007225 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.007367 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.007537 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.007674 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.007845 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.007974 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.008153 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.008283 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.008461 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.008590 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.008771 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.008900 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.009122 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.009258 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.009418 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.009550 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.009725 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.009858 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.010036 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.010177 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.010352 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.010484 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.010666 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.010806 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.010978 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.011224 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.011357 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.011549 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.011680 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.011861 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.011993 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.012169 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.012301 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.012477 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.012617 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.013325 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.013467 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.013678 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.013838 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.013991 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.014307 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.014438 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.014623 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.014753 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.014936 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.015058 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.015245 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.015375 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.015562 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.015706 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.015876 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.016007 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.016190 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.016323 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.016515 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.016689 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.016822 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.016957 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.017160 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.017293 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.017475 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.017620 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.017788 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.017928 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.018104 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.018233 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.018437 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.018627 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.018770 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.018944 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.019075 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.019278 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.019417 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.019606 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.019820 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.019950 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.020075 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.020208 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.020334 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.020516 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.020650 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.020831 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.020961 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.021159 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.021294 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.021467 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.021600 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.021774 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.021905 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.022080 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.022208 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.022383 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.022514 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.022707 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.022838 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.023019 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.023149 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.023325 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.023457 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.023633 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.023762 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.023941 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.024076 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.024461 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.024591 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.024772 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.024910 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.025113 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.025443 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.025573 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.025764 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.026060 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.026191 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.026379 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.026510 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.026705 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.026822 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.027007 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.027124 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.027310 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.027449 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.027618 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.027749 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.027925 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.028056 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.028224 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.028363 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.029208 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.029322 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.029483 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.029748 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.029849 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.030066 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.030157 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.030397 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.030563 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.030705 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.030854 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.031050 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.031238 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.031440 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.031598 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.031740 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.031888 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.032035 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.032177 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.032315 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.032474 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.032615 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.032771 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.032912 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.033050 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.033228 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.033371 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.033562 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.033712 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.033852 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.033999 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.034162 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.034311 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.034470 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.034618 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.034759 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.034905 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.035105 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.035300 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.035618 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.035765 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.035927 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.036188 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.036335 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.036530 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.036701 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.036849 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.036994 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.037159 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.037315 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.037517 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.037664 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.037835 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.037981 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.038146 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.038298 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.038447 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.038597 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.038755 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.038896 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.039034 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.039173 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.039320 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.039460 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.039600 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.039738 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.039901 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.040202 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.040356 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.040508 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.040657 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.040807 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.040946 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.041170 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.041320 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.041458 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.041597 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.041747 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.041887 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.042034 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.042175 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.042321 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.042461 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.042599 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.042749 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.042898 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.043039 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.043177 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.043348 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.043495 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.043644 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.043786 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.043961 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.044108 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.044392 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.044562 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.044730 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.044933 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.045100 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.045372 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.045517 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.045764 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.045935 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.046077 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.046216 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.046362 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.046587 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.046744 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.046978 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.047149 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.047291 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.047435 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.047579 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.047726 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.047868 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.048009 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.048179 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.048350 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.048511 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.048667 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.048809 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.048973 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.049153 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.049398 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.049545 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.049698 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.049837 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.050002 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.050235 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.050387 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.050604 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.050748 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.050886 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.051033 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.051186 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.051326 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.051478 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.051621 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.051761 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.051898 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.052037 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.052176 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.052328 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.052470 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.052610 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.052748 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.052905 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.053053 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.053271 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.053426 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.053567 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.053705 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.053853 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.054003 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.054151 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.054293 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.054431 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.054570 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.054720 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.054868 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.055008 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.055148 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.055339 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.055494 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.055682 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.055841 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.055983 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.056122 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.056268 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.056408 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.056582 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.056740 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.056911 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.057060 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.057285 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.057427 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.057580 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.057731 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.057871 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.058008 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.058156 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.058297 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.058445 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.058596 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.058736 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.058874 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.059035 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.059195 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.059337 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.059476 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.059637 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.059807 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.059978 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.060287 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.060603 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.060749 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.060899 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.061039 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.061211 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.061364 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.061504 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.061644 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.061784 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.061922 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.062068 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.062218 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.062358 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.062505 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.062647 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.062806 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.062959 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.063100 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.063238 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.063377 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.063515 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.063654 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.063801 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.064016 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.064159 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.064298 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.064437 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.064591 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.064746 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.064887 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.065025 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.065231 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.065383 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.065532 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.065700 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.065807 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.065894 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.066059 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.066157 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.066337 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.066440 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.066662 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.066756 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.066987 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.067088 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.067308 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.067400 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.067623 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.067712 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.067917 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.068025 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.068214 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.068321 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.068522 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.068683 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.068827 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.068934 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.069156 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.069252 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.069463 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.069562 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.069818 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.069931 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.070070 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.070160 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.070400 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.070490 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.070711 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.070814 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.071041 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.071130 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.071360 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.071449 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.071669 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.071759 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.071989 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.072088 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.072300 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.072397 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.072623 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.072737 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.072931 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.073019 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.073269 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.073361 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.073580 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.073669 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.073892 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.073983 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.074205 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.074302 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.074514 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.074604 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.074823 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.074919 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.075129 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.075227 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.075994 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.076154 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.076397 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.076559 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.076869 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.076972 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.077227 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.077323 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.077544 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.077636 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.077874 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.077974 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.078204 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.078293 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.078528 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.078626 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.078844 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.078935 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.079157 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.079254 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.079488 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.079577 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.079798 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.079892 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.080108 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.080201 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.080416 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.080505 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.080665 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 16:59:57.080762 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.081022 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.081365 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.081675 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.081985 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.082298 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.082628 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.082937 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.083261 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.083570 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.083893 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.084217 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.084567 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.084879 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.085247 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.085577 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.085893 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.086217 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.086503 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 16:59:57.086746 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 16:59:57.235076 n-d-854030-1 devstack@n-api.service[107010]: INFO dbcounter [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] Registered counter for database nova_api Aug 22 16:59:57.243999 n-d-854030-1 devstack@n-api.service[107009]: INFO dbcounter [None req-8f6ae683-fe2f-4055-99fd-01561c5915da None None] Registered counter for database nova_api Aug 22 16:59:57.255834 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_db.sqlalchemy.engines [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 16:59:57.262573 n-d-854030-1 devstack@n-api.service[107010]: DEBUG dbcounter [-] [107010] Writer thread running {{(pid=107010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 16:59:57.265152 n-d-854030-1 devstack@n-api.service[107009]: DEBUG oslo_db.sqlalchemy.engines [None req-8f6ae683-fe2f-4055-99fd-01561c5915da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107009) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 16:59:57.271554 n-d-854030-1 devstack@n-api.service[107009]: DEBUG dbcounter [-] [107009] Writer thread running {{(pid=107009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 16:59:57.319066 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.context [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0e788ee0-d5b8-44d6-b202-c201e1b338b4(cell1) {{(pid=107010) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 16:59:57.323031 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_concurrency.lockutils [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:59:57.323447 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_concurrency.lockutils [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:59:57.325030 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_concurrency.lockutils [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:59:57.326325 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_concurrency.lockutils [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:59:57.326770 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_concurrency.lockutils [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:59:57.328316 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.context [None req-8f6ae683-fe2f-4055-99fd-01561c5915da None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0e788ee0-d5b8-44d6-b202-c201e1b338b4(cell1) {{(pid=107009) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 16:59:57.328781 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_concurrency.lockutils [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:59:57.330821 n-d-854030-1 devstack@n-api.service[107010]: INFO dbcounter [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] Registered counter for database nova_cell0 Aug 22 16:59:57.332188 n-d-854030-1 devstack@n-api.service[107009]: DEBUG oslo_concurrency.lockutils [None req-8f6ae683-fe2f-4055-99fd-01561c5915da None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:59:57.332675 n-d-854030-1 devstack@n-api.service[107009]: DEBUG oslo_concurrency.lockutils [None req-8f6ae683-fe2f-4055-99fd-01561c5915da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:59:57.334290 n-d-854030-1 devstack@n-api.service[107009]: DEBUG oslo_concurrency.lockutils [None req-8f6ae683-fe2f-4055-99fd-01561c5915da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:59:57.335035 n-d-854030-1 devstack@n-api.service[107009]: DEBUG oslo_concurrency.lockutils [None req-8f6ae683-fe2f-4055-99fd-01561c5915da None None] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 16:59:57.335471 n-d-854030-1 devstack@n-api.service[107009]: DEBUG oslo_concurrency.lockutils [None req-8f6ae683-fe2f-4055-99fd-01561c5915da None None] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 16:59:57.336284 n-d-854030-1 devstack@n-api.service[107010]: INFO dbcounter [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] Registered counter for database nova_cell1 Aug 22 16:59:57.337476 n-d-854030-1 devstack@n-api.service[107009]: DEBUG oslo_concurrency.lockutils [None req-8f6ae683-fe2f-4055-99fd-01561c5915da None None] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107009) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 16:59:57.340940 n-d-854030-1 devstack@n-api.service[107009]: INFO dbcounter [None req-8f6ae683-fe2f-4055-99fd-01561c5915da None None] Registered counter for database nova_cell0 Aug 22 16:59:57.345712 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_db.sqlalchemy.engines [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 16:59:57.346514 n-d-854030-1 devstack@n-api.service[107009]: INFO dbcounter [None req-8f6ae683-fe2f-4055-99fd-01561c5915da None None] Registered counter for database nova_cell1 Aug 22 16:59:57.346810 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_db.sqlalchemy.engines [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 16:59:57.355740 n-d-854030-1 devstack@n-api.service[107009]: DEBUG oslo_db.sqlalchemy.engines [None req-8f6ae683-fe2f-4055-99fd-01561c5915da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107009) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 16:59:57.356923 n-d-854030-1 devstack@n-api.service[107009]: DEBUG oslo_db.sqlalchemy.engines [None req-8f6ae683-fe2f-4055-99fd-01561c5915da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107009) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 16:59:57.358239 n-d-854030-1 devstack@n-api.service[107010]: DEBUG dbcounter [-] [107010] Writer thread running {{(pid=107010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 16:59:57.361708 n-d-854030-1 devstack@n-api.service[107010]: DEBUG dbcounter [-] [107010] Writer thread running {{(pid=107010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 16:59:57.363874 n-d-854030-1 devstack@n-api.service[107009]: DEBUG dbcounter [-] [107009] Writer thread running {{(pid=107009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 16:59:57.365447 n-d-854030-1 devstack@n-api.service[107009]: DEBUG dbcounter [-] [107009] Writer thread running {{(pid=107009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 16:59:57.505969 n-d-854030-1 devstack@n-api.service[107010]: INFO dbcounter [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] Registered counter for database nova_cell0 Aug 22 16:59:57.512790 n-d-854030-1 devstack@n-api.service[107009]: INFO dbcounter [None req-8f6ae683-fe2f-4055-99fd-01561c5915da None None] Registered counter for database nova_cell0 Aug 22 16:59:57.513975 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_db.sqlalchemy.engines [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 16:59:57.518679 n-d-854030-1 devstack@n-api.service[107010]: DEBUG dbcounter [-] [107010] Writer thread running {{(pid=107010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 16:59:57.522946 n-d-854030-1 devstack@n-api.service[107009]: DEBUG oslo_db.sqlalchemy.engines [None req-8f6ae683-fe2f-4055-99fd-01561c5915da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107009) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 16:59:57.527466 n-d-854030-1 devstack@n-api.service[107009]: DEBUG dbcounter [-] [107009] Writer thread running {{(pid=107009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 16:59:57.955579 n-d-854030-1 devstack@n-api.service[107010]: WARNING keystonemiddleware.auth_token [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 16:59:57.962992 n-d-854030-1 devstack@n-api.service[107010]: WARNING keystonemiddleware.auth_token [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 16:59:57.990315 n-d-854030-1 devstack@n-api.service[107009]: WARNING keystonemiddleware.auth_token [None req-8f6ae683-fe2f-4055-99fd-01561c5915da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 16:59:57.998244 n-d-854030-1 devstack@n-api.service[107009]: WARNING keystonemiddleware.auth_token [None req-8f6ae683-fe2f-4055-99fd-01561c5915da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 16:59:58.313487 n-d-854030-1 devstack@n-api.service[107010]: WARNING keystonemiddleware.auth_token [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 16:59:58.319488 n-d-854030-1 devstack@n-api.service[107010]: WARNING keystonemiddleware.auth_token [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 16:59:58.324939 n-d-854030-1 devstack@n-api.service[107010]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fb821a39c0 pid: 107010 (default app) Aug 22 16:59:58.327814 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 16:59:58.329003 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] 10.222.0.96 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001816 Aug 22 16:59:58.329911 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 1/1] 10.222.0.96 () {50 vars in 788 bytes} [Mon Aug 22 16:59:58 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 16:59:58.346053 n-d-854030-1 devstack@n-api.service[107009]: WARNING keystonemiddleware.auth_token [None req-8f6ae683-fe2f-4055-99fd-01561c5915da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 16:59:58.352428 n-d-854030-1 devstack@n-api.service[107009]: WARNING keystonemiddleware.auth_token [None req-8f6ae683-fe2f-4055-99fd-01561c5915da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 16:59:58.357931 n-d-854030-1 devstack@n-api.service[107009]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fb821a39c0 pid: 107009 (default app) Aug 22 17:01:21.151265 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:01:21.153017 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002188 Aug 22 17:01:21.153466 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 2/2] 10.222.0.96 () {54 vars in 931 bytes} [Mon Aug 22 17:01:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:01:21.165926 n-d-854030-1 devstack@n-api.service[107009]: DEBUG dbcounter [-] [107009] Writing DB stats nova_api:SELECT=3 {{(pid=107009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:21.167200 n-d-854030-1 devstack@n-api.service[107009]: DEBUG dbcounter [-] [107009] Writing DB stats nova_cell1:SELECT=3 {{(pid=107009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:21.168311 n-d-854030-1 devstack@n-api.service[107009]: DEBUG dbcounter [-] [107009] Writing DB stats nova_cell0:SELECT=3 {{(pid=107009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:21.169181 n-d-854030-1 devstack@n-api.service[107009]: DEBUG dbcounter [-] [107009] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=107009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:22.066824 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-0bbc5e35-f148-478a-8187-899c8d27c763 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:01:22.100898 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-0bbc5e35-f148-478a-8187-899c8d27c763 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.939763 Aug 22 17:01:22.101582 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 1/3] 10.222.0.96 () {60 vars in 1292 bytes} [Mon Aug 22 17:01:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:01:24.538156 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:01:24.539454 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-9d698e63-8674-489c-a08c-5225f90f17cc None None] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 22 17:01:24.540257 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 3/4] 10.222.0.96 () {54 vars in 931 bytes} [Mon Aug 22 17:01:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:01:25.057960 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-eb340e3b-007b-449d-9ca6-4490865b2942 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1", "ram": 256, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:25.079343 n-d-854030-1 devstack@n-api.service[107009]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:01:25.079343 n-d-854030-1 devstack@n-api.service[107009]: warnings.warn(msg) Aug 22 17:01:25.178378 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-eb340e3b-007b-449d-9ca6-4490865b2942 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.631393 Aug 22 17:01:25.178959 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 2/5] 10.222.0.96 () {64 vars in 1283 bytes} [Mon Aug 22 17:01:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:01:25.196753 n-d-854030-1 devstack@n-api.service[107010]: DEBUG dbcounter [-] [107010] Writing DB stats nova_api:SELECT=3 {{(pid=107010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:25.198914 n-d-854030-1 devstack@n-api.service[107010]: DEBUG dbcounter [-] [107010] Writing DB stats nova_cell0:SELECT=3 {{(pid=107010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:25.202849 n-d-854030-1 devstack@n-api.service[107010]: DEBUG dbcounter [-] [107010] Writing DB stats nova_cell1:SELECT=3 {{(pid=107010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:25.204359 n-d-854030-1 devstack@n-api.service[107010]: DEBUG dbcounter [-] [107010] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=107010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:25.446067 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-b3f2ad83-65c1-4bbd-a7f2-7f7cc1b4790e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:25.450491 n-d-854030-1 devstack@n-api.service[107010]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:01:25.450491 n-d-854030-1 devstack@n-api.service[107010]: warnings.warn(msg) Aug 22 17:01:25.574536 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-b3f2ad83-65c1-4bbd-a7f2-7f7cc1b4790e admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.384350 Aug 22 17:01:25.575148 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 4/6] 10.222.0.96 () {64 vars in 1336 bytes} [Mon Aug 22 17:01:25 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:01:28.201546 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-eb340e3b-007b-449d-9ca6-4490865b2942 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:01:28.202827 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-eb340e3b-007b-449d-9ca6-4490865b2942 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001649 Aug 22 17:01:28.203376 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 3/7] 10.222.0.96 () {54 vars in 931 bytes} [Mon Aug 22 17:01:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:01:29.066681 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-8bd3ba75-98ff-4b7e-8085-afb0a1516dd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 5, "ram": 512, "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d1", "vcpus": 1}} {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:29.088758 n-d-854030-1 devstack@n-api.service[107010]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:01:29.088758 n-d-854030-1 devstack@n-api.service[107010]: warnings.warn(msg) Aug 22 17:01:29.233051 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-8bd3ba75-98ff-4b7e-8085-afb0a1516dd1 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.021317 Aug 22 17:01:29.234548 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 5/8] 10.222.0.96 () {64 vars in 1283 bytes} [Mon Aug 22 17:01:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:01:29.248597 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-d6bfb730-8aaa-43e8-906d-f2d04db978b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:29.253275 n-d-854030-1 devstack@n-api.service[107009]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:01:29.253275 n-d-854030-1 devstack@n-api.service[107009]: warnings.warn(msg) Aug 22 17:01:29.370031 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-d6bfb730-8aaa-43e8-906d-f2d04db978b6 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126618 Aug 22 17:01:29.382233 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 4/9] 10.222.0.96 () {64 vars in 1336 bytes} [Mon Aug 22 17:01:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:01:32.187765 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-8bd3ba75-98ff-4b7e-8085-afb0a1516dd1 admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:01:32.189581 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-8bd3ba75-98ff-4b7e-8085-afb0a1516dd1 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002274 Aug 22 17:01:32.200449 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 6/10] 10.222.0.96 () {54 vars in 931 bytes} [Mon Aug 22 17:01:32 2022] GET /compute/v2.1 => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:01:32.703972 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-6d497d0e-e876-4b62-be9c-b2b09a14a3d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "disk": 10, "vcpus": 1, "name": "ds1G"}} {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:32.763131 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-6d497d0e-e876-4b62-be9c-b2b09a14a3d0 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.566176 Aug 22 17:01:32.764203 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 5/11] 10.222.0.96 () {64 vars in 1283 bytes} [Mon Aug 22 17:01:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:01:32.780115 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-a72bc9ba-0fc0-4927-af74-04bb96b42574 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:32.882166 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-a72bc9ba-0fc0-4927-af74-04bb96b42574 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105943 Aug 22 17:01:32.895738 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 7/12] 10.222.0.96 () {64 vars in 1336 bytes} [Mon Aug 22 17:01:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:01:35.530029 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-6d497d0e-e876-4b62-be9c-b2b09a14a3d0 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:01:35.530946 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-6d497d0e-e876-4b62-be9c-b2b09a14a3d0 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Aug 22 17:01:35.531442 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 6/13] 10.222.0.96 () {54 vars in 931 bytes} [Mon Aug 22 17:01:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:01:35.979475 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-ba78daf4-3228-44c7-8311-578826fe575b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "id": "d3", "os-flavor-access:is_public": true}} {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:36.056641 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-ba78daf4-3228-44c7-8311-578826fe575b admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.518542 Aug 22 17:01:36.057377 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 8/14] 10.222.0.96 () {64 vars in 1283 bytes} [Mon Aug 22 17:01:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:01:36.070664 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-af871e5a-e93d-480c-a415-89d8166306f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:36.160301 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-af871e5a-e93d-480c-a415-89d8166306f7 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093217 Aug 22 17:01:36.173109 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 7/15] 10.222.0.96 () {64 vars in 1336 bytes} [Mon Aug 22 17:01:36 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:01:38.708083 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-ba78daf4-3228-44c7-8311-578826fe575b admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:01:38.709690 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-ba78daf4-3228-44c7-8311-578826fe575b admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002117 Aug 22 17:01:38.721167 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 9/16] 10.222.0.96 () {54 vars in 931 bytes} [Mon Aug 22 17:01:38 2022] GET /compute/v2.1 => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:01:39.339639 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-0817994d-947c-4c09-adec-b7b81c332fa9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "id": "d4", "swap": 0, "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096}} {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:39.424923 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-0817994d-947c-4c09-adec-b7b81c332fa9 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.707838 Aug 22 17:01:39.434951 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 8/17] 10.222.0.96 () {64 vars in 1283 bytes} [Mon Aug 22 17:01:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:01:39.441214 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-3e099d0e-68f9-4573-86ab-d70cfc645caf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:39.570491 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-3e099d0e-68f9-4573-86ab-d70cfc645caf admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.133835 Aug 22 17:01:39.571321 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 10/18] 10.222.0.96 () {64 vars in 1336 bytes} [Mon Aug 22 17:01:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:01:42.038771 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-0817994d-947c-4c09-adec-b7b81c332fa9 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:01:42.040386 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-0817994d-947c-4c09-adec-b7b81c332fa9 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002159 Aug 22 17:01:42.040792 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 9/19] 10.222.0.96 () {54 vars in 931 bytes} [Mon Aug 22 17:01:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:01:42.498632 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-2ddc7a15-e5ec-44ad-a4dc-5399fcf157bb admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:01:42.525472 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-2ddc7a15-e5ec-44ad-a4dc-5399fcf157bb admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.477320 Aug 22 17:01:42.526304 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 11/20] 10.222.0.96 () {60 vars in 1292 bytes} [Mon Aug 22 17:01:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:01:45.004447 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-0817994d-947c-4c09-adec-b7b81c332fa9 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:01:45.005532 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-0817994d-947c-4c09-adec-b7b81c332fa9 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 22 17:01:45.005949 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 10/21] 10.222.0.96 () {54 vars in 931 bytes} [Mon Aug 22 17:01:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:01:45.467144 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-f55b9eb8-8120-4c8b-a0c6-4dc004301a01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:45.536138 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-f55b9eb8-8120-4c8b-a0c6-4dc004301a01 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.523823 Aug 22 17:01:45.536717 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 12/22] 10.222.0.96 () {64 vars in 1283 bytes} [Mon Aug 22 17:01:45 2022] POST /compute/v2.1/flavors => generated 402 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:01:45.549376 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-8e4a3f0c-531c-4210-938f-8a370eaf5434 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:45.637368 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-8e4a3f0c-531c-4210-938f-8a370eaf5434 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092072 Aug 22 17:01:45.637871 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 11/23] 10.222.0.96 () {64 vars in 1333 bytes} [Mon Aug 22 17:01:45 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:01:48.326524 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-f55b9eb8-8120-4c8b-a0c6-4dc004301a01 admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:01:48.328600 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-f55b9eb8-8120-4c8b-a0c6-4dc004301a01 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002262 Aug 22 17:01:48.329352 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 13/24] 10.222.0.96 () {54 vars in 931 bytes} [Mon Aug 22 17:01:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:01:48.889118 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-d4add942-a8c4-482b-89a0-6e111cafa526 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 20}} {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:48.969779 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-d4add942-a8c4-482b-89a0-6e111cafa526 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.631800 Aug 22 17:01:48.970359 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 12/25] 10.222.0.96 () {64 vars in 1283 bytes} [Mon Aug 22 17:01:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:01:48.986163 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-131026d7-fed3-4d0f-8db7-765c0d8558b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:49.078877 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-131026d7-fed3-4d0f-8db7-765c0d8558b7 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097654 Aug 22 17:01:49.079556 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 14/26] 10.222.0.96 () {64 vars in 1333 bytes} [Mon Aug 22 17:01:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:01:51.552231 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-d4add942-a8c4-482b-89a0-6e111cafa526 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:01:51.553185 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-d4add942-a8c4-482b-89a0-6e111cafa526 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 22 17:01:51.553592 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 13/27] 10.222.0.96 () {54 vars in 931 bytes} [Mon Aug 22 17:01:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:01:51.968509 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-bf769cc9-d20c-4ce1-b95e-659ea9b59848 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "vcpus": 2, "ram": 4096, "swap": 0}} {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:52.084443 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-bf769cc9-d20c-4ce1-b95e-659ea9b59848 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.524421 Aug 22 17:01:52.084975 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 15/28] 10.222.0.96 () {64 vars in 1283 bytes} [Mon Aug 22 17:01:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:01:52.097615 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-05cebdb6-27fa-4b9c-9d57-1f4360468109 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:52.104800 n-d-854030-1 devstack@n-api.service[107009]: DEBUG dbcounter [-] [107009] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=107009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:52.192411 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-05cebdb6-27fa-4b9c-9d57-1f4360468109 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098419 Aug 22 17:01:52.192982 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 14/29] 10.222.0.96 () {64 vars in 1333 bytes} [Mon Aug 22 17:01:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:01:54.627497 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-bf769cc9-d20c-4ce1-b95e-659ea9b59848 admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:01:54.628503 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-bf769cc9-d20c-4ce1-b95e-659ea9b59848 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 22 17:01:54.629274 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 16/30] 10.222.0.96 () {54 vars in 931 bytes} [Mon Aug 22 17:01:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:01:55.097248 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-003c70de-1111-42f1-a00a-f984aa84f237 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "disk": 80, "name": "m1.large", "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:55.665642 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-003c70de-1111-42f1-a00a-f984aa84f237 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.026517 Aug 22 17:01:55.665642 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 15/31] 10.222.0.96 () {64 vars in 1283 bytes} [Mon Aug 22 17:01:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:01:55.677241 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-16252926-0f50-4423-b0cc-482577f07c70 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:55.771444 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-16252926-0f50-4423-b0cc-482577f07c70 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097838 Aug 22 17:01:55.777712 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 17/32] 10.222.0.96 () {64 vars in 1333 bytes} [Mon Aug 22 17:01:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:01:58.295148 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-003c70de-1111-42f1-a00a-f984aa84f237 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:01:58.297418 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-003c70de-1111-42f1-a00a-f984aa84f237 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002674 Aug 22 17:01:58.301403 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 16/33] 10.222.0.96 () {54 vars in 931 bytes} [Mon Aug 22 17:01:58 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:01:58.819331 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-5e407463-bbec-4f86-a2cc-5d030880c141 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "rxtx_factor": 1.0, "id": "5", "ram": 16384, "os-flavor-access:is_public": true, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160}} {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:58.827996 n-d-854030-1 devstack@n-api.service[107010]: DEBUG dbcounter [-] [107010] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=107010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:01:58.898292 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-5e407463-bbec-4f86-a2cc-5d030880c141 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.593204 Aug 22 17:01:58.900079 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 18/34] 10.222.0.96 () {64 vars in 1283 bytes} [Mon Aug 22 17:01:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:01:58.914030 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-ccdc2640-bab5-4c96-b420-849df2429ef3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:01:59.183344 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-ccdc2640-bab5-4c96-b420-849df2429ef3 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.273224 Aug 22 17:01:59.193755 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 17/35] 10.222.0.96 () {64 vars in 1333 bytes} [Mon Aug 22 17:01:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:02:22.323203 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-5e407463-bbec-4f86-a2cc-5d030880c141 admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:22.324248 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-5e407463-bbec-4f86-a2cc-5d030880c141 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 22 17:02:22.324653 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 19/36] 10.222.0.96 () {54 vars in 931 bytes} [Mon Aug 22 17:02:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:02:22.341895 n-d-854030-1 devstack@n-api.service[107009]: DEBUG dbcounter [-] [107009] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=107009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:02:22.876819 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-be774790-b086-478a-ac81-6c77c2b87105 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:22.899936 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-be774790-b086-478a-ac81-6c77c2b87105 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.565094 Aug 22 17:02:22.900733 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 18/37] 10.222.0.96 () {60 vars in 1292 bytes} [Mon Aug 22 17:02:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:02:24.048073 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-5e407463-bbec-4f86-a2cc-5d030880c141 admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:24.049073 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-5e407463-bbec-4f86-a2cc-5d030880c141 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 22 17:02:24.049506 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 20/38] 10.222.0.96 () {56 vars in 1074 bytes} [Mon Aug 22 17:02:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:02:24.689920 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-4de1049b-36a5-4722-92c9-7480c4f89564 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:24.696169 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.wsgi [None req-4de1049b-36a5-4722-92c9-7480c4f89564 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-4de1049b-36a5-4722-92c9-7480c4f89564 admin admin] Request method failure captured: Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: Accept: application/json Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: Accept-Encoding: gzip, deflate Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: Connection: keep-alive Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: Content-Length: 0 Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: Host: 10.222.0.96 Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: Openstack-Api-Version: compute 2.90 Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: Openstack-System-Scope: None Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: User-Agent: python-novaclient Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: X-Auth-Token: gAAAAABjA7af1QfZK6rtj8ERupqxMEIuMqrH2S9aY_3EiDAKWHFxuJ8L2l9gIC9L2XDdSalysWmpL2tddUTCuTT2fzz8z-AmRnDkf1_AKRix9iVE5IeDkifM7e_tP9LSSWdyugmMexlCp8K1kDbG4AyO5tybZBkHwpPKcV4rUsyDSVxIYCJ-oPQ Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: X-Domain-Id: None Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: X-Domain-Name: None Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: X-Identity-Status: Confirmed Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: X-Is-Admin-Project: True Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: X-Project-Domain-Id: default Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: X-Project-Domain-Name: Default Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: X-Project-Id: 12889750ad6d43d3b1912a6efdac9935 Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: X-Project-Name: admin Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: X-Role: member,reader,admin Aug 22 17:02:24.699520 n-d-854030-1 devstack@n-api.service[107009]: X-Roles: member,reader,admin Aug 22 17:02:24.700985 n-d-854030-1 devstack@n-api.service[107009]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/12889750ad6d43d3b1912a6efdac9935"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_12889750ad6d43d3b1912a6efdac9935", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/12889750ad6d43d3b1912a6efdac9935"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/12889750ad6d43d3b1912a6efdac9935"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:02:24.700985 n-d-854030-1 devstack@n-api.service[107009]: X-Tenant: admin Aug 22 17:02:24.700985 n-d-854030-1 devstack@n-api.service[107009]: X-Tenant-Id: 12889750ad6d43d3b1912a6efdac9935 Aug 22 17:02:24.700985 n-d-854030-1 devstack@n-api.service[107009]: X-Tenant-Name: admin Aug 22 17:02:24.700985 n-d-854030-1 devstack@n-api.service[107009]: X-User: admin Aug 22 17:02:24.700985 n-d-854030-1 devstack@n-api.service[107009]: X-User-Domain-Id: default Aug 22 17:02:24.700985 n-d-854030-1 devstack@n-api.service[107009]: X-User-Domain-Name: Default Aug 22 17:02:24.700985 n-d-854030-1 devstack@n-api.service[107009]: X-User-Id: 819926b2e1d2421f9bae4a4f280a73db Aug 22 17:02:24.700985 n-d-854030-1 devstack@n-api.service[107009]: X-User-Name: admin Aug 22 17:02:24.700985 n-d-854030-1 devstack@n-api.service[107009]: method: > Aug 22 17:02:24.700985 n-d-854030-1 devstack@n-api.service[107009]: exception: Flavor 42 could not be found. Aug 22 17:02:24.700985 n-d-854030-1 devstack@n-api.service[107009]: action_args: {'id': '42'} Aug 22 17:02:24.700985 n-d-854030-1 devstack@n-api.service[107009]: {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:02:24.700985 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:02:24.702018 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 17:02:24.702018 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 17:02:24.702018 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 17:02:24.702018 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 17:02:24.702018 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:02:24.702018 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:02:24.702018 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 17:02:24.702018 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 17:02:24.702018 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 17:02:24.702018 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:02:24.702018 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 17:02:24.702018 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 17:02:24.702018 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 22 17:02:24.702018 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Aug 22 17:02:24.702018 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:02:24.702018 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Aug 22 17:02:24.702018 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:02:24.702018 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:02:24.702018 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:02:24.703888 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:02:24.703888 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:02:24.703888 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:02:24.703888 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:02:24.703888 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 17:02:24.703888 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:02:24.703888 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 22 17:02:24.703888 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Aug 22 17:02:24.703888 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:02:24.703888 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Aug 22 17:02:24.703888 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:02:24.703888 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:02:24.703888 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:02:24.703888 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:02:24.703888 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:02:24.703888 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 22 17:02:24.703888 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Aug 22 17:02:24.703888 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-4de1049b-36a5-4722-92c9-7480c4f89564 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:02:24.705334 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-4de1049b-36a5-4722-92c9-7480c4f89564 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.453024 Aug 22 17:02:24.705334 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 19/39] 10.222.0.96 () {60 vars in 1190 bytes} [Mon Aug 22 17:02:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 454 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 17:02:24.712305 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-367eca88-0cd5-4d3f-9567-3236a0220f6a admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:24.736692 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-367eca88-0cd5-4d3f-9567-3236a0220f6a admin admin] 10.222.0.96 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027855 Aug 22 17:02:24.737368 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 21/40] 10.222.0.96 () {60 vars in 1210 bytes} [Mon Aug 22 17:02:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:02:24.754338 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-ff5000c3-8312-47fa-89d1-df59c38809c3 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:24.785389 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-ff5000c3-8312-47fa-89d1-df59c38809c3 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034676 Aug 22 17:02:24.786069 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 20/41] 10.222.0.96 () {60 vars in 1210 bytes} [Mon Aug 22 17:02:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:02:24.796306 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-025d5806-5fd6-4a24-88b8-68f3b1b1e73f admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:24.802869 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.wsgi [None req-025d5806-5fd6-4a24-88b8-68f3b1b1e73f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-025d5806-5fd6-4a24-88b8-68f3b1b1e73f admin admin] Request method failure captured: Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: Accept: application/json Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: Accept-Encoding: gzip, deflate Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: Connection: keep-alive Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: Content-Length: 0 Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: Host: 10.222.0.96 Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: Openstack-Api-Version: compute 2.90 Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: Openstack-System-Scope: None Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: User-Agent: python-novaclient Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: X-Auth-Token: gAAAAABjA7af1QfZK6rtj8ERupqxMEIuMqrH2S9aY_3EiDAKWHFxuJ8L2l9gIC9L2XDdSalysWmpL2tddUTCuTT2fzz8z-AmRnDkf1_AKRix9iVE5IeDkifM7e_tP9LSSWdyugmMexlCp8K1kDbG4AyO5tybZBkHwpPKcV4rUsyDSVxIYCJ-oPQ Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: X-Domain-Id: None Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: X-Domain-Name: None Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: X-Identity-Status: Confirmed Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: X-Is-Admin-Project: True Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: X-Project-Domain-Id: default Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: X-Project-Domain-Name: Default Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: X-Project-Id: 12889750ad6d43d3b1912a6efdac9935 Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: X-Project-Name: admin Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: X-Role: member,reader,admin Aug 22 17:02:24.806388 n-d-854030-1 devstack@n-api.service[107010]: X-Roles: member,reader,admin Aug 22 17:02:24.807969 n-d-854030-1 devstack@n-api.service[107010]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/12889750ad6d43d3b1912a6efdac9935"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_12889750ad6d43d3b1912a6efdac9935", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/12889750ad6d43d3b1912a6efdac9935"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/12889750ad6d43d3b1912a6efdac9935"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:02:24.807969 n-d-854030-1 devstack@n-api.service[107010]: X-Tenant: admin Aug 22 17:02:24.807969 n-d-854030-1 devstack@n-api.service[107010]: X-Tenant-Id: 12889750ad6d43d3b1912a6efdac9935 Aug 22 17:02:24.807969 n-d-854030-1 devstack@n-api.service[107010]: X-Tenant-Name: admin Aug 22 17:02:24.807969 n-d-854030-1 devstack@n-api.service[107010]: X-User: admin Aug 22 17:02:24.807969 n-d-854030-1 devstack@n-api.service[107010]: X-User-Domain-Id: default Aug 22 17:02:24.807969 n-d-854030-1 devstack@n-api.service[107010]: X-User-Domain-Name: Default Aug 22 17:02:24.807969 n-d-854030-1 devstack@n-api.service[107010]: X-User-Id: 819926b2e1d2421f9bae4a4f280a73db Aug 22 17:02:24.807969 n-d-854030-1 devstack@n-api.service[107010]: X-User-Name: admin Aug 22 17:02:24.807969 n-d-854030-1 devstack@n-api.service[107010]: method: > Aug 22 17:02:24.807969 n-d-854030-1 devstack@n-api.service[107010]: exception: Flavor 42 could not be found. Aug 22 17:02:24.807969 n-d-854030-1 devstack@n-api.service[107010]: action_args: {'id': '42'} Aug 22 17:02:24.807969 n-d-854030-1 devstack@n-api.service[107010]: {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:02:24.807969 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:02:24.809008 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 17:02:24.809008 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 17:02:24.809008 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 17:02:24.809008 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 17:02:24.809008 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:02:24.809008 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:02:24.809008 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 17:02:24.809008 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 17:02:24.809008 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 17:02:24.809008 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:02:24.809008 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 17:02:24.809008 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 17:02:24.809008 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 22 17:02:24.809008 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Aug 22 17:02:24.809008 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:02:24.809008 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Aug 22 17:02:24.809008 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:02:24.809008 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:02:24.809008 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:02:24.810489 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:02:24.810489 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:02:24.810489 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:02:24.810489 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:02:24.810489 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 17:02:24.810489 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:02:24.810489 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 22 17:02:24.810489 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Aug 22 17:02:24.810489 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:02:24.810489 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Aug 22 17:02:24.810489 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:02:24.810489 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:02:24.810489 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:02:24.810489 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:02:24.810489 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:02:24.810489 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 22 17:02:24.810489 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Aug 22 17:02:24.810489 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-025d5806-5fd6-4a24-88b8-68f3b1b1e73f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:02:24.811685 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-025d5806-5fd6-4a24-88b8-68f3b1b1e73f admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015497 Aug 22 17:02:24.811685 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 22/42] 10.222.0.96 () {60 vars in 1190 bytes} [Mon Aug 22 17:02:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 22 17:02:25.839868 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-ff5000c3-8312-47fa-89d1-df59c38809c3 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:25.840970 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-ff5000c3-8312-47fa-89d1-df59c38809c3 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001712 Aug 22 17:02:25.841431 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 21/43] 10.222.0.96 () {56 vars in 1074 bytes} [Mon Aug 22 17:02:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:02:26.517527 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-51340747-f1e0-4e58-b118-bd587c3d0d94 admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:26.526385 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.wsgi [None req-51340747-f1e0-4e58-b118-bd587c3d0d94 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-51340747-f1e0-4e58-b118-bd587c3d0d94 admin admin] Request method failure captured: Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: Accept: application/json Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: Accept-Encoding: gzip, deflate Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: Connection: keep-alive Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: Content-Length: 0 Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: Host: 10.222.0.96 Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: Openstack-Api-Version: compute 2.90 Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: Openstack-System-Scope: None Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: User-Agent: python-novaclient Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: X-Auth-Token: gAAAAABjA7ahBgEl9knJeumsRtgmPgWLZtxnm7WkDLybTrZqqdqFGCeOyEakIj3ziryoNtv-0Dvl-SY3BXTjf-sSiO0Vx1w5T3dn5zLMrHHZYagFBvo0vCpPSa-Eda9DLs_A4i5EG-EwDQFBeWWnTBQA3rZl11QY6qth9RSFLSBpxHfpZMKFOx0 Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: X-Domain-Id: None Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: X-Domain-Name: None Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: X-Identity-Status: Confirmed Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: X-Is-Admin-Project: True Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: X-Project-Domain-Id: default Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: X-Project-Domain-Name: Default Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: X-Project-Id: 12889750ad6d43d3b1912a6efdac9935 Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: X-Project-Name: admin Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: X-Role: member,reader,admin Aug 22 17:02:26.529248 n-d-854030-1 devstack@n-api.service[107010]: X-Roles: member,reader,admin Aug 22 17:02:26.531694 n-d-854030-1 devstack@n-api.service[107010]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/12889750ad6d43d3b1912a6efdac9935"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_12889750ad6d43d3b1912a6efdac9935", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/12889750ad6d43d3b1912a6efdac9935"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/12889750ad6d43d3b1912a6efdac9935"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:02:26.531694 n-d-854030-1 devstack@n-api.service[107010]: X-Tenant: admin Aug 22 17:02:26.531694 n-d-854030-1 devstack@n-api.service[107010]: X-Tenant-Id: 12889750ad6d43d3b1912a6efdac9935 Aug 22 17:02:26.531694 n-d-854030-1 devstack@n-api.service[107010]: X-Tenant-Name: admin Aug 22 17:02:26.531694 n-d-854030-1 devstack@n-api.service[107010]: X-User: admin Aug 22 17:02:26.531694 n-d-854030-1 devstack@n-api.service[107010]: X-User-Domain-Id: default Aug 22 17:02:26.531694 n-d-854030-1 devstack@n-api.service[107010]: X-User-Domain-Name: Default Aug 22 17:02:26.531694 n-d-854030-1 devstack@n-api.service[107010]: X-User-Id: 819926b2e1d2421f9bae4a4f280a73db Aug 22 17:02:26.531694 n-d-854030-1 devstack@n-api.service[107010]: X-User-Name: admin Aug 22 17:02:26.531694 n-d-854030-1 devstack@n-api.service[107010]: method: > Aug 22 17:02:26.531694 n-d-854030-1 devstack@n-api.service[107010]: exception: Flavor 84 could not be found. Aug 22 17:02:26.531694 n-d-854030-1 devstack@n-api.service[107010]: action_args: {'id': '84'} Aug 22 17:02:26.531694 n-d-854030-1 devstack@n-api.service[107010]: {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:02:26.531694 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:02:26.533196 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 17:02:26.533196 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 17:02:26.533196 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 17:02:26.533196 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 17:02:26.533196 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:02:26.533196 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:02:26.533196 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 17:02:26.533196 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 17:02:26.533196 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 17:02:26.533196 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:02:26.533196 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 17:02:26.533196 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 17:02:26.533196 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 22 17:02:26.533196 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Aug 22 17:02:26.533196 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:02:26.533196 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Aug 22 17:02:26.533196 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:02:26.533196 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:02:26.533196 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:02:26.535267 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:02:26.535267 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:02:26.535267 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:02:26.535267 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:02:26.535267 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 17:02:26.535267 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:02:26.535267 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 22 17:02:26.535267 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Aug 22 17:02:26.535267 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:02:26.535267 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Aug 22 17:02:26.535267 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:02:26.535267 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:02:26.535267 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:02:26.535267 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:02:26.535267 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:02:26.535267 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 22 17:02:26.535267 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Aug 22 17:02:26.535267 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-51340747-f1e0-4e58-b118-bd587c3d0d94 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:02:26.537991 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-51340747-f1e0-4e58-b118-bd587c3d0d94 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.547147 Aug 22 17:02:26.537991 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 23/44] 10.222.0.96 () {60 vars in 1190 bytes} [Mon Aug 22 17:02:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 549 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 22 17:02:26.544590 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-9479e26b-b706-418a-94b2-38edb72b382d admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:26.562617 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-9479e26b-b706-418a-94b2-38edb72b382d admin admin] 10.222.0.96 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021191 Aug 22 17:02:26.563346 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 22/45] 10.222.0.96 () {60 vars in 1210 bytes} [Mon Aug 22 17:02:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:02:26.577495 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-501962ca-97ce-48f1-9fc9-02c74568caf7 admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:26.607239 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-501962ca-97ce-48f1-9fc9-02c74568caf7 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.035903 Aug 22 17:02:26.608256 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 24/46] 10.222.0.96 () {60 vars in 1210 bytes} [Mon Aug 22 17:02:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:02:26.622939 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-32606b39-649a-4278-bb76-c746946f62c2 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:26.630972 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.wsgi [None req-32606b39-649a-4278-bb76-c746946f62c2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-32606b39-649a-4278-bb76-c746946f62c2 admin admin] Request method failure captured: Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: Accept: application/json Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: Accept-Encoding: gzip, deflate Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: Connection: keep-alive Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: Content-Length: 0 Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: Host: 10.222.0.96 Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: Openstack-Api-Version: compute 2.90 Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: Openstack-System-Scope: None Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: User-Agent: python-novaclient Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: X-Auth-Token: gAAAAABjA7ahBgEl9knJeumsRtgmPgWLZtxnm7WkDLybTrZqqdqFGCeOyEakIj3ziryoNtv-0Dvl-SY3BXTjf-sSiO0Vx1w5T3dn5zLMrHHZYagFBvo0vCpPSa-Eda9DLs_A4i5EG-EwDQFBeWWnTBQA3rZl11QY6qth9RSFLSBpxHfpZMKFOx0 Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: X-Domain-Id: None Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: X-Domain-Name: None Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: X-Identity-Status: Confirmed Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: X-Is-Admin-Project: True Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: X-Project-Domain-Id: default Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: X-Project-Domain-Name: Default Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: X-Project-Id: 12889750ad6d43d3b1912a6efdac9935 Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: X-Project-Name: admin Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: X-Role: member,reader,admin Aug 22 17:02:26.632686 n-d-854030-1 devstack@n-api.service[107009]: X-Roles: member,reader,admin Aug 22 17:02:26.634600 n-d-854030-1 devstack@n-api.service[107009]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/12889750ad6d43d3b1912a6efdac9935"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_12889750ad6d43d3b1912a6efdac9935", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/12889750ad6d43d3b1912a6efdac9935"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/12889750ad6d43d3b1912a6efdac9935"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:02:26.634600 n-d-854030-1 devstack@n-api.service[107009]: X-Tenant: admin Aug 22 17:02:26.634600 n-d-854030-1 devstack@n-api.service[107009]: X-Tenant-Id: 12889750ad6d43d3b1912a6efdac9935 Aug 22 17:02:26.634600 n-d-854030-1 devstack@n-api.service[107009]: X-Tenant-Name: admin Aug 22 17:02:26.634600 n-d-854030-1 devstack@n-api.service[107009]: X-User: admin Aug 22 17:02:26.634600 n-d-854030-1 devstack@n-api.service[107009]: X-User-Domain-Id: default Aug 22 17:02:26.634600 n-d-854030-1 devstack@n-api.service[107009]: X-User-Domain-Name: Default Aug 22 17:02:26.634600 n-d-854030-1 devstack@n-api.service[107009]: X-User-Id: 819926b2e1d2421f9bae4a4f280a73db Aug 22 17:02:26.634600 n-d-854030-1 devstack@n-api.service[107009]: X-User-Name: admin Aug 22 17:02:26.634600 n-d-854030-1 devstack@n-api.service[107009]: method: > Aug 22 17:02:26.634600 n-d-854030-1 devstack@n-api.service[107009]: exception: Flavor 84 could not be found. Aug 22 17:02:26.634600 n-d-854030-1 devstack@n-api.service[107009]: action_args: {'id': '84'} Aug 22 17:02:26.634600 n-d-854030-1 devstack@n-api.service[107009]: {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:02:26.634600 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:02:26.636187 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 17:02:26.636187 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 17:02:26.636187 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 17:02:26.636187 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 17:02:26.636187 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:02:26.636187 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:02:26.636187 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 17:02:26.636187 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 17:02:26.636187 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 17:02:26.636187 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:02:26.636187 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 17:02:26.636187 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 17:02:26.636187 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 22 17:02:26.636187 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Aug 22 17:02:26.636187 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:02:26.636187 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Aug 22 17:02:26.636187 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:02:26.636187 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:02:26.636187 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:02:26.638460 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:02:26.638460 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:02:26.638460 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:02:26.638460 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:02:26.638460 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 17:02:26.638460 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:02:26.638460 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 22 17:02:26.638460 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Aug 22 17:02:26.638460 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:02:26.638460 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Aug 22 17:02:26.638460 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:02:26.638460 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:02:26.638460 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:02:26.638460 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:02:26.638460 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:02:26.638460 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 22 17:02:26.638460 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Aug 22 17:02:26.638460 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-32606b39-649a-4278-bb76-c746946f62c2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:02:26.641404 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-32606b39-649a-4278-bb76-c746946f62c2 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.016572 Aug 22 17:02:26.641404 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 23/47] 10.222.0.96 () {60 vars in 1190 bytes} [Mon Aug 22 17:02:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 17:02:28.014623 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-501962ca-97ce-48f1-9fc9-02c74568caf7 admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:28.016847 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-501962ca-97ce-48f1-9fc9-02c74568caf7 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002526 Aug 22 17:02:28.017307 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 25/48] 10.222.0.96 () {56 vars in 1074 bytes} [Mon Aug 22 17:02:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:02:28.713374 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-f5ba77c0-5e5d-4964-a3b7-9df6a014bedd admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:28.720787 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.wsgi [None req-f5ba77c0-5e5d-4964-a3b7-9df6a014bedd admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-f5ba77c0-5e5d-4964-a3b7-9df6a014bedd admin admin] Request method failure captured: Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: Accept: application/json Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: Accept-Encoding: gzip, deflate Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: Connection: keep-alive Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: Content-Length: 0 Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: Host: 10.222.0.96 Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: Openstack-Api-Version: compute 2.90 Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: Openstack-System-Scope: None Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: User-Agent: python-novaclient Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: X-Auth-Token: gAAAAABjA7ajv4SvQefnT5avhAmpYHeJe30_N6gMEsF5RCVZkBP6imM7wvHJ-NLDPPAwMpliRfQqYi5c6eaDiSKA0mZh5ZqjEBMyUBWyVpCFvSV_6b280e5R6ies6tB56_PnYiOGJuyiKfJfagS5I59u7byfhqldxebX2EYd0xIZu6Jtd-OYKqs Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: X-Domain-Id: None Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: X-Domain-Name: None Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: X-Identity-Status: Confirmed Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: X-Is-Admin-Project: True Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: X-Project-Domain-Id: default Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: X-Project-Domain-Name: Default Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: X-Project-Id: 12889750ad6d43d3b1912a6efdac9935 Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: X-Project-Name: admin Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: X-Role: member,reader,admin Aug 22 17:02:28.722375 n-d-854030-1 devstack@n-api.service[107009]: X-Roles: member,reader,admin Aug 22 17:02:28.724770 n-d-854030-1 devstack@n-api.service[107009]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/12889750ad6d43d3b1912a6efdac9935"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_12889750ad6d43d3b1912a6efdac9935", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/12889750ad6d43d3b1912a6efdac9935"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/12889750ad6d43d3b1912a6efdac9935"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:02:28.724770 n-d-854030-1 devstack@n-api.service[107009]: X-Tenant: admin Aug 22 17:02:28.724770 n-d-854030-1 devstack@n-api.service[107009]: X-Tenant-Id: 12889750ad6d43d3b1912a6efdac9935 Aug 22 17:02:28.724770 n-d-854030-1 devstack@n-api.service[107009]: X-Tenant-Name: admin Aug 22 17:02:28.724770 n-d-854030-1 devstack@n-api.service[107009]: X-User: admin Aug 22 17:02:28.724770 n-d-854030-1 devstack@n-api.service[107009]: X-User-Domain-Id: default Aug 22 17:02:28.724770 n-d-854030-1 devstack@n-api.service[107009]: X-User-Domain-Name: Default Aug 22 17:02:28.724770 n-d-854030-1 devstack@n-api.service[107009]: X-User-Id: 819926b2e1d2421f9bae4a4f280a73db Aug 22 17:02:28.724770 n-d-854030-1 devstack@n-api.service[107009]: X-User-Name: admin Aug 22 17:02:28.724770 n-d-854030-1 devstack@n-api.service[107009]: method: > Aug 22 17:02:28.724770 n-d-854030-1 devstack@n-api.service[107009]: exception: Flavor 451 could not be found. Aug 22 17:02:28.724770 n-d-854030-1 devstack@n-api.service[107009]: action_args: {'id': '451'} Aug 22 17:02:28.724770 n-d-854030-1 devstack@n-api.service[107009]: {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:02:28.724770 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:02:28.726350 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 17:02:28.726350 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 17:02:28.726350 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 17:02:28.726350 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 17:02:28.726350 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:02:28.726350 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:02:28.726350 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 17:02:28.726350 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 17:02:28.726350 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 17:02:28.726350 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:02:28.726350 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 17:02:28.726350 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 17:02:28.726350 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 22 17:02:28.726350 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Aug 22 17:02:28.726350 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:02:28.726350 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Aug 22 17:02:28.726350 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:02:28.726350 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:02:28.726350 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:02:28.728470 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:02:28.728470 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:02:28.728470 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:02:28.728470 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:02:28.728470 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 17:02:28.728470 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:02:28.728470 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 22 17:02:28.728470 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Aug 22 17:02:28.728470 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:02:28.728470 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Aug 22 17:02:28.728470 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:02:28.728470 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:02:28.728470 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:02:28.728470 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:02:28.728470 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:02:28.728470 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 22 17:02:28.728470 n-d-854030-1 devstack@n-api.service[107009]: ERROR nova.api.openstack.wsgi Aug 22 17:02:28.728470 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-f5ba77c0-5e5d-4964-a3b7-9df6a014bedd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107009) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:02:28.730740 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-f5ba77c0-5e5d-4964-a3b7-9df6a014bedd admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.563487 Aug 22 17:02:28.730740 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 24/49] 10.222.0.96 () {60 vars in 1193 bytes} [Mon Aug 22 17:02:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 565 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 22 17:02:28.737788 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-bcc8f430-270f-4976-bd54-7d527c6d4799 admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:28.756030 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-bcc8f430-270f-4976-bd54-7d527c6d4799 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020942 Aug 22 17:02:28.756030 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 26/50] 10.222.0.96 () {60 vars in 1210 bytes} [Mon Aug 22 17:02:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:02:28.768906 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-24fb03a5-0da6-4122-bea8-c90972cec1f9 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:28.786042 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-24fb03a5-0da6-4122-bea8-c90972cec1f9 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021471 Aug 22 17:02:28.786721 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 25/51] 10.222.0.96 () {60 vars in 1210 bytes} [Mon Aug 22 17:02:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:02:28.797791 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-fab0a87b-0077-4665-8aec-528967191af2 admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:28.804423 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.wsgi [None req-fab0a87b-0077-4665-8aec-528967191af2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-fab0a87b-0077-4665-8aec-528967191af2 admin admin] Request method failure captured: Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: Accept: application/json Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: Accept-Encoding: gzip, deflate Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: Connection: keep-alive Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: Content-Length: 0 Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: Host: 10.222.0.96 Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: Openstack-Api-Version: compute 2.90 Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: Openstack-System-Scope: None Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: User-Agent: python-novaclient Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: X-Auth-Token: gAAAAABjA7ajv4SvQefnT5avhAmpYHeJe30_N6gMEsF5RCVZkBP6imM7wvHJ-NLDPPAwMpliRfQqYi5c6eaDiSKA0mZh5ZqjEBMyUBWyVpCFvSV_6b280e5R6ies6tB56_PnYiOGJuyiKfJfagS5I59u7byfhqldxebX2EYd0xIZu6Jtd-OYKqs Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: X-Domain-Id: None Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: X-Domain-Name: None Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: X-Identity-Status: Confirmed Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: X-Is-Admin-Project: True Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: X-Project-Domain-Id: default Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: X-Project-Domain-Name: Default Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: X-Project-Id: 12889750ad6d43d3b1912a6efdac9935 Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: X-Project-Name: admin Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: X-Role: member,reader,admin Aug 22 17:02:28.806051 n-d-854030-1 devstack@n-api.service[107010]: X-Roles: member,reader,admin Aug 22 17:02:28.808500 n-d-854030-1 devstack@n-api.service[107010]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/12889750ad6d43d3b1912a6efdac9935"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_12889750ad6d43d3b1912a6efdac9935", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/12889750ad6d43d3b1912a6efdac9935"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/12889750ad6d43d3b1912a6efdac9935"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:02:28.808500 n-d-854030-1 devstack@n-api.service[107010]: X-Tenant: admin Aug 22 17:02:28.808500 n-d-854030-1 devstack@n-api.service[107010]: X-Tenant-Id: 12889750ad6d43d3b1912a6efdac9935 Aug 22 17:02:28.808500 n-d-854030-1 devstack@n-api.service[107010]: X-Tenant-Name: admin Aug 22 17:02:28.808500 n-d-854030-1 devstack@n-api.service[107010]: X-User: admin Aug 22 17:02:28.808500 n-d-854030-1 devstack@n-api.service[107010]: X-User-Domain-Id: default Aug 22 17:02:28.808500 n-d-854030-1 devstack@n-api.service[107010]: X-User-Domain-Name: Default Aug 22 17:02:28.808500 n-d-854030-1 devstack@n-api.service[107010]: X-User-Id: 819926b2e1d2421f9bae4a4f280a73db Aug 22 17:02:28.808500 n-d-854030-1 devstack@n-api.service[107010]: X-User-Name: admin Aug 22 17:02:28.808500 n-d-854030-1 devstack@n-api.service[107010]: method: > Aug 22 17:02:28.808500 n-d-854030-1 devstack@n-api.service[107010]: exception: Flavor 451 could not be found. Aug 22 17:02:28.808500 n-d-854030-1 devstack@n-api.service[107010]: action_args: {'id': '451'} Aug 22 17:02:28.808500 n-d-854030-1 devstack@n-api.service[107010]: {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:02:28.808500 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:02:28.810243 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 17:02:28.810243 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 17:02:28.810243 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 17:02:28.810243 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 17:02:28.810243 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:02:28.810243 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:02:28.810243 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 17:02:28.810243 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 17:02:28.810243 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 17:02:28.810243 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:02:28.810243 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 17:02:28.810243 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 17:02:28.810243 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 22 17:02:28.810243 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Aug 22 17:02:28.810243 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:02:28.810243 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Aug 22 17:02:28.810243 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:02:28.810243 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:02:28.810243 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:02:28.812739 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:02:28.812739 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:02:28.812739 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:02:28.812739 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:02:28.812739 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 17:02:28.812739 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:02:28.812739 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 22 17:02:28.812739 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Aug 22 17:02:28.812739 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:02:28.812739 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Aug 22 17:02:28.812739 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:02:28.812739 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:02:28.812739 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:02:28.812739 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:02:28.812739 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:02:28.812739 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 22 17:02:28.812739 n-d-854030-1 devstack@n-api.service[107010]: ERROR nova.api.openstack.wsgi Aug 22 17:02:28.812739 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-fab0a87b-0077-4665-8aec-528967191af2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:02:28.815070 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-fab0a87b-0077-4665-8aec-528967191af2 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014152 Aug 22 17:02:28.815070 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 27/52] 10.222.0.96 () {60 vars in 1193 bytes} [Mon Aug 22 17:02:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 17:02:29.920682 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-24fb03a5-0da6-4122-bea8-c90972cec1f9 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:29.921307 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-24fb03a5-0da6-4122-bea8-c90972cec1f9 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002553 Aug 22 17:02:29.921966 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 26/53] 10.222.0.96 () {56 vars in 1074 bytes} [Mon Aug 22 17:02:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:02:30.572843 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-78cb692d-2eba-43ea-8d29-be298f3c1565 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:02:30.657360 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-78cb692d-2eba-43ea-8d29-be298f3c1565 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.582032 Aug 22 17:02:30.657829 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 28/54] 10.222.0.96 () {64 vars in 1235 bytes} [Mon Aug 22 17:02:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:02:31.746744 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-24fb03a5-0da6-4122-bea8-c90972cec1f9 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:31.747749 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-24fb03a5-0da6-4122-bea8-c90972cec1f9 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 22 17:02:31.748192 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 27/55] 10.222.0.96 () {56 vars in 1074 bytes} [Mon Aug 22 17:02:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:02:32.383711 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-ea205a91-1bc9-40d5-bd54-cf0a53e03297 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:02:32.581408 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-ea205a91-1bc9-40d5-bd54-cf0a53e03297 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.691529 Aug 22 17:02:32.582442 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 29/56] 10.222.0.96 () {64 vars in 1235 bytes} [Mon Aug 22 17:02:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:02:33.894860 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-24fb03a5-0da6-4122-bea8-c90972cec1f9 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:33.896005 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-24fb03a5-0da6-4122-bea8-c90972cec1f9 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Aug 22 17:02:33.896562 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 28/57] 10.222.0.96 () {56 vars in 1074 bytes} [Mon Aug 22 17:02:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:02:34.517252 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-e6d9629b-bdb0-401f-bbfc-85774a9db5c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:02:34.643374 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-e6d9629b-bdb0-401f-bbfc-85774a9db5c7 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.607500 Aug 22 17:02:34.644041 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 30/58] 10.222.0.96 () {64 vars in 1235 bytes} [Mon Aug 22 17:02:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:02:35.766727 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-24fb03a5-0da6-4122-bea8-c90972cec1f9 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:35.767586 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-24fb03a5-0da6-4122-bea8-c90972cec1f9 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002284 Aug 22 17:02:35.768393 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 29/59] 10.222.0.96 () {56 vars in 1074 bytes} [Mon Aug 22 17:02:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:02:36.382927 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-2629911b-8854-4b62-b42c-233d12553d02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:02:36.486089 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-2629911b-8854-4b62-b42c-233d12553d02 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.573704 Aug 22 17:02:36.489295 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 31/60] 10.222.0.96 () {64 vars in 1235 bytes} [Mon Aug 22 17:02:35 2022] POST /compute/v2.1/flavors => generated 409 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:02:37.536032 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-24fb03a5-0da6-4122-bea8-c90972cec1f9 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:37.537438 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-24fb03a5-0da6-4122-bea8-c90972cec1f9 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001790 Aug 22 17:02:37.538010 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 30/61] 10.222.0.96 () {56 vars in 1074 bytes} [Mon Aug 22 17:02:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:02:38.137435 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-10b536b7-8faa-45d9-beec-c04647e750ad admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:02:38.159532 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-10b536b7-8faa-45d9-beec-c04647e750ad admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.480323 Aug 22 17:02:38.160076 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 32/62] 10.222.0.96 () {60 vars in 1202 bytes} [Mon Aug 22 17:02:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:03:35.127316 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-24fb03a5-0da6-4122-bea8-c90972cec1f9 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:03:35.128351 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-24fb03a5-0da6-4122-bea8-c90972cec1f9 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002095 Aug 22 17:03:35.128754 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 31/63] 10.222.0.96 () {54 vars in 931 bytes} [Mon Aug 22 17:03:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:03:35.139408 n-d-854030-1 devstack@n-api.service[107010]: DEBUG dbcounter [-] [107010] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=107010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:03:35.542577 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-f2d79ae1-d254-4ac5-bb31-be9691ffba62 admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:03:35.566129 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-f2d79ae1-d254-4ac5-bb31-be9691ffba62 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.431154 Aug 22 17:03:35.566673 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 33/64] 10.222.0.96 () {60 vars in 1292 bytes} [Mon Aug 22 17:03:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:03:35.587320 n-d-854030-1 devstack@n-api.service[107009]: DEBUG dbcounter [-] [107009] Writing DB stats nova_api:SELECT=14 {{(pid=107009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:03:35.591088 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-35458b65-2175-46b6-805b-2eba9418b84c admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:03:35.599675 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-35458b65-2175-46b6-805b-2eba9418b84c admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013709 Aug 22 17:03:35.603713 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 32/65] 10.222.0.96 () {60 vars in 1283 bytes} [Mon Aug 22 17:03:35 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:03:35.612629 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-75e2437a-b0cb-4f12-9cd7-a4d949f98fac admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:03:35.621520 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-75e2437a-b0cb-4f12-9cd7-a4d949f98fac admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012570 Aug 22 17:03:35.622090 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 34/66] 10.222.0.96 () {60 vars in 1286 bytes} [Mon Aug 22 17:03:35 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:03:35.634299 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-22a9de81-05d8-4c84-b146-ce84adcf6a16 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:03:35.642833 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-22a9de81-05d8-4c84-b146-ce84adcf6a16 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011946 Aug 22 17:03:35.643379 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 33/67] 10.222.0.96 () {60 vars in 1286 bytes} [Mon Aug 22 17:03:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:03:35.657536 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-c4dd7b6a-6e30-4b8f-9264-e11af5f1fffc admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:03:35.667158 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-c4dd7b6a-6e30-4b8f-9264-e11af5f1fffc admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013878 Aug 22 17:03:35.667628 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 35/68] 10.222.0.96 () {60 vars in 1283 bytes} [Mon Aug 22 17:03:35 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:09:31.941750 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-22a9de81-05d8-4c84-b146-ce84adcf6a16 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:09:31.942788 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-22a9de81-05d8-4c84-b146-ce84adcf6a16 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Aug 22 17:09:31.943215 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 34/69] 10.222.0.96 () {56 vars in 1074 bytes} [Mon Aug 22 17:09:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:09:32.085005 n-d-854030-1 devstack@n-api.service[107010]: DEBUG dbcounter [-] [107010] Writing DB stats nova_api:SELECT=6 {{(pid=107010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:09:32.240318 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-044b1daf-d9f2-4029-b459-745292ba2a7f admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:09:32.243355 n-d-854030-1 devstack@n-api.service[107010]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:09:32.243355 n-d-854030-1 devstack@n-api.service[107010]: warnings.warn(msg) Aug 22 17:09:32.244660 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_concurrency.lockutils [None req-044b1daf-d9f2-4029-b459-745292ba2a7f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:09:32.245186 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_concurrency.lockutils [None req-044b1daf-d9f2-4029-b459-745292ba2a7f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:09:32.245625 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_concurrency.lockutils [None req-044b1daf-d9f2-4029-b459-745292ba2a7f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:09:32.246351 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_concurrency.lockutils [None req-044b1daf-d9f2-4029-b459-745292ba2a7f admin admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:09:32.246799 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_concurrency.lockutils [None req-044b1daf-d9f2-4029-b459-745292ba2a7f admin admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:09:32.247215 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_concurrency.lockutils [None req-044b1daf-d9f2-4029-b459-745292ba2a7f admin admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:09:32.291085 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-044b1daf-d9f2-4029-b459-745292ba2a7f admin admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.207511 Aug 22 17:09:32.291655 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 36/70] 10.222.0.96 () {60 vars in 1193 bytes} [Mon Aug 22 17:09:32 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:09:33.134361 n-d-854030-1 devstack@n-api.service[107009]: DEBUG nova.api.openstack.wsgi [None req-22a9de81-05d8-4c84-b146-ce84adcf6a16 admin admin] Calling method '>' {{(pid=107009) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:09:33.135370 n-d-854030-1 devstack@n-api.service[107009]: INFO nova.api.openstack.requestlog [None req-22a9de81-05d8-4c84-b146-ce84adcf6a16 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 22 17:09:33.135773 n-d-854030-1 devstack@n-api.service[107009]: [pid: 107009|app: 0|req: 35/71] 10.222.0.96 () {56 vars in 1074 bytes} [Mon Aug 22 17:09:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:09:33.327855 n-d-854030-1 devstack@n-api.service[107010]: DEBUG nova.api.openstack.wsgi [None req-ddf39569-6d53-44c6-b44f-13f063383341 admin admin] Calling method '>' {{(pid=107010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:09:33.330926 n-d-854030-1 devstack@n-api.service[107010]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:09:33.330926 n-d-854030-1 devstack@n-api.service[107010]: warnings.warn(msg) Aug 22 17:09:33.332153 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_concurrency.lockutils [None req-ddf39569-6d53-44c6-b44f-13f063383341 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:09:33.332625 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_concurrency.lockutils [None req-ddf39569-6d53-44c6-b44f-13f063383341 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:09:33.333050 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_concurrency.lockutils [None req-ddf39569-6d53-44c6-b44f-13f063383341 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:09:33.333862 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_concurrency.lockutils [None req-ddf39569-6d53-44c6-b44f-13f063383341 admin admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:09:33.334303 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_concurrency.lockutils [None req-ddf39569-6d53-44c6-b44f-13f063383341 admin admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:09:33.334715 n-d-854030-1 devstack@n-api.service[107010]: DEBUG oslo_concurrency.lockutils [None req-ddf39569-6d53-44c6-b44f-13f063383341 admin admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:09:33.357918 n-d-854030-1 devstack@n-api.service[107010]: INFO nova.api.openstack.requestlog [None req-ddf39569-6d53-44c6-b44f-13f063383341 admin admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.082900 Aug 22 17:09:33.358404 n-d-854030-1 devstack@n-api.service[107010]: [pid: 107010|app: 0|req: 37/72] 10.222.0.96 () {60 vars in 1193 bytes} [Mon Aug 22 17:09:33 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:10:20.578610 n-d-854030-1 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 22 17:10:20.579200 n-d-854030-1 devstack@n-api.service[107008]: Mon Aug 22 17:10:20 2022 - graceful shutdown triggered... Aug 22 17:10:20.579668 n-d-854030-1 devstack@n-api.service[107010]: Gracefully killing worker 2 (pid: 107010)... Aug 22 17:10:20.583241 n-d-854030-1 devstack@n-api.service[107009]: Gracefully killing worker 1 (pid: 107009)... Aug 22 17:10:21.580261 n-d-854030-1 devstack@n-api.service[107008]: worker 1 buried after 1 seconds Aug 22 17:10:21.580261 n-d-854030-1 devstack@n-api.service[107008]: worker 2 buried after 1 seconds Aug 22 17:10:21.580261 n-d-854030-1 devstack@n-api.service[107008]: goodbye to uWSGI. Aug 22 17:10:21.581724 n-d-854030-1 systemd[1]: devstack@n-api.service: Succeeded. Aug 22 17:10:21.582278 n-d-854030-1 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 22 17:10:21.584979 n-d-854030-1 systemd[1]: Starting Devstack devstack@n-api.service... Aug 22 17:10:21.601546 n-d-854030-1 devstack@n-api.service[123003]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 22 17:10:21.616618 n-d-854030-1 devstack@n-api.service[123003]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 17:10:21 2022] *** Aug 22 17:10:21.616618 n-d-854030-1 devstack@n-api.service[123003]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 17:10:21.616618 n-d-854030-1 devstack@n-api.service[123003]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 17:10:21.616618 n-d-854030-1 devstack@n-api.service[123003]: nodename: n-d-854030-1 Aug 22 17:10:21.616618 n-d-854030-1 devstack@n-api.service[123003]: machine: x86_64 Aug 22 17:10:21.616618 n-d-854030-1 devstack@n-api.service[123003]: clock source: unix Aug 22 17:10:21.616618 n-d-854030-1 devstack@n-api.service[123003]: pcre jit disabled Aug 22 17:10:21.616618 n-d-854030-1 devstack@n-api.service[123003]: detected number of CPU cores: 4 Aug 22 17:10:21.616618 n-d-854030-1 devstack@n-api.service[123003]: current working directory: / Aug 22 17:10:21.616618 n-d-854030-1 devstack@n-api.service[123003]: detected binary path: /usr/bin/uwsgi-core Aug 22 17:10:21.616618 n-d-854030-1 devstack@n-api.service[123003]: your processes number limit is 47680 Aug 22 17:10:21.616618 n-d-854030-1 devstack@n-api.service[123003]: your memory page size is 4096 bytes Aug 22 17:10:21.616618 n-d-854030-1 devstack@n-api.service[123003]: detected max file descriptor number: 2048 Aug 22 17:10:21.616618 n-d-854030-1 devstack@n-api.service[123003]: lock engine: pthread robust mutexes Aug 22 17:10:21.617803 n-d-854030-1 devstack@n-api.service[123003]: thunder lock: enabled Aug 22 17:10:21.617803 n-d-854030-1 devstack@n-api.service[123003]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 22 17:10:21.617803 n-d-854030-1 devstack@n-api.service[123003]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 17:10:21.658625 n-d-854030-1 devstack@n-api.service[123003]: Python main interpreter initialized at 0x55fd808ad9c0 Aug 22 17:10:21.658625 n-d-854030-1 devstack@n-api.service[123003]: python threads support enabled Aug 22 17:10:21.658625 n-d-854030-1 devstack@n-api.service[123003]: your server socket listen backlog is limited to 100 connections Aug 22 17:10:21.658625 n-d-854030-1 devstack@n-api.service[123003]: your mercy for graceful operations on workers is 90 seconds Aug 22 17:10:21.659069 n-d-854030-1 devstack@n-api.service[123003]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 17:10:21.659069 n-d-854030-1 devstack@n-api.service[123003]: *** Operational MODE: preforking *** Aug 22 17:10:21.659336 n-d-854030-1 devstack@n-api.service[123003]: *** uWSGI is running in multiple interpreter mode *** Aug 22 17:10:21.659336 n-d-854030-1 devstack@n-api.service[123003]: spawned uWSGI master process (pid: 123003) Aug 22 17:10:21.659549 n-d-854030-1 systemd[1]: Started Devstack devstack@n-api.service. Aug 22 17:10:21.660192 n-d-854030-1 devstack@n-api.service[123003]: spawned uWSGI worker 1 (pid: 123015, cores: 1) Aug 22 17:10:21.660709 n-d-854030-1 devstack@n-api.service[123003]: spawned uWSGI worker 2 (pid: 123016, cores: 1) Aug 22 17:10:21.661023 n-d-854030-1 devstack@n-api.service[123003]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 17:10:22.334703 n-d-854030-1 devstack@n-api.service[123015]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 17:10:22.340867 n-d-854030-1 devstack@n-api.service[123016]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 17:10:23.544818 n-d-854030-1 devstack@n-api.service[123015]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 17:10:23.544818 n-d-854030-1 devstack@n-api.service[123015]: from cryptography.utils import int_from_bytes Aug 22 17:10:23.545478 n-d-854030-1 devstack@n-api.service[123016]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 17:10:23.545478 n-d-854030-1 devstack@n-api.service[123016]: from cryptography.utils import int_from_bytes Aug 22 17:10:23.545941 n-d-854030-1 devstack@n-api.service[123015]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 17:10:23.545941 n-d-854030-1 devstack@n-api.service[123015]: from cryptography.utils import int_from_bytes Aug 22 17:10:23.546098 n-d-854030-1 devstack@n-api.service[123016]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 17:10:23.546098 n-d-854030-1 devstack@n-api.service[123016]: from cryptography.utils import int_from_bytes Aug 22 17:10:26.082544 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 17:10:26.083228 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 17:10:26.083598 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 17:10:26.083700 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 17:10:26.083820 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 17:10:26.083922 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 17:10:26.084020 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 17:10:26.084117 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 17:10:26.084216 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 17:10:26.084308 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 17:10:26.084401 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.084494 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.084653 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.084822 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.085011 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.085762 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.085940 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.086094 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.086546 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.086662 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.086866 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.086977 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.087191 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.087293 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.087515 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.087628 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.087846 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.087948 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.088109 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.088218 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.088445 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.088544 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.088778 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854030-1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.088873 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854030-1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.089147 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.089303 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.089462 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.089600 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.089779 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.089916 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.090103 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.090265 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.090410 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.090557 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.090716 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.090854 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.091022 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.091187 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.091524 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.091649 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.092803 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.092972 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.093157 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.093297 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.093427 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.093566 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.093698 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.093845 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.093989 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.094128 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.094272 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.094403 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.094542 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.094701 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.094846 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.094997 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.095137 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.095276 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.095407 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.095622 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.095753 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854030-1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.095892 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854030-1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.096050 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.096180 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.096367 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.096509 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.096631 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.096777 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.096909 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.097055 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.097227 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.097367 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.097513 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.097651 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.097782 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.097929 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.098062 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.098205 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.098337 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.098468 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.098614 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.098747 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.098887 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.099028 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.099161 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.099301 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.099447 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.099868 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.100009 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.100153 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.100298 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.100298 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.100733 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.100913 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.101047 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.101219 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.101353 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.101353 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.101610 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.101740 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.101877 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.102015 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.102152 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.102296 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.102434 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.102565 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.102699 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.102840 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.102983 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.103126 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.103265 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.103399 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.103536 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.103675 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.103819 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.103962 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.104093 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.104223 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.104407 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.104560 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.104724 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.104870 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.105040 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.105212 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.105375 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.105520 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.105682 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.105829 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.105989 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.106133 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.106294 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.106488 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.106624 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.106753 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.106883 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.107024 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.107207 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.107357 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.107497 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.107634 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.107810 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.107947 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.108455 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.96 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.108606 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.108753 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.96 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.108874 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.109015 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.109286 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.96 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.109438 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.109579 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.96 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.109712 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.110041 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.110189 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.110321 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.110462 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.110681 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.110816 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.110955 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.111094 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.111234 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.111375 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.111516 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.111648 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.111788 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.111919 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.112057 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.112198 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.112339 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.112484 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.112624 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.112765 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.112912 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.113052 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.113267 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.113400 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.113540 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.113672 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.113812 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.113944 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.114083 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.114232 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.114373 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.114512 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.114655 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.114786 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.114950 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.115176 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.115322 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.115454 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.115598 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.115730 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.115869 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.116009 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.116165 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.116357 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.116584 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.116773 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.117026 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.117197 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.117375 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.117522 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.117685 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.117828 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.118005 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.118631 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.118771 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.118918 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.119061 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.119203 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.119336 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.119466 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.119605 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.119747 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.119880 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.120034 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.120354 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.120491 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.120629 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.120853 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.120997 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.121183 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.121327 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.121459 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.121679 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.121826 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.121965 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.122097 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.122230 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.122369 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.122507 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.122717 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.122860 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.122992 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.123122 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.123262 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.123403 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.123536 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.123667 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.123804 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.123943 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.124122 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.124271 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.124405 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.124543 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.124712 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.124876 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.125010 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.125183 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.125325 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.125458 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.125596 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.125736 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.125868 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.126013 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.126146 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.126277 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.126409 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.126594 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.126746 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.126886 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.127017 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.127148 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.127285 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.127417 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.127563 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.127703 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.127842 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.127982 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.128122 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.128268 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.128431 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.128566 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.128696 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.128826 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.128956 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.129167 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.129322 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:10:26.129463 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.129604 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.129735 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.129735 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.130007 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.130163 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.130500 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.130647 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.130778 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.131012 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.131163 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.131297 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.131443 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.131576 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.131715 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.132392 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.132535 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.132676 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.132816 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.132816 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.133065 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.133228 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.133369 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.133507 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.133646 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.133780 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.133928 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.134070 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.134241 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.134387 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.134570 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.134711 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.134884 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.135028 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.135202 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.135347 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.135523 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.135657 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.135839 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.135974 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.136150 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.136300 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.136489 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.136689 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.136832 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.136967 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.137164 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.137300 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.137466 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.137611 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.137785 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.137935 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.138094 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.138240 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.138404 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.138548 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.138710 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.138859 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.139032 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.139170 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.139360 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.139505 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.139667 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.139814 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.139981 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.140118 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.140290 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.140450 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.140769 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.140912 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.141171 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.141316 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.141458 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.141598 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.141739 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.141885 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.142025 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.142159 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.142291 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.142422 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.142563 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.142697 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.142836 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.142976 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.143109 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.143242 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.143382 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.143515 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.143654 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.143794 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.143927 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.144067 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.144214 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.144356 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.144502 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.144635 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.144767 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.144941 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.145129 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.145816 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.145971 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.146113 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.146235 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.146367 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.146538 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.146678 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.146846 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.146987 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.147128 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.147274 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.147460 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.147599 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.147731 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.147870 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.148026 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.148224 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.148363 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.148506 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.148645 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.149323 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.149461 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.149674 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.149817 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.149961 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.150151 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.150470 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.150645 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.150969 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.151141 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.151424 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.151570 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.151711 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.151859 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.152001 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.152133 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.152264 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.152409 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.152548 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.152692 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.152825 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.152964 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.153104 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.153237 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.153368 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.153518 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.153659 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.153792 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.153924 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.154055 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.154196 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.154339 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.154479 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.154612 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.154751 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.154892 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.155039 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.155173 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.155313 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.155446 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.155577 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.155723 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.155866 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.156007 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.156007 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.156270 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.156402 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.156544 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.156690 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.156862 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.156998 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.157172 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.157314 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.157461 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.157622 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.157763 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.157908 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.158041 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.158172 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.158313 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.158454 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.158595 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.158728 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.158860 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.158999 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.159146 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.159286 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.159428 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.159568 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.159700 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.159838 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.159981 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.160124 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.160265 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.160412 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.160544 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.160684 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.160833 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.161144 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.161294 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.161449 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.161657 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.161807 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.161941 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.162074 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.162213 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.162345 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.162476 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.162621 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.162761 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.162900 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.163090 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.163303 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.163491 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.163640 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.163773 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.163945 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.164124 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.164272 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.164453 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.164598 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.164779 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.164916 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.165184 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.165324 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.165506 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.165614 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.165815 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.165922 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.166132 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.166236 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.166439 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.166550 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.166757 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.166887 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.167065 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.167217 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.167363 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.167512 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.167694 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.167840 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.168022 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.168166 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.168335 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.168473 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.168642 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.168776 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.168950 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.169137 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.169303 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.169441 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.169612 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.169749 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.169919 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.170113 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.170294 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.170488 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.170657 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.170834 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.171003 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.171406 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.171587 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.171896 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.172082 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.172252 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.172421 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.172609 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.172789 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.172965 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.173239 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.173377 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.173525 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.173650 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.173805 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.173978 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.174157 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.174335 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.174515 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.174695 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.174864 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.175043 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.175245 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.175429 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.175615 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.175796 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.175973 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.176142 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.176318 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.176503 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.176697 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.176843 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.176983 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.177292 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.177475 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.177661 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.177834 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.177834 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.178179 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.178356 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.178545 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.178771 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.178951 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.179128 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.179295 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.179462 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.179626 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.179893 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.180093 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.180240 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.180373 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.180514 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.180643 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.180788 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.180928 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.180928 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.181223 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.181540 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.181681 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.181844 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.182057 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.182201 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.182341 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.182472 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.182618 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.182759 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.182898 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.183033 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.183172 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.183303 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.183440 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.183583 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.183722 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.183853 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.183985 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.183985 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.184243 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.184383 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.184515 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.184515 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.184769 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.184909 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.185054 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.185210 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.185342 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.185471 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.185609 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.185758 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.185898 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.186028 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.186157 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.186157 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.186410 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.186410 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.186671 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.186671 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.186914 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.187044 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.187288 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.187439 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.187571 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.187709 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.187849 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.187988 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.188128 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.188275 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.188407 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.188547 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.188679 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.188817 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.188958 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.189131 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.189266 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.189417 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.189551 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.189691 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.189821 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.189942 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.190072 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.190202 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.190333 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.190474 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.190616 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.190746 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.190877 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.190877 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.191132 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.191263 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.191407 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.191722 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.191868 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.192001 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.192214 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.192358 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.192493 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.192625 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.192755 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.192755 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.193019 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.193183 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.193317 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.193471 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.193620 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.193761 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.193882 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.194019 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.194159 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.194850 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.195048 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.195185 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.195326 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.195467 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.195602 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.195734 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.195878 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.196026 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.196176 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.196328 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.196476 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.196663 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.196808 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.196942 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.197102 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.197359 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.197506 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.197639 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.197781 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.197915 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.198047 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.198193 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.198334 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.198473 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.198614 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.198754 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.198894 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.199035 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.199168 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.199300 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.199432 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.199627 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.199769 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.199906 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.200035 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.200175 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.200314 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.200447 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.200626 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.200761 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.200884 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.201015 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.201235 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.201370 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.201517 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.201517 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.201951 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.202103 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.202251 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.202459 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.202606 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.202606 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.202874 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.202874 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.203114 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.203114 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.203385 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.203518 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.203650 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.203769 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.203908 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.204051 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.204197 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.204330 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.204469 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.204602 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.204733 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.204873 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.205007 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.205171 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.205317 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.205458 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.205598 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.205743 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.205884 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.206025 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.206166 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.206299 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.206440 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.206573 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.206739 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.206877 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.207077 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.207222 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.207567 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.207712 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.207845 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.207986 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.208127 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.208268 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.208416 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.208549 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.208688 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.208827 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.208960 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.209115 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.209265 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.209398 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.209530 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.209667 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.209800 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.209993 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.210640 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.210778 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.210988 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.211216 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.211384 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.211539 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.211761 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.211909 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.212218 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.212362 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.212587 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.212734 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.212869 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.213008 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.213167 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.213304 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.213458 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.213608 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.213749 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.213879 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.214012 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.214153 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.214296 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.214438 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.214580 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.214719 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.214866 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.214999 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.215197 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.215331 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.215485 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.216281 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.216423 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.216565 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.216715 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.216851 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.216984 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.217167 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.217302 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.217496 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.217717 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.217863 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.217996 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.218136 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.218269 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.436858 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.436858 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.438473 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.438568 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.438668 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.438759 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.438839 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.439922 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.440045 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.440131 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.440220 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.440301 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.440378 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.440455 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.440523 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.440588 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.440654 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.440718 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.440783 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.440855 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.440923 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.440987 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.441051 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.441135 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.441202 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.441349 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.441421 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.441488 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.441553 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.441626 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.441694 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.441759 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.441827 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.441949 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.442019 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.442093 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.442162 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.442269 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.442361 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.442441 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.442510 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.442585 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.442657 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.442726 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.442793 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.442863 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.442990 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.443071 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.443071 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.443193 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.443260 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.443326 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.443400 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.443470 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.443536 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.443601 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.443601 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.443719 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.443855 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.443926 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.443993 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.444059 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.444125 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.444311 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.444943 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.445044 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.445150 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.445222 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.445279 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.445358 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.445358 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.445482 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.445551 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.445607 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.445673 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.445747 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.445816 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.445883 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.445949 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.446023 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.446093 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.446159 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.446226 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.446300 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.446368 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.446434 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.446500 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.446566 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.446631 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.446745 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.446871 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.446941 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.447009 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.447075 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.447141 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.447215 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.447288 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.447356 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.447423 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.447490 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.447563 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.447633 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.447699 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.447765 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.447832 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.447898 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.447971 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.448040 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.448107 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.448173 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.448285 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.448362 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.448483 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.448556 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.448623 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.448822 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.448955 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.449049 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.449138 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.449229 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.449301 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.449370 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.449483 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.449567 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.449647 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.449718 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.449787 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.449856 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.449975 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.450087 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.450171 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.450243 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.450320 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.450390 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.450466 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.450550 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.450626 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.450626 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.450753 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.450821 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.450888 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.450956 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.451031 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.451101 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.451168 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.451236 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.451303 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.451379 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.451449 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.451517 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.451585 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.451585 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.451706 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.451801 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.451801 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.451933 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.452002 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.452060 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.452117 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.452181 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.452251 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.452318 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.452318 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.452439 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.452507 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.452582 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.452735 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.452809 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.452878 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.452945 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.453022 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.453022 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.453169 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.453169 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.453360 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.453420 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.453533 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.453642 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.453713 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.453713 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.453833 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.453946 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.454086 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.454202 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.454273 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.454332 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.454437 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.455613 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.455785 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.455851 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.455980 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.456042 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.456112 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.456202 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.456281 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.456351 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.456448 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.456568 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.456648 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.456727 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.456810 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.456888 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.456947 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.457066 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.457151 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.457223 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.457297 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.457366 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.457366 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.457488 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.457557 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.457694 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.457771 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.457841 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.457955 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.458029 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.458147 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.458225 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.458294 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.458424 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.458505 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.458574 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.458651 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.458722 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.458791 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.458858 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.458926 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.458994 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.459069 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.459140 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.459208 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.459284 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.459355 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.459423 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.459488 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.459547 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.459640 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.459716 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.459794 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.459967 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.460047 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.460108 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.460177 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.460246 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.460314 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.460382 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.460458 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.460529 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.460597 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.460664 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.460754 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.460830 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.460830 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.460967 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.461037 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.461135 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.461203 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.461275 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.461344 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.461421 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.461480 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.461538 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.461595 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.461661 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.461720 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.461824 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.461917 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.462065 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.462145 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.462215 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.462275 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.462333 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.462390 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.462447 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.462504 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.462568 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.462627 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.462685 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.462741 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.462799 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.462799 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.462910 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.462967 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.463024 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.463081 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.463138 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.463201 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.463260 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.463317 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.463374 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.463430 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.463487 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.463552 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.463612 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.463669 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.463725 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.463782 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.463839 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.463903 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.463962 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.464019 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.464127 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.464276 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.464407 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.464520 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.464586 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.464691 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.464856 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.464918 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.464984 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.465109 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.465219 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.465284 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.465391 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.465583 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.465666 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.465728 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.465790 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.465896 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.466003 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.466068 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.466138 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.466372 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.466496 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.466574 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.466691 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.466773 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.466845 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.466965 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.467080 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.467155 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.467224 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.467366 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.467366 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.467489 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.467489 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.467590 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.467659 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.467735 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.467861 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.467932 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.468001 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.468069 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.468137 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.468215 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.468376 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.468457 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.468532 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.468671 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.468762 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.468762 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.469026 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.469026 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.469026 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.469441 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.469529 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.469529 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.469529 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.469529 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.469529 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.469934 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.470051 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.470051 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.470183 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.470262 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.470343 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.470415 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.470488 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.470558 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.470675 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.470751 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.470831 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.470910 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.470983 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.471122 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.471369 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.471624 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.471765 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.472241 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.472380 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.472709 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.472993 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.473131 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.473541 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.473673 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.474004 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.474205 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.474384 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.474681 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.474909 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.475319 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.475516 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.476506 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.476881 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.477461 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.477550 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.477878 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.478000 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.478279 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.478431 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.478638 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.478749 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.478984 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.479164 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.479334 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.479790 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.480112 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.480323 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.480506 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.480660 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.481009 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.481113 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.481573 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.481653 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.481948 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.482079 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.482490 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.482939 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.483325 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.483545 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.483677 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.483994 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.484095 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.484645 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.484744 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.484838 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.484912 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.484983 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.485941 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.486043 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.486118 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.486283 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.486388 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.486472 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.486472 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.486783 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.486914 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.487164 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.487871 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.487871 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.488059 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.488338 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.488546 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.488635 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.488965 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.489130 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.489437 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.489523 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.489774 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.489998 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.490089 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.490333 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.490412 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.490658 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.490736 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.491008 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.491665 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.492032 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.492318 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.492584 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.492963 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.493136 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.493303 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.493431 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.493625 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.493750 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.494021 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.494135 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.494382 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.494474 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.494717 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.494870 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.495128 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.495239 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.495519 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.495648 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.495925 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.496025 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.496293 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.496388 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.496608 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.496959 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.497054 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.497319 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.497402 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.497722 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.497826 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.498101 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.498210 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.498508 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.498612 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.498910 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.499031 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.499221 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.499378 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.499529 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.499818 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.499947 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.500142 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.500267 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.500452 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.500616 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.500769 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.500941 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.501119 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.501327 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.501412 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.501638 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.501733 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.501948 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.502101 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.502356 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.502442 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.502675 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.502764 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.502986 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.503138 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.503320 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.503460 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.503630 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.503822 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.504022 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.504294 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.504423 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.504617 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.504708 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.504994 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.505259 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.505369 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.505605 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.505689 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.505933 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.506018 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.506277 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.506378 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.506705 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.507384 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.509114 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.509114 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.509300 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.509379 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.509454 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.509454 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.509646 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.509821 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.509979 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.510183 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.510323 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.510505 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.510657 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.510851 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.510987 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.511170 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.511307 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.511491 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.511626 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.511812 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.511947 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.512130 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.512267 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.512446 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.512583 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.512810 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.512946 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.513114 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.513265 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.513473 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.513610 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.513795 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.513932 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.514299 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.514456 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.514567 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.514645 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.515004 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.515114 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.515346 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.515509 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.515728 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.515813 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.516081 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.516331 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.516423 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.516497 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.516713 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.516793 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.517024 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.517136 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.517415 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.517498 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.517749 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.517909 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.518068 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.518208 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.518381 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.518691 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.519011 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.519212 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.519346 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.519498 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.519646 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.519831 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.520061 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.520320 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.520450 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.520647 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.520772 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.520971 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.521128 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.521311 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.521622 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.521747 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.521934 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.522150 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.522296 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.522662 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.522745 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.522977 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.523281 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.523368 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.523601 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.523681 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.523926 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.524007 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.524245 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.524452 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.524559 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.524657 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.524902 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.524987 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.525251 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.525578 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.525824 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.525983 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.526182 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.526427 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.526569 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.526717 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.526849 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.527001 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.527275 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.527421 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.527582 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.527731 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.527900 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.528046 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.528209 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.528341 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.528518 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.528663 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.528827 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.529002 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.529236 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.529363 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.529493 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.529658 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.529820 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.529970 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.530096 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.530279 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.530410 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.530590 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.530769 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.530897 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.531116 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.531198 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.531446 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.531527 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.531772 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.531855 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.532078 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.532159 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.532383 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.532463 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.532689 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.532771 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.532994 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.533091 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.533330 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.533424 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.533636 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.533716 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.533939 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.534019 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.534248 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.534386 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.534550 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.534632 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.534951 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.535031 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.535271 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.535373 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.535574 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.535655 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.535901 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.535981 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.536217 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.536296 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.536534 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.536670 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.536848 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.536930 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.537193 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.537278 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.537513 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.537596 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.537827 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.537975 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.538191 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.538301 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.538519 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.538752 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.538834 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.539074 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.539189 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.539383 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.539474 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.539690 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.539772 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.539999 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.540089 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.540304 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.540446 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.540639 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.540781 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.540973 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.541110 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.541313 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.541515 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.541704 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.541785 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.542062 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.542261 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.542390 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.542602 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.542685 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.542918 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.543078 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.543245 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.543334 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.543568 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.543648 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.543882 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.543962 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.544192 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.544279 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.544515 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.544686 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.544827 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.544905 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.545160 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.545296 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.545476 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.545561 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.545787 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.545905 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.546099 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.546207 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.546409 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.546572 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.546775 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.546914 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.547055 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.547230 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.547363 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.547560 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.547691 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.547890 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.548210 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.548321 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.548420 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.548543 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.548655 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.548895 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.549021 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.549245 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.549355 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.549566 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.549671 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.549880 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.549989 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.550203 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.550420 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 17:10:26.550503 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.550795 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.551113 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.551430 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.551741 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.552051 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.552368 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.552683 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.553008 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.553361 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.554252 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.554820 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.555270 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.555626 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.555945 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.556295 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.556629 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.556949 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.557293 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.557600 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:10:26.558372 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 17:10:26.614666 n-d-854030-1 devstack@n-api.service[123016]: INFO dbcounter [None req-eeb44390-bb20-4327-8944-e079474f0111 None None] Registered counter for database nova_api Aug 22 17:10:26.622250 n-d-854030-1 devstack@n-api.service[123015]: INFO dbcounter [None req-7d7d8d23-e106-4e29-b423-3a12ff43cf2f None None] Registered counter for database nova_api Aug 22 17:10:26.636783 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_db.sqlalchemy.engines [None req-eeb44390-bb20-4327-8944-e079474f0111 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:10:26.644008 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writer thread running {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:10:26.644229 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_db.sqlalchemy.engines [None req-7d7d8d23-e106-4e29-b423-3a12ff43cf2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:10:26.651707 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writer thread running {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:10:26.702933 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.context [None req-eeb44390-bb20-4327-8944-e079474f0111 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0e788ee0-d5b8-44d6-b202-c201e1b338b4(cell1) {{(pid=123016) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 17:10:26.707426 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eeb44390-bb20-4327-8944-e079474f0111 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:10:26.708072 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eeb44390-bb20-4327-8944-e079474f0111 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:10:26.709679 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eeb44390-bb20-4327-8944-e079474f0111 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:10:26.711061 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eeb44390-bb20-4327-8944-e079474f0111 None None] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:10:26.711574 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eeb44390-bb20-4327-8944-e079474f0111 None None] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:10:26.713603 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eeb44390-bb20-4327-8944-e079474f0111 None None] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:10:26.714880 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.context [None req-7d7d8d23-e106-4e29-b423-3a12ff43cf2f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0e788ee0-d5b8-44d6-b202-c201e1b338b4(cell1) {{(pid=123015) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 17:10:26.715642 n-d-854030-1 devstack@n-api.service[123016]: INFO dbcounter [None req-eeb44390-bb20-4327-8944-e079474f0111 None None] Registered counter for database nova_cell0 Aug 22 17:10:26.719254 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7d7d8d23-e106-4e29-b423-3a12ff43cf2f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:10:26.719684 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7d7d8d23-e106-4e29-b423-3a12ff43cf2f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:10:26.719861 n-d-854030-1 devstack@n-api.service[123016]: INFO dbcounter [None req-eeb44390-bb20-4327-8944-e079474f0111 None None] Registered counter for database nova_cell1 Aug 22 17:10:26.721303 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7d7d8d23-e106-4e29-b423-3a12ff43cf2f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:10:26.722127 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7d7d8d23-e106-4e29-b423-3a12ff43cf2f None None] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:10:26.722791 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7d7d8d23-e106-4e29-b423-3a12ff43cf2f None None] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:10:26.724866 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7d7d8d23-e106-4e29-b423-3a12ff43cf2f None None] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:10:26.727310 n-d-854030-1 devstack@n-api.service[123015]: INFO dbcounter [None req-7d7d8d23-e106-4e29-b423-3a12ff43cf2f None None] Registered counter for database nova_cell0 Aug 22 17:10:26.728838 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_db.sqlalchemy.engines [None req-eeb44390-bb20-4327-8944-e079474f0111 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:10:26.730952 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_db.sqlalchemy.engines [None req-eeb44390-bb20-4327-8944-e079474f0111 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:10:26.732022 n-d-854030-1 devstack@n-api.service[123015]: INFO dbcounter [None req-7d7d8d23-e106-4e29-b423-3a12ff43cf2f None None] Registered counter for database nova_cell1 Aug 22 17:10:26.739319 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writer thread running {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:10:26.739696 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_db.sqlalchemy.engines [None req-7d7d8d23-e106-4e29-b423-3a12ff43cf2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:10:26.743161 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_db.sqlalchemy.engines [None req-7d7d8d23-e106-4e29-b423-3a12ff43cf2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:10:26.750774 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writer thread running {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:10:26.752136 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writer thread running {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:10:26.892673 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writer thread running {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:10:26.903804 n-d-854030-1 devstack@n-api.service[123016]: INFO dbcounter [None req-eeb44390-bb20-4327-8944-e079474f0111 None None] Registered counter for database nova_cell0 Aug 22 17:10:26.909156 n-d-854030-1 devstack@n-api.service[123015]: INFO dbcounter [None req-7d7d8d23-e106-4e29-b423-3a12ff43cf2f None None] Registered counter for database nova_cell0 Aug 22 17:10:26.915565 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_db.sqlalchemy.engines [None req-eeb44390-bb20-4327-8944-e079474f0111 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:10:26.917299 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_db.sqlalchemy.engines [None req-7d7d8d23-e106-4e29-b423-3a12ff43cf2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:10:26.920517 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writer thread running {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:10:26.921664 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writer thread running {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:10:27.241206 n-d-854030-1 devstack@n-api.service[123015]: WARNING keystonemiddleware.auth_token [None req-7d7d8d23-e106-4e29-b423-3a12ff43cf2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 17:10:27.247449 n-d-854030-1 devstack@n-api.service[123016]: WARNING keystonemiddleware.auth_token [None req-eeb44390-bb20-4327-8944-e079474f0111 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 17:10:27.248708 n-d-854030-1 devstack@n-api.service[123015]: WARNING keystonemiddleware.auth_token [None req-7d7d8d23-e106-4e29-b423-3a12ff43cf2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 17:10:27.254799 n-d-854030-1 devstack@n-api.service[123016]: WARNING keystonemiddleware.auth_token [None req-eeb44390-bb20-4327-8944-e079474f0111 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 17:10:27.593575 n-d-854030-1 devstack@n-api.service[123015]: WARNING keystonemiddleware.auth_token [None req-7d7d8d23-e106-4e29-b423-3a12ff43cf2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 17:10:27.599573 n-d-854030-1 devstack@n-api.service[123015]: WARNING keystonemiddleware.auth_token [None req-7d7d8d23-e106-4e29-b423-3a12ff43cf2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 17:10:27.604314 n-d-854030-1 devstack@n-api.service[123016]: WARNING keystonemiddleware.auth_token [None req-eeb44390-bb20-4327-8944-e079474f0111 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 17:10:27.604948 n-d-854030-1 devstack@n-api.service[123015]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fd808ad9c0 pid: 123015 (default app) Aug 22 17:10:27.610601 n-d-854030-1 devstack@n-api.service[123016]: WARNING keystonemiddleware.auth_token [None req-eeb44390-bb20-4327-8944-e079474f0111 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 17:10:27.615982 n-d-854030-1 devstack@n-api.service[123016]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fd808ad9c0 pid: 123016 (default app) Aug 22 17:11:10.482439 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=3 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:10.484097 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=3 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:10.497342 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=3 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:10.497342 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=3 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:10.661513 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:10.663256 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:10.664560 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:10.665601 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:11.791129 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b6360dde-cc67-4551-b6ce-30d56d682cc5 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Calling method '.version_select at 0x7f800c1ba700>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:11.797316 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:11.797316 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:11.804931 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b6360dde-cc67-4551-b6ce-30d56d682cc5 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0e788ee0-d5b8-44d6-b202-c201e1b338b4(cell1) {{(pid=123015) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 22 17:11:11.805919 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6360dde-cc67-4551-b6ce-30d56d682cc5 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:11.806660 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6360dde-cc67-4551-b6ce-30d56d682cc5 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:11.807358 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6360dde-cc67-4551-b6ce-30d56d682cc5 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:11.837531 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6360dde-cc67-4551-b6ce-30d56d682cc5 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:11.838520 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6360dde-cc67-4551-b6ce-30d56d682cc5 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:11.839088 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6360dde-cc67-4551-b6ce-30d56d682cc5 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:11.854070 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6360dde-cc67-4551-b6ce-30d56d682cc5 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:11.854892 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6360dde-cc67-4551-b6ce-30d56d682cc5 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:11.855536 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6360dde-cc67-4551-b6ce-30d56d682cc5 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:11.864022 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b6360dde-cc67-4551-b6ce-30d56d682cc5 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1424 microversion: 2.41 time: 1.393554 Aug 22 17:11:11.872479 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1/1] 10.222.0.96 () {60 vars in 1208 bytes} [Mon Aug 22 17:11:10 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1424 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:11:12.137558 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8fc681d8-8716-49c5-a62f-46cdc2753714 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '.version_select at 0x7f800c1ba700>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:12.139075 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:12.139075 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:12.145738 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-8fc681d8-8716-49c5-a62f-46cdc2753714 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0e788ee0-d5b8-44d6-b202-c201e1b338b4(cell1) {{(pid=123016) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 22 17:11:12.146636 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8fc681d8-8716-49c5-a62f-46cdc2753714 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:12.147115 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8fc681d8-8716-49c5-a62f-46cdc2753714 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:12.147549 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8fc681d8-8716-49c5-a62f-46cdc2753714 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:12.194153 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8fc681d8-8716-49c5-a62f-46cdc2753714 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:12.195044 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8fc681d8-8716-49c5-a62f-46cdc2753714 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:12.195630 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8fc681d8-8716-49c5-a62f-46cdc2753714 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:12.214591 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8fc681d8-8716-49c5-a62f-46cdc2753714 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:12.215317 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8fc681d8-8716-49c5-a62f-46cdc2753714 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:12.215920 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8fc681d8-8716-49c5-a62f-46cdc2753714 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:12.224125 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8fc681d8-8716-49c5-a62f-46cdc2753714 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 1.573780 Aug 22 17:11:12.225361 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1/2] 10.222.0.96 () {58 vars in 1167 bytes} [Mon Aug 22 17:11:10 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:12.342289 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b9f5d454-85ae-4e19-9a0b-d2766faa8f14 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:12.346439 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:12.346439 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:12.352392 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b9f5d454-85ae-4e19-9a0b-d2766faa8f14 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:12.353509 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b9f5d454-85ae-4e19-9a0b-d2766faa8f14 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:12.356220 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b9f5d454-85ae-4e19-9a0b-d2766faa8f14 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:12.357110 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b9f5d454-85ae-4e19-9a0b-d2766faa8f14 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:12.359484 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b9f5d454-85ae-4e19-9a0b-d2766faa8f14 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:12.368258 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b9f5d454-85ae-4e19-9a0b-d2766faa8f14 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:12.418213 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b9f5d454-85ae-4e19-9a0b-d2766faa8f14 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.544035 Aug 22 17:11:12.419422 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 2/3] 10.222.0.96 () {58 vars in 1176 bytes} [Mon Aug 22 17:11:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:12.437758 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-55d83ad9-57fd-4e39-841e-06c5e7838197 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1726322139"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:12.460932 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:12.460932 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:12.465314 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.aggregate [None req-55d83ad9-57fd-4e39-841e-06c5e7838197 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Generated uuid 8847781f-45fb-4425-8828-ce12ded9b231 for aggregate {{(pid=123015) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:11:12.513260 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a66ae311-67e4-4a51-93f0-96d25e6c52ba tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1698552636", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:12.661452 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-55d83ad9-57fd-4e39-841e-06c5e7838197 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.232481 Aug 22 17:11:12.661452 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 3/4] 10.222.0.96 () {62 vars in 1205 bytes} [Mon Aug 22 17:11:12 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:11:12.861829 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-a66ae311-67e4-4a51-93f0-96d25e6c52ba tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] validate_networks() for None {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:11:13.026242 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c76befaa-750a-4007-ad5f-2efb7cd945ce tempest-FlavorMetadataValidation-721234604 tempest-FlavorMetadataValidation-721234604-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1040657285", "id": 674935434, "os-flavor-access:is_public": "True"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:13.029703 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:13.029703 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:13.140379 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c76befaa-750a-4007-ad5f-2efb7cd945ce tempest-FlavorMetadataValidation-721234604 tempest-FlavorMetadataValidation-721234604-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.485242 Aug 22 17:11:13.141715 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 4/5] 10.222.0.96 () {62 vars in 1188 bytes} [Mon Aug 22 17:11:12 2022] POST /compute/v2.1/flavors => generated 468 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:11:13.264676 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-259a6bfb-e443-4973-b385-b2a1056b1b6c tempest-AZAdminV2TestJSON-2106212531 tempest-AZAdminV2TestJSON-2106212531-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:13.267276 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-259a6bfb-e443-4973-b385-b2a1056b1b6c tempest-AZAdminV2TestJSON-2106212531 tempest-AZAdminV2TestJSON-2106212531-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:13.267981 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-259a6bfb-e443-4973-b385-b2a1056b1b6c tempest-AZAdminV2TestJSON-2106212531 tempest-AZAdminV2TestJSON-2106212531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:13.269336 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-259a6bfb-e443-4973-b385-b2a1056b1b6c tempest-AZAdminV2TestJSON-2106212531 tempest-AZAdminV2TestJSON-2106212531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:13.269660 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-259a6bfb-e443-4973-b385-b2a1056b1b6c tempest-AZAdminV2TestJSON-2106212531 tempest-AZAdminV2TestJSON-2106212531-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:13.271152 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-259a6bfb-e443-4973-b385-b2a1056b1b6c tempest-AZAdminV2TestJSON-2106212531 tempest-AZAdminV2TestJSON-2106212531-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:13.271812 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-259a6bfb-e443-4973-b385-b2a1056b1b6c tempest-AZAdminV2TestJSON-2106212531 tempest-AZAdminV2TestJSON-2106212531-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:13.298200 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-259a6bfb-e443-4973-b385-b2a1056b1b6c tempest-AZAdminV2TestJSON-2106212531 tempest-AZAdminV2TestJSON-2106212531-project-admin] 10.222.0.96 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.155107 Aug 22 17:11:13.299071 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 5/6] 10.222.0.96 () {58 vars in 1164 bytes} [Mon Aug 22 17:11:13 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:11:13.311512 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8646e071-3192-4f5e-beb0-a163c3c4fb2b tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-366998552"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:13.411128 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-a66ae311-67e4-4a51-93f0-96d25e6c52ba tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:11:13.411550 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-a66ae311-67e4-4a51-93f0-96d25e6c52ba tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:11:13.412652 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-a66ae311-67e4-4a51-93f0-96d25e6c52ba tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:11:13.413418 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-a66ae311-67e4-4a51-93f0-96d25e6c52ba tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:11:13.413842 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-a66ae311-67e4-4a51-93f0-96d25e6c52ba tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:11:13.429586 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a66ae311-67e4-4a51-93f0-96d25e6c52ba tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:13.430178 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a66ae311-67e4-4a51-93f0-96d25e6c52ba tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:13.430823 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a66ae311-67e4-4a51-93f0-96d25e6c52ba tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:13.431124 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:13.431124 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:13.431626 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a66ae311-67e4-4a51-93f0-96d25e6c52ba tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:13.434455 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a66ae311-67e4-4a51-93f0-96d25e6c52ba tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:13.435353 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a66ae311-67e4-4a51-93f0-96d25e6c52ba tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:13.477127 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-a66ae311-67e4-4a51-93f0-96d25e6c52ba tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Getting quotas for project 7d39044d6ce2411fbecee39e30eb5b6e. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:11:13.487528 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-a66ae311-67e4-4a51-93f0-96d25e6c52ba tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Getting quotas for user 25b8f088a9d54406b1d670d7f8feecd9 and project 7d39044d6ce2411fbecee39e30eb5b6e. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:11:13.501647 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-a66ae311-67e4-4a51-93f0-96d25e6c52ba tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Going to run 1 instances... {{(pid=123016) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:11:13.505684 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-a66ae311-67e4-4a51-93f0-96d25e6c52ba tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:11:13.567065 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8646e071-3192-4f5e-beb0-a163c3c4fb2b tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.259190 Aug 22 17:11:13.569847 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 6/7] 10.222.0.96 () {62 vars in 1210 bytes} [Mon Aug 22 17:11:13 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:11:13.691392 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a66ae311-67e4-4a51-93f0-96d25e6c52ba tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.464610 Aug 22 17:11:13.692869 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 2/8] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:11:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:11:13.700697 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-499960cb-691e-45c1-b612-e576cfb7eaf5 tempest-FlavorMetadataValidation-721234604 tempest-FlavorMetadataValidation-721234604-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:13.706054 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:13.706054 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:13.766526 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7c7b14b7-0d11-43d8-8949-235e443e58eb tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-685218715", "id": 746296373, "os-flavor-access:is_public": "False"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:13.769694 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:13.769694 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:13.884879 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7c7b14b7-0d11-43d8-8949-235e443e58eb tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.313677 Aug 22 17:11:13.895840 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 7/9] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:11:13 2022] POST /compute/v2.1/flavors => generated 435 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:13.904275 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6f595801-bde4-44a3-a319-f04c442252dc tempest-AZAdminV2TestJSON-2106212531 tempest-AZAdminV2TestJSON-2106212531-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:13.905071 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:13.905071 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:13.908136 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6f595801-bde4-44a3-a319-f04c442252dc tempest-AZAdminV2TestJSON-2106212531 tempest-AZAdminV2TestJSON-2106212531-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:13.908626 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6f595801-bde4-44a3-a319-f04c442252dc tempest-AZAdminV2TestJSON-2106212531 tempest-AZAdminV2TestJSON-2106212531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:13.909066 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6f595801-bde4-44a3-a319-f04c442252dc tempest-AZAdminV2TestJSON-2106212531 tempest-AZAdminV2TestJSON-2106212531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:13.910969 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6f595801-bde4-44a3-a319-f04c442252dc tempest-AZAdminV2TestJSON-2106212531 tempest-AZAdminV2TestJSON-2106212531-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:13.911463 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6f595801-bde4-44a3-a319-f04c442252dc tempest-AZAdminV2TestJSON-2106212531 tempest-AZAdminV2TestJSON-2106212531-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:13.911895 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6f595801-bde4-44a3-a319-f04c442252dc tempest-AZAdminV2TestJSON-2106212531 tempest-AZAdminV2TestJSON-2106212531-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:13.953656 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6f595801-bde4-44a3-a319-f04c442252dc tempest-AZAdminV2TestJSON-2106212531 tempest-AZAdminV2TestJSON-2106212531-project-admin] 10.222.0.96 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.055860 Aug 22 17:11:13.954416 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 8/10] 10.222.0.96 () {58 vars in 1185 bytes} [Mon Aug 22 17:11:13 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:13.974407 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8c47bebe-f6a1-40d9-8c40-d0c85afcc71d tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:13.975214 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:13.975214 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:13.990209 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8c47bebe-f6a1-40d9-8c40-d0c85afcc71d tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] 10.222.0.96 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.027813 Aug 22 17:11:13.997515 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 9/11] 10.222.0.96 () {60 vars in 1190 bytes} [Mon Aug 22 17:11:13 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:11:14.003297 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2383a584-a221-48ed-a39d-881b5740d417 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:14.004043 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-2383a584-a221-48ed-a39d-881b5740d417 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:14.029403 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-499960cb-691e-45c1-b612-e576cfb7eaf5 tempest-FlavorMetadataValidation-721234604 tempest-FlavorMetadataValidation-721234604-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors/674935434/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.334859 Aug 22 17:11:14.035838 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 3/12] 10.222.0.96 () {62 vars in 1262 bytes} [Mon Aug 22 17:11:13 2022] POST /compute/v2.1/flavors/674935434/os-extra_specs => generated 62 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:14.047089 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-053acc93-bed9-44b8-88af-1a4d30d36d70 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b3c57acf7cf1461dad5130cf904dbe65"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:14.057604 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:14.057604 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:14.261935 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-053acc93-bed9-44b8-88af-1a4d30d36d70 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors/746296373/action" status: 200 len: 96 microversion: 2.1 time: 0.223952 Aug 22 17:11:14.268531 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 4/13] 10.222.0.96 () {60 vars in 1197 bytes} [Mon Aug 22 17:11:14 2022] POST /compute/v2.1/flavors/746296373/action => generated 96 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:11:14.274057 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-acc02fa3-5d75-46b8-9ed0-ac7264bfdf99 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854030-1"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:14.277287 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:14.277287 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:14.301482 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-acc02fa3-5d75-46b8-9ed0-ac7264bfdf99 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:14.301975 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-acc02fa3-5d75-46b8-9ed0-ac7264bfdf99 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:14.306969 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-acc02fa3-5d75-46b8-9ed0-ac7264bfdf99 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:14.346847 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-2383a584-a221-48ed-a39d-881b5740d417 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:14.364727 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2383a584-a221-48ed-a39d-881b5740d417 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1220 microversion: 2.1 time: 0.365901 Aug 22 17:11:14.366002 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 10/14] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:13 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1220 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:14.372725 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cb6bd23f-af7e-4a15-ba4a-943a6663a648 tempest-FlavorMetadataValidation-721234604 tempest-FlavorMetadataValidation-721234604-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:14.373882 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:14.373882 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:14.548940 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-cb6bd23f-af7e-4a15-ba4a-943a6663a648 tempest-FlavorMetadataValidation-721234604 tempest-FlavorMetadataValidation-721234604-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/674935434" status: 202 len: 0 microversion: 2.86 time: 0.180914 Aug 22 17:11:14.549543 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 11/15] 10.222.0.96 () {60 vars in 1199 bytes} [Mon Aug 22 17:11:14 2022] DELETE /compute/v2.1/flavors/674935434 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:11:14.554952 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-18f95b93-3cb3-4a15-89b2-79e8b11bb14a tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b3c57acf7cf1461dad5130cf904dbe65"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:14.559201 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:14.559201 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:14.890627 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-18f95b93-3cb3-4a15-89b2-79e8b11bb14a tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project b3c57acf7cf1461dad5130cf904dbe65 combination. Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-18f95b93-3cb3-4a15-89b2-79e8b11bb14a tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Request method failure captured: Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/flavors/746296373/action HTTP/1.1 Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 67 Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7ivnoT52uOBlfT44wfqh6LDjamFXyhXGWrorgWOgqLwSMIplLgm44VHpZSjkn_NApUOCNgDJLu0o10c5imAWGP6aDTwshtHkh6CnLg10q30zwE8tJQhjT7eGEVRMTqcpYLcPAt3nyTSHYNZ-_9H3Mm0UWWhyd_KileRi9u3HvW7mZQ Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: e76a5d11edcf4803ad4a59d9f61445e0 Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-315916960 Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:11:14.905675 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:11:14.907300 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e76a5d11edcf4803ad4a59d9f61445e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_e76a5d11edcf4803ad4a59d9f61445e0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e76a5d11edcf4803ad4a59d9f61445e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/e76a5d11edcf4803ad4a59d9f61445e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:11:14.907300 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-315916960 Aug 22 17:11:14.907300 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: e76a5d11edcf4803ad4a59d9f61445e0 Aug 22 17:11:14.907300 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-315916960 Aug 22 17:11:14.907300 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin Aug 22 17:11:14.907300 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:11:14.907300 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:11:14.907300 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 6f9eaea71ac84542be5b0a2c1fd5735e Aug 22 17:11:14.907300 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin Aug 22 17:11:14.907300 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:11:14.907300 n-d-854030-1 devstack@n-api.service[123015]: {"addTenantAccess": {"tenant": "b3c57acf7cf1461dad5130cf904dbe65"}} Aug 22 17:11:14.907300 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:11:14.907894 n-d-854030-1 devstack@n-api.service[123015]: exception: Flavor access already exists for flavor 16 and project b3c57acf7cf1461dad5130cf904dbe65 combination. Aug 22 17:11:14.907894 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '746296373', 'body': {'addTenantAccess': {'tenant': 'b3c57acf7cf1461dad5130cf904dbe65'}}} Aug 22 17:11:14.907894 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:11:14.907894 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:14.907894 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 17:11:14.907894 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 22 17:11:14.907894 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 17:11:14.907894 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 22 17:11:14.907894 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 17:11:14.907894 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 22 17:11:14.907894 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 17:11:14.907894 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 22 17:11:14.907894 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 17:11:14.907894 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 17:11:14.907894 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 17:11:14.907894 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result.read() Aug 22 17:11:14.907894 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 17:11:14.907894 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 22 17:11:14.908755 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 17:11:14.908755 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 22 17:11:14.908755 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 17:11:14.908755 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 22 17:11:14.908755 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 17:11:14.908755 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 22 17:11:14.908755 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-b3c57acf7cf1461dad5130cf904dbe65' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 22 17:11:14.908755 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:14.908755 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 22 17:11:14.908755 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:14.908755 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:14.908755 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 22 17:11:14.908755 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 22 17:11:14.908755 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 22 17:11:14.908755 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi session.flush() Aug 22 17:11:14.908755 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 17:11:14.908755 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 22 17:11:14.908755 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 17:11:14.908755 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 22 17:11:14.910497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 17:11:14.910497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 22 17:11:14.910497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 17:11:14.910497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception Aug 22 17:11:14.910497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 17:11:14.910497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 22 17:11:14.910497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 17:11:14.910497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 22 17:11:14.910497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 17:11:14.910497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 22 17:11:14.910497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 17:11:14.910497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 22 17:11:14.910497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 22 17:11:14.910497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 22 17:11:14.910497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 17:11:14.910497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 17:11:14.910497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 17:11:14.910497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 22 17:11:14.912485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 17:11:14.912485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 22 17:11:14.912485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 17:11:14.912485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 22 17:11:14.912485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 17:11:14.912485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 17:11:14.912485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 17:11:14.912485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception Aug 22 17:11:14.912485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 17:11:14.912485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 22 17:11:14.912485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 17:11:14.912485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 22 17:11:14.912485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 17:11:14.912485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 22 17:11:14.912485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 17:11:14.912485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 22 17:11:14.912485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 17:11:14.912485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 17:11:14.914343 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 17:11:14.914343 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result.read() Aug 22 17:11:14.914343 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 17:11:14.914343 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 22 17:11:14.914343 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 17:11:14.914343 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 22 17:11:14.914343 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 17:11:14.914343 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 22 17:11:14.914343 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 17:11:14.914343 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 22 17:11:14.914343 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-b3c57acf7cf1461dad5130cf904dbe65' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 22 17:11:14.914343 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 22 17:11:14.914343 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 22, 17, 11, 14, 823568), 'updated_at': None, 'flavor_id': 16, 'project_id': 'b3c57acf7cf1461dad5130cf904dbe65'}] Aug 22 17:11:14.914343 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 17:11:14.914343 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:14.914343 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:14.914343 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:14.916096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:14.916096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 22 17:11:14.916096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 22 17:11:14.916096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 22 17:11:14.916096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 22 17:11:14.916096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 22 17:11:14.916096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 22 17:11:14.916096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 22 17:11:14.916096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 22 17:11:14.916096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 22 17:11:14.916096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 22 17:11:14.916096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:11:14.916096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:11:14.916096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 22 17:11:14.916096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 22 17:11:14.916096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project b3c57acf7cf1461dad5130cf904dbe65 combination. Aug 22 17:11:14.916096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:14.916096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:14.916096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project b3c57acf7cf1461dad5130cf904dbe65 combination. Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:11:14.919053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:11:14.922356 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project b3c57acf7cf1461dad5130cf904dbe65 combination. Aug 22 17:11:14.922356 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:14.927340 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-18f95b93-3cb3-4a15-89b2-79e8b11bb14a tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project b3c57acf7cf1461dad5130cf904dbe65 combination. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:11:14.929137 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-18f95b93-3cb3-4a15-89b2-79e8b11bb14a tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors/746296373/action" status: 409 len: 152 microversion: 2.1 time: 0.376526 Aug 22 17:11:14.933245 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 12/16] 10.222.0.96 () {60 vars in 1197 bytes} [Mon Aug 22 17:11:14 2022] POST /compute/v2.1/flavors/746296373/action => generated 152 bytes in 380 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:11:14.940387 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7b39b3a6-f00a-43fa-b814-b1dfb47423a3 tempest-FlavorMetadataValidation-721234604 tempest-FlavorMetadataValidation-721234604-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:14.985055 n-d-854030-1 devstack@n-api.service[123016]: WARNING nova.scheduler.client.report [None req-acc02fa3-5d75-46b8-9ed0-ac7264bfdf99 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] [req-5800ff6c-8bf3-4355-a6af-650d3829d97a] Failed to update aggregates to [8847781f-45fb-4425-8828-ce12ded9b231] for resource provider with UUID 190c2828-63d8-4621-a18d-73826677ef3c. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-5800ff6c-8bf3-4355-a6af-650d3829d97a"}]} Aug 22 17:11:15.001271 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7b39b3a6-f00a-43fa-b814-b1dfb47423a3 tempest-FlavorMetadataValidation-721234604 tempest-FlavorMetadataValidation-721234604-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.069827 Aug 22 17:11:15.009716 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 13/17] 10.222.0.96 () {60 vars in 1187 bytes} [Mon Aug 22 17:11:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:11:15.020333 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c7f99f4a-2abb-4bd8-b0ea-a124ad902145 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b3c57acf7cf1461dad5130cf904dbe65"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:15.036614 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:15.036614 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:15.232860 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-acc02fa3-5d75-46b8-9ed0-ac7264bfdf99 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 0.961668 Aug 22 17:11:15.232860 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 5/18] 10.222.0.96 () {62 vars in 1232 bytes} [Mon Aug 22 17:11:14 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:11:15.249161 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f78a4e01-2284-4ea8-92cf-28a68f2c7f23 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854030-1"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:15.256238 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:15.256238 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:15.279601 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f78a4e01-2284-4ea8-92cf-28a68f2c7f23 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:15.280443 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f78a4e01-2284-4ea8-92cf-28a68f2c7f23 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:15.281233 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f78a4e01-2284-4ea8-92cf-28a68f2c7f23 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:15.433696 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c7f99f4a-2abb-4bd8-b0ea-a124ad902145 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors/746296373/action" status: 200 len: 21 microversion: 2.1 time: 0.412340 Aug 22 17:11:15.433696 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 14/19] 10.222.0.96 () {60 vars in 1197 bytes} [Mon Aug 22 17:11:15 2022] POST /compute/v2.1/flavors/746296373/action => generated 21 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:11:15.434653 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-214345ca-4f0e-4438-b4d3-1af3d543b279 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:15.435410 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-214345ca-4f0e-4438-b4d3-1af3d543b279 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:15.510440 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-214345ca-4f0e-4438-b4d3-1af3d543b279 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:15.527066 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-214345ca-4f0e-4438-b4d3-1af3d543b279 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1220 microversion: 2.1 time: 0.095761 Aug 22 17:11:15.529880 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 15/20] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:15 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:15.558071 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d1c049ec-aa71-4f7b-8fee-b3258e1ccad4 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:15.559186 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:15.559186 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:15.690019 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f78a4e01-2284-4ea8-92cf-28a68f2c7f23 tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.448605 Aug 22 17:11:15.691346 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 6/21] 10.222.0.96 () {62 vars in 1232 bytes} [Mon Aug 22 17:11:15 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:11:15.697031 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d1c049ec-aa71-4f7b-8fee-b3258e1ccad4 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/746296373" status: 202 len: 0 microversion: 2.1 time: 0.165737 Aug 22 17:11:15.707419 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5360cb60-6923-43ea-a5f0-8087c3b0f78f tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:15.713455 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 16/22] 10.222.0.96 () {58 vars in 1158 bytes} [Mon Aug 22 17:11:15 2022] DELETE /compute/v2.1/flavors/746296373 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:11:15.722102 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:15.722102 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:15.725921 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6c2cd27f-85f5-4953-af87-8c363abdb70c tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:15.759278 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6c2cd27f-85f5-4953-af87-8c363abdb70c tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044433 Aug 22 17:11:15.759894 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 17/23] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:11:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:15.797819 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7b3ab89c-6eb8-453b-aa9c-149dec3872be tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-152504589", "id": 2097756821, "os-flavor-access:is_public": "True"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:15.812329 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:15.812329 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:15.857222 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5360cb60-6923-43ea-a5f0-8087c3b0f78f tempest-AggregatesAdminTestV241-176793155 tempest-AggregatesAdminTestV241-176793155-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.156259 Aug 22 17:11:15.859158 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 7/24] 10.222.0.96 () {60 vars in 1193 bytes} [Mon Aug 22 17:11:15 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:15.903960 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-92d4ba97-c763-4451-8625-7d8e12c922f8 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2048340960", "name": "tempest-test_aggregate-122645576"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:15.905944 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7b3ab89c-6eb8-453b-aa9c-149dec3872be tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.117052 Aug 22 17:11:15.913803 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 18/25] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:11:15 2022] POST /compute/v2.1/flavors => generated 437 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:15.930050 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-49025adc-635a-4931-be42-7ec11f53a38d tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:15.932110 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:15.932110 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:15.942557 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-49025adc-635a-4931-be42-7ec11f53a38d tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-49025adc-635a-4931-be42-7ec11f53a38d tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Request method failure captured: Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/flavors/2097756821/os-flavor-access HTTP/1.1 Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7ivnoT52uOBlfT44wfqh6LDjamFXyhXGWrorgWOgqLwSMIplLgm44VHpZSjkn_NApUOCNgDJLu0o10c5imAWGP6aDTwshtHkh6CnLg10q30zwE8tJQhjT7eGEVRMTqcpYLcPAt3nyTSHYNZ-_9H3Mm0UWWhyd_KileRi9u3HvW7mZQ Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: e76a5d11edcf4803ad4a59d9f61445e0 Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-315916960 Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:11:15.944680 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:11:15.946026 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e76a5d11edcf4803ad4a59d9f61445e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_e76a5d11edcf4803ad4a59d9f61445e0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e76a5d11edcf4803ad4a59d9f61445e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/e76a5d11edcf4803ad4a59d9f61445e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:11:15.946026 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-315916960 Aug 22 17:11:15.946026 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: e76a5d11edcf4803ad4a59d9f61445e0 Aug 22 17:11:15.946026 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-315916960 Aug 22 17:11:15.946026 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin Aug 22 17:11:15.946026 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:11:15.946026 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:11:15.946026 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 6f9eaea71ac84542be5b0a2c1fd5735e Aug 22 17:11:15.946026 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin Aug 22 17:11:15.946026 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:11:15.946026 n-d-854030-1 devstack@n-api.service[123015]: exception: Access list not available for public flavors. Aug 22 17:11:15.946026 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'flavor_id': '2097756821'} Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 22 17:11:15.946722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:15.948599 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-49025adc-635a-4931-be42-7ec11f53a38d tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:11:15.949510 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-49025adc-635a-4931-be42-7ec11f53a38d tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/2097756821/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.034137 Aug 22 17:11:15.953959 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 19/26] 10.222.0.96 () {58 vars in 1209 bytes} [Mon Aug 22 17:11:15 2022] GET /compute/v2.1/flavors/2097756821/os-flavor-access => generated 91 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:11:15.960578 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c413a526-83f1-4e22-82e4-98afaa6dac6b tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:16.008106 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:16.008106 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:16.011884 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.aggregate [None req-92d4ba97-c763-4451-8625-7d8e12c922f8 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Generated uuid 03a27b38-d091-4c7a-bbe1-7ed09e2e433c for aggregate {{(pid=123016) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:11:16.085245 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c413a526-83f1-4e22-82e4-98afaa6dac6b tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/2097756821" status: 202 len: 0 microversion: 2.1 time: 0.129788 Aug 22 17:11:16.088094 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 20/27] 10.222.0.96 () {58 vars in 1161 bytes} [Mon Aug 22 17:11:15 2022] DELETE /compute/v2.1/flavors/2097756821 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:11:16.102456 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-eecd8eda-7b51-4a4d-84d9-7858d0ed4e76 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:16.153321 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-eecd8eda-7b51-4a4d-84d9-7858d0ed4e76 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041294 Aug 22 17:11:16.153321 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 21/28] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:11:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:11:16.160753 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-99ba36dc-78c9-4b39-917c-eba05c8f8479 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1536808925", "id": 373651650, "os-flavor-access:is_public": "False"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:16.186018 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-92d4ba97-c763-4451-8625-7d8e12c922f8 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.288199 Aug 22 17:11:16.188217 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 8/29] 10.222.0.96 () {60 vars in 1165 bytes} [Mon Aug 22 17:11:15 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:16.199735 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-76312bef-5256-419b-99be-b86c05709ca3 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:16.201636 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:16.201636 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:16.257208 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-76312bef-5256-419b-99be-b86c05709ca3 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.061433 Aug 22 17:11:16.258566 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 9/30] 10.222.0.96 () {58 vars in 1143 bytes} [Mon Aug 22 17:11:16 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:16.277925 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-bbc2e15d-2ccb-4f14-920a-6e212ede97f3 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854030-1"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:16.282767 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:16.282767 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:16.284963 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-99ba36dc-78c9-4b39-917c-eba05c8f8479 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.127183 Aug 22 17:11:16.286111 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 22/31] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:11:16 2022] POST /compute/v2.1/flavors => generated 436 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:11:16.291737 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bbc2e15d-2ccb-4f14-920a-6e212ede97f3 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:16.292295 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bbc2e15d-2ccb-4f14-920a-6e212ede97f3 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:16.292767 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bbc2e15d-2ccb-4f14-920a-6e212ede97f3 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:16.741889 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-bbc2e15d-2ccb-4f14-920a-6e212ede97f3 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.1 time: 0.473552 Aug 22 17:11:16.742717 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 10/32] 10.222.0.96 () {60 vars in 1191 bytes} [Mon Aug 22 17:11:16 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:11:16.748106 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e8152013-4661-4fdb-9572-9b313cc426a1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:16.748927 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e8152013-4661-4fdb-9572-9b313cc426a1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:16.763257 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e8152013-4661-4fdb-9572-9b313cc426a1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:16.763831 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e8152013-4661-4fdb-9572-9b313cc426a1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:16.764275 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e8152013-4661-4fdb-9572-9b313cc426a1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:16.765821 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e8152013-4661-4fdb-9572-9b313cc426a1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:16.766485 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e8152013-4661-4fdb-9572-9b313cc426a1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:16.766901 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e8152013-4661-4fdb-9572-9b313cc426a1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:16.894380 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-47769bcf-a86b-4b72-911e-f9be7c7c7e0a tempest-FlavorsAccessNegativeTestJSON-876432830 tempest-FlavorsAccessNegativeTestJSON-876432830-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b3c57acf7cf1461dad5130cf904dbe65"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:16.897017 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:16.897017 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:16.897961 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-47769bcf-a86b-4b72-911e-f9be7c7c7e0a tempest-FlavorsAccessNegativeTestJSON-876432830 tempest-FlavorsAccessNegativeTestJSON-876432830-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'bd0851f91ee94fc991ea1d46aae244e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c57acf7cf1461dad5130cf904dbe65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-47769bcf-a86b-4b72-911e-f9be7c7c7e0a tempest-FlavorsAccessNegativeTestJSON-876432830 tempest-FlavorsAccessNegativeTestJSON-876432830-project] Request method failure captured: Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/flavors/373651650/action HTTP/1.1 Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 67 Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7isAUI5aoN-TUz-kC9BhVo106brEnkx2msuVujcQyNPRI64Wa1RCTLfCpJhTA6O-eKTYHfEqW5Usy41_l22GzPr1LuFYVtSoHkV5siWPEZimA2uT7_lM64pBAsQ0U9BWMNdMhnctGcFUZjidhR7mGlkcIK0_VD3-M7DP48B8AycVts Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: b3c57acf7cf1461dad5130cf904dbe65 Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-876432830 Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:11:16.901288 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:11:16.906976 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/b3c57acf7cf1461dad5130cf904dbe65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_b3c57acf7cf1461dad5130cf904dbe65", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/b3c57acf7cf1461dad5130cf904dbe65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/b3c57acf7cf1461dad5130cf904dbe65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:11:16.906976 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-876432830 Aug 22 17:11:16.906976 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: b3c57acf7cf1461dad5130cf904dbe65 Aug 22 17:11:16.906976 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-876432830 Aug 22 17:11:16.906976 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-FlavorsAccessNegativeTestJSON-876432830-project Aug 22 17:11:16.906976 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:11:16.906976 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:11:16.906976 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: bd0851f91ee94fc991ea1d46aae244e9 Aug 22 17:11:16.906976 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-876432830-project Aug 22 17:11:16.906976 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:11:16.906976 n-d-854030-1 devstack@n-api.service[123015]: {"addTenantAccess": {"tenant": "b3c57acf7cf1461dad5130cf904dbe65"}} Aug 22 17:11:16.906976 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:11:16.907574 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 22 17:11:16.907574 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '373651650', 'body': {'addTenantAccess': {'tenant': 'b3c57acf7cf1461dad5130cf904dbe65'}}} Aug 22 17:11:16.907574 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:11:16.907574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:16.907574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:16.907574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:16.907574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:11:16.907574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:11:16.907574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:16.907574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:16.907574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:16.907574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:16.907574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 22 17:11:16.907574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 22 17:11:16.907574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:11:16.907574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:11:16.907574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:11:16.907574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:11:16.907574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 22 17:11:16.908469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:16.909528 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-47769bcf-a86b-4b72-911e-f9be7c7c7e0a tempest-FlavorsAccessNegativeTestJSON-876432830 tempest-FlavorsAccessNegativeTestJSON-876432830-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:11:16.909528 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-47769bcf-a86b-4b72-911e-f9be7c7c7e0a tempest-FlavorsAccessNegativeTestJSON-876432830 tempest-FlavorsAccessNegativeTestJSON-876432830-project] 10.222.0.96 "POST /compute/v2.1/flavors/373651650/action" status: 403 len: 130 microversion: 2.1 time: 0.608910 Aug 22 17:11:16.909528 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 23/33] 10.222.0.96 () {60 vars in 1197 bytes} [Mon Aug 22 17:11:16 2022] POST /compute/v2.1/flavors/373651650/action => generated 130 bytes in 611 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:11:16.914758 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7092edbe-c81f-4ab3-a744-179d8738a853 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:16.936500 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=12 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:16.947421 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e8152013-4661-4fdb-9572-9b313cc426a1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:16.963910 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e8152013-4661-4fdb-9572-9b313cc426a1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1224 microversion: 2.1 time: 0.220266 Aug 22 17:11:16.964495 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 11/34] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:16 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1224 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:17.034040 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7092edbe-c81f-4ab3-a744-179d8738a853 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/373651650" status: 202 len: 0 microversion: 2.1 time: 0.122844 Aug 22 17:11:17.034733 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 24/35] 10.222.0.96 () {58 vars in 1158 bytes} [Mon Aug 22 17:11:16 2022] DELETE /compute/v2.1/flavors/373651650 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:11:17.043065 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-93ea8b69-8b2c-4d2e-bcf4-09e64b5ab142 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:17.073817 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-93ea8b69-8b2c-4d2e-bcf4-09e64b5ab142 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034332 Aug 22 17:11:17.074915 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 12/36] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:11:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:17.095454 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b5fbd103-28c8-482f-ad71-fae2dc3c3e31 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-392775180", "id": 361890697, "os-flavor-access:is_public": "False"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:17.200772 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b5fbd103-28c8-482f-ad71-fae2dc3c3e31 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.109052 Aug 22 17:11:17.201504 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 25/37] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:11:17 2022] POST /compute/v2.1/flavors => generated 435 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:17.214884 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c859283f-839a-440f-a1ee-be0dc858c791 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b3c57acf7cf1461dad5130cf904dbe65"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:17.218071 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:17.218071 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:17.949660 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1178236691", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "availability_zone": "tempest-test_az-2048340960"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:17.973215 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:17.974177 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:17.974788 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:17.975669 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:17.976514 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:17.977101 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:18.103528 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] validate_networks() for None {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:11:18.164314 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c859283f-839a-440f-a1ee-be0dc858c791 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors/361890697/action" status: 200 len: 96 microversion: 2.1 time: 0.953927 Aug 22 17:11:18.165187 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 13/38] 10.222.0.96 () {60 vars in 1197 bytes} [Mon Aug 22 17:11:17 2022] POST /compute/v2.1/flavors/361890697/action => generated 96 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:11:18.171384 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-165c38ec-b02e-469d-a445-fb1ff0dd62e6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:18.172295 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-165c38ec-b02e-469d-a445-fb1ff0dd62e6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:18.179298 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-165c38ec-b02e-469d-a445-fb1ff0dd62e6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:18.180263 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-165c38ec-b02e-469d-a445-fb1ff0dd62e6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:18.180928 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-165c38ec-b02e-469d-a445-fb1ff0dd62e6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:18.181912 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-165c38ec-b02e-469d-a445-fb1ff0dd62e6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:18.182594 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-165c38ec-b02e-469d-a445-fb1ff0dd62e6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:18.183252 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-165c38ec-b02e-469d-a445-fb1ff0dd62e6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:18.293378 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-165c38ec-b02e-469d-a445-fb1ff0dd62e6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:18.306142 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-165c38ec-b02e-469d-a445-fb1ff0dd62e6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1302 microversion: 2.1 time: 0.139686 Aug 22 17:11:18.313864 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 14/39] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:18 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1302 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:18.316227 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-11c01975-6cfa-47bb-9417-1a78567091e5 tempest-FlavorsAccessNegativeTestJSON-876432830 tempest-FlavorsAccessNegativeTestJSON-876432830-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b3c57acf7cf1461dad5130cf904dbe65"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:18.327530 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:18.327530 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:18.330467 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-11c01975-6cfa-47bb-9417-1a78567091e5 tempest-FlavorsAccessNegativeTestJSON-876432830 tempest-FlavorsAccessNegativeTestJSON-876432830-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'bd0851f91ee94fc991ea1d46aae244e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c57acf7cf1461dad5130cf904dbe65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-11c01975-6cfa-47bb-9417-1a78567091e5 tempest-FlavorsAccessNegativeTestJSON-876432830 tempest-FlavorsAccessNegativeTestJSON-876432830-project] Request method failure captured: Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/flavors/361890697/action HTTP/1.1 Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 70 Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7isAUI5aoN-TUz-kC9BhVo106brEnkx2msuVujcQyNPRI64Wa1RCTLfCpJhTA6O-eKTYHfEqW5Usy41_l22GzPr1LuFYVtSoHkV5siWPEZimA2uT7_lM64pBAsQ0U9BWMNdMhnctGcFUZjidhR7mGlkcIK0_VD3-M7DP48B8AycVts Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: b3c57acf7cf1461dad5130cf904dbe65 Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-876432830 Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:11:18.334104 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:11:18.335295 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/b3c57acf7cf1461dad5130cf904dbe65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_b3c57acf7cf1461dad5130cf904dbe65", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/b3c57acf7cf1461dad5130cf904dbe65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/b3c57acf7cf1461dad5130cf904dbe65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:11:18.335295 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-876432830 Aug 22 17:11:18.335295 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: b3c57acf7cf1461dad5130cf904dbe65 Aug 22 17:11:18.335295 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-876432830 Aug 22 17:11:18.335295 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-FlavorsAccessNegativeTestJSON-876432830-project Aug 22 17:11:18.335295 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:11:18.335295 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:11:18.335295 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: bd0851f91ee94fc991ea1d46aae244e9 Aug 22 17:11:18.335295 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-876432830-project Aug 22 17:11:18.335295 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:11:18.335295 n-d-854030-1 devstack@n-api.service[123016]: {"removeTenantAccess": {"tenant": "b3c57acf7cf1461dad5130cf904dbe65"}} Aug 22 17:11:18.335295 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '361890697', 'body': {'removeTenantAccess': {'tenant': 'b3c57acf7cf1461dad5130cf904dbe65'}}} Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi context.can( Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:11:18.335894 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:11:18.336890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:11:18.336890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:11:18.336890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:11:18.336890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:11:18.336890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:11:18.336890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:11:18.336890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:11:18.336890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:11:18.336890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 22 17:11:18.336890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:18.336890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:18.336890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:18.336890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:18.336890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:18.336890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:18.336890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:11:18.336890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:11:18.336890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 22 17:11:18.336890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:18.338269 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-11c01975-6cfa-47bb-9417-1a78567091e5 tempest-FlavorsAccessNegativeTestJSON-876432830 tempest-FlavorsAccessNegativeTestJSON-876432830-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:11:18.338269 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-11c01975-6cfa-47bb-9417-1a78567091e5 tempest-FlavorsAccessNegativeTestJSON-876432830 tempest-FlavorsAccessNegativeTestJSON-876432830-project] 10.222.0.96 "POST /compute/v2.1/flavors/361890697/action" status: 403 len: 133 microversion: 2.1 time: 0.027611 Aug 22 17:11:18.338269 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 15/40] 10.222.0.96 () {60 vars in 1197 bytes} [Mon Aug 22 17:11:18 2022] POST /compute/v2.1/flavors/361890697/action => generated 133 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:11:18.357639 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1d47065c-5da4-4952-9606-e2fe9ec3bc52 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b3c57acf7cf1461dad5130cf904dbe65"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:18.485729 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:11:18.486306 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:11:18.486841 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:11:18.487486 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:11:18.488073 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:11:18.506352 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:18.506832 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:18.507258 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:18.508210 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:18.508851 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:18.509525 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:18.542514 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Getting quotas for project 1897a03823894ee8a981bd1e47cb5050. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:11:18.550699 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Getting quotas for user 64571f795f2748fcb657ca3f9031f35e and project 1897a03823894ee8a981bd1e47cb5050. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:11:18.573741 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Going to run 1 instances... {{(pid=123015) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:11:18.577043 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:11:18.777219 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ab7dabf2-ac24-4453-aa4e-bf70e33149a9 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.545851 Aug 22 17:11:18.778462 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 26/41] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:11:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:11:18.789747 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-949852c7-d94f-414f-8688-714baf88e5c5 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:18.790582 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-949852c7-d94f-414f-8688-714baf88e5c5 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:18.865540 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-949852c7-d94f-414f-8688-714baf88e5c5 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:18.875272 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-949852c7-d94f-414f-8688-714baf88e5c5 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1243 microversion: 2.1 time: 0.089210 Aug 22 17:11:18.876997 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 27/42] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:18 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1243 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:11:19.330015 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-82ae740a-160a-4f17-a9de-d1787c5d8b01 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:19.331475 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-82ae740a-160a-4f17-a9de-d1787c5d8b01 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:19.343954 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-82ae740a-160a-4f17-a9de-d1787c5d8b01 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:19.346158 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-82ae740a-160a-4f17-a9de-d1787c5d8b01 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:19.347724 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-82ae740a-160a-4f17-a9de-d1787c5d8b01 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:19.348862 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-82ae740a-160a-4f17-a9de-d1787c5d8b01 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:19.350521 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-82ae740a-160a-4f17-a9de-d1787c5d8b01 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:19.352225 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-82ae740a-160a-4f17-a9de-d1787c5d8b01 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:19.604305 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-82ae740a-160a-4f17-a9de-d1787c5d8b01 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:19.617358 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=11,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:19.623229 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1d47065c-5da4-4952-9606-e2fe9ec3bc52 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors/361890697/action" status: 200 len: 21 microversion: 2.1 time: 1.274715 Aug 22 17:11:19.623907 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 16/43] 10.222.0.96 () {60 vars in 1197 bytes} [Mon Aug 22 17:11:18 2022] POST /compute/v2.1/flavors/361890697/action => generated 21 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:11:19.638129 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-85655d10-9f86-4452-a91b-fb53969128ba tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:19.638980 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:19.638980 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:19.646162 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-82ae740a-160a-4f17-a9de-d1787c5d8b01 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1300 microversion: 2.1 time: 0.318397 Aug 22 17:11:19.660017 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 28/44] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:19 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1300 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:11:19.867671 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-85655d10-9f86-4452-a91b-fb53969128ba tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/361890697" status: 202 len: 0 microversion: 2.1 time: 0.237475 Aug 22 17:11:19.868209 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 17/45] 10.222.0.96 () {58 vars in 1158 bytes} [Mon Aug 22 17:11:19 2022] DELETE /compute/v2.1/flavors/361890697 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:11:19.883645 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7963c914-c19b-4d27-9981-13f9f2db9422 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:19.896957 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c0a080f4-f7ea-487e-9aaa-f89ab24a6f86 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:19.897818 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c0a080f4-f7ea-487e-9aaa-f89ab24a6f86 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:19.961071 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7963c914-c19b-4d27-9981-13f9f2db9422 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.084300 Aug 22 17:11:19.961963 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 29/46] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:11:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:19.982359 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d2184fa8-69e7-415b-9a4b-d630c4062c68 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2036372898", "id": 375804441, "os-flavor-access:is_public": "False"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:19.985612 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:19.985612 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:20.070922 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c0a080f4-f7ea-487e-9aaa-f89ab24a6f86 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:20.113443 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c0a080f4-f7ea-487e-9aaa-f89ab24a6f86 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1243 microversion: 2.1 time: 0.207667 Aug 22 17:11:20.126431 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 18/47] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:19 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1243 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:11:20.144081 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d2184fa8-69e7-415b-9a4b-d630c4062c68 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.167562 Aug 22 17:11:20.145267 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 30/48] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:11:19 2022] POST /compute/v2.1/flavors => generated 436 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:11:20.164623 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7a386931-7d5b-4180-946f-81866524e237 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "06bd35d741e140fc95bfcec8bc82e1c6"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:20.167703 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:20.167703 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:20.675693 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-45d6d428-7b54-4b89-9a75-a6c3885cb0eb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:20.677875 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-45d6d428-7b54-4b89-9a75-a6c3885cb0eb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:20.713894 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-45d6d428-7b54-4b89-9a75-a6c3885cb0eb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:20.715947 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-45d6d428-7b54-4b89-9a75-a6c3885cb0eb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:20.717384 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-45d6d428-7b54-4b89-9a75-a6c3885cb0eb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:20.723806 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-45d6d428-7b54-4b89-9a75-a6c3885cb0eb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:20.727102 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-45d6d428-7b54-4b89-9a75-a6c3885cb0eb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:20.733974 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-45d6d428-7b54-4b89-9a75-a6c3885cb0eb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:21.110445 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-7a386931-7d5b-4180-946f-81866524e237 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] HTTP exception thrown: Flavor access not found for 20 / 06bd35d741e140fc95bfcec8bc82e1c6 combination. Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7a386931-7d5b-4180-946f-81866524e237 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Request method failure captured: Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/flavors/375804441/action HTTP/1.1 Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 70 Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7ivnoT52uOBlfT44wfqh6LDjamFXyhXGWrorgWOgqLwSMIplLgm44VHpZSjkn_NApUOCNgDJLu0o10c5imAWGP6aDTwshtHkh6CnLg10q30zwE8tJQhjT7eGEVRMTqcpYLcPAt3nyTSHYNZ-_9H3Mm0UWWhyd_KileRi9u3HvW7mZQ Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: e76a5d11edcf4803ad4a59d9f61445e0 Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-315916960 Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:11:21.117471 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:11:21.118806 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e76a5d11edcf4803ad4a59d9f61445e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_e76a5d11edcf4803ad4a59d9f61445e0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e76a5d11edcf4803ad4a59d9f61445e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/e76a5d11edcf4803ad4a59d9f61445e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:11:21.118806 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-315916960 Aug 22 17:11:21.118806 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: e76a5d11edcf4803ad4a59d9f61445e0 Aug 22 17:11:21.118806 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-315916960 Aug 22 17:11:21.118806 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin Aug 22 17:11:21.118806 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:11:21.118806 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:11:21.118806 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 6f9eaea71ac84542be5b0a2c1fd5735e Aug 22 17:11:21.118806 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin Aug 22 17:11:21.118806 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:11:21.118806 n-d-854030-1 devstack@n-api.service[123016]: {"removeTenantAccess": {"tenant": "06bd35d741e140fc95bfcec8bc82e1c6"}} Aug 22 17:11:21.118806 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:11:21.119486 n-d-854030-1 devstack@n-api.service[123016]: exception: Flavor access not found for 20 / 06bd35d741e140fc95bfcec8bc82e1c6 combination. Aug 22 17:11:21.119486 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '375804441', 'body': {'removeTenantAccess': {'tenant': '06bd35d741e140fc95bfcec8bc82e1c6'}}} Aug 22 17:11:21.119486 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:11:21.119486 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:21.119486 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 22 17:11:21.119486 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 22 17:11:21.119486 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 22 17:11:21.119486 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 22 17:11:21.119486 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 22 17:11:21.119486 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 22 17:11:21.119486 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 22 17:11:21.119486 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 22 17:11:21.119486 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 22 17:11:21.119486 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 22 17:11:21.119486 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:11:21.119486 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:11:21.119486 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 22 17:11:21.119486 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 20 / 06bd35d741e140fc95bfcec8bc82e1c6 combination. Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 20 / 06bd35d741e140fc95bfcec8bc82e1c6 combination. Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:21.120373 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:21.121727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:21.121727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:21.121727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:11:21.121727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:11:21.121727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 20 / 06bd35d741e140fc95bfcec8bc82e1c6 combination. Aug 22 17:11:21.121727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:21.121727 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7a386931-7d5b-4180-946f-81866524e237 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Returning 404 to user: Flavor access not found for 20 / 06bd35d741e140fc95bfcec8bc82e1c6 combination. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:11:21.121727 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7a386931-7d5b-4180-946f-81866524e237 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors/375804441/action" status: 404 len: 124 microversion: 2.1 time: 0.958421 Aug 22 17:11:21.128691 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 19/49] 10.222.0.96 () {60 vars in 1197 bytes} [Mon Aug 22 17:11:20 2022] POST /compute/v2.1/flavors/375804441/action => generated 124 bytes in 968 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:11:21.135384 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c59c9513-d906-45dd-b273-9a3dbc7fed82 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:21.136182 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:21.136182 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:21.267576 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c59c9513-d906-45dd-b273-9a3dbc7fed82 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/375804441" status: 202 len: 0 microversion: 2.1 time: 0.137578 Aug 22 17:11:21.271257 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 20/50] 10.222.0.96 () {58 vars in 1158 bytes} [Mon Aug 22 17:11:21 2022] DELETE /compute/v2.1/flavors/375804441 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:11:21.277258 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-67cd2c77-1b71-4974-8c4a-1fe32acf3d95 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:21.277258 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-67cd2c77-1b71-4974-8c4a-1fe32acf3d95 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:21.291194 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-67cd2c77-1b71-4974-8c4a-1fe32acf3d95 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:21.291738 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-67cd2c77-1b71-4974-8c4a-1fe32acf3d95 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:21.292826 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-67cd2c77-1b71-4974-8c4a-1fe32acf3d95 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:21.294986 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-67cd2c77-1b71-4974-8c4a-1fe32acf3d95 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:21.295879 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-67cd2c77-1b71-4974-8c4a-1fe32acf3d95 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:21.296522 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-67cd2c77-1b71-4974-8c4a-1fe32acf3d95 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:21.706842 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-67cd2c77-1b71-4974-8c4a-1fe32acf3d95 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:21.706842 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-67cd2c77-1b71-4974-8c4a-1fe32acf3d95 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1243 microversion: 2.1 time: 0.265700 Aug 22 17:11:21.706842 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 21/51] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:21 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1243 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:21.706842 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-31c24f36-312f-4f44-b306-a4e979dcf477 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:21.707648 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-31c24f36-312f-4f44-b306-a4e979dcf477 tempest-FlavorsAccessNegativeTestJSON-315916960 tempest-FlavorsAccessNegativeTestJSON-315916960-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061583 Aug 22 17:11:21.707648 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 22/52] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:11:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:21.710131 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-45d6d428-7b54-4b89-9a75-a6c3885cb0eb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:21.718741 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-45d6d428-7b54-4b89-9a75-a6c3885cb0eb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1342 microversion: 2.1 time: 1.055320 Aug 22 17:11:21.721782 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 31/53] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:20 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1342 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:22.726820 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-81bb60ac-cf63-43ff-92f2-c6d5ae2f16f4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:22.726820 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-81bb60ac-cf63-43ff-92f2-c6d5ae2f16f4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:22.726820 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-81bb60ac-cf63-43ff-92f2-c6d5ae2f16f4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:22.726820 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-81bb60ac-cf63-43ff-92f2-c6d5ae2f16f4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:22.727674 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-81bb60ac-cf63-43ff-92f2-c6d5ae2f16f4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:22.727674 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-81bb60ac-cf63-43ff-92f2-c6d5ae2f16f4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:22.727674 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-81bb60ac-cf63-43ff-92f2-c6d5ae2f16f4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:22.727674 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-81bb60ac-cf63-43ff-92f2-c6d5ae2f16f4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:22.751253 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5645a8d8-b241-4cdb-93b1-bb99fd88b759 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:22.753814 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-5645a8d8-b241-4cdb-93b1-bb99fd88b759 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:22.765180 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5645a8d8-b241-4cdb-93b1-bb99fd88b759 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:22.767289 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5645a8d8-b241-4cdb-93b1-bb99fd88b759 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:22.768189 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5645a8d8-b241-4cdb-93b1-bb99fd88b759 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:22.771110 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5645a8d8-b241-4cdb-93b1-bb99fd88b759 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:22.772787 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5645a8d8-b241-4cdb-93b1-bb99fd88b759 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:22.776756 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5645a8d8-b241-4cdb-93b1-bb99fd88b759 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:23.005933 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-81bb60ac-cf63-43ff-92f2-c6d5ae2f16f4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:23.017467 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-81bb60ac-cf63-43ff-92f2-c6d5ae2f16f4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1235 microversion: 2.1 time: 0.307744 Aug 22 17:11:23.019209 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 23/54] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:22 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1235 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:23.111476 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-5645a8d8-b241-4cdb-93b1-bb99fd88b759 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:23.126721 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5645a8d8-b241-4cdb-93b1-bb99fd88b759 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1342 microversion: 2.1 time: 0.380670 Aug 22 17:11:23.130281 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 32/55] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:22 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1342 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:24.042435 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e6349ef5-18d3-4e79-a735-7cf2dc00b1ea tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:24.043899 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e6349ef5-18d3-4e79-a735-7cf2dc00b1ea tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:24.047032 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:24.061805 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e6349ef5-18d3-4e79-a735-7cf2dc00b1ea tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:24.062553 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e6349ef5-18d3-4e79-a735-7cf2dc00b1ea tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:24.063151 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e6349ef5-18d3-4e79-a735-7cf2dc00b1ea tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:24.064266 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e6349ef5-18d3-4e79-a735-7cf2dc00b1ea tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:24.064873 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e6349ef5-18d3-4e79-a735-7cf2dc00b1ea tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:24.065489 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e6349ef5-18d3-4e79-a735-7cf2dc00b1ea tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:24.155628 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1309be57-e687-499f-9355-2677b19fbdea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:24.156408 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-1309be57-e687-499f-9355-2677b19fbdea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:24.168724 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1309be57-e687-499f-9355-2677b19fbdea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:24.173821 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1309be57-e687-499f-9355-2677b19fbdea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:24.175234 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1309be57-e687-499f-9355-2677b19fbdea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:24.186532 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1309be57-e687-499f-9355-2677b19fbdea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:24.187650 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1309be57-e687-499f-9355-2677b19fbdea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:24.199261 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1309be57-e687-499f-9355-2677b19fbdea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:24.347786 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e6349ef5-18d3-4e79-a735-7cf2dc00b1ea tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:24.363118 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e6349ef5-18d3-4e79-a735-7cf2dc00b1ea tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1291 microversion: 2.1 time: 0.322038 Aug 22 17:11:24.363868 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 24/56] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:24 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1291 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:25.153363 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1309be57-e687-499f-9355-2677b19fbdea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:25.170836 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1309be57-e687-499f-9355-2677b19fbdea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1342 microversion: 2.1 time: 1.021254 Aug 22 17:11:25.172370 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 33/57] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:24 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1342 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:25.438809 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-a273f511-8d0d-4138-89ce-770ad33bea2f req-3db59b56-8e1c-4f8b-98d5-9615bf506cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337beedf-68a6-4cf9-b6f3-7f451f1cd496", "tag": "7d236e6a-9b38-4578-89a7-d101675b8fc0"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:25.464521 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-a273f511-8d0d-4138-89ce-770ad33bea2f req-3db59b56-8e1c-4f8b-98d5-9615bf506cf8 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:25.464521 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-a273f511-8d0d-4138-89ce-770ad33bea2f req-3db59b56-8e1c-4f8b-98d5-9615bf506cf8 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:25.464521 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-a273f511-8d0d-4138-89ce-770ad33bea2f req-3db59b56-8e1c-4f8b-98d5-9615bf506cf8 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:25.553611 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-a273f511-8d0d-4138-89ce-770ad33bea2f req-3db59b56-8e1c-4f8b-98d5-9615bf506cf8 service nova] Creating event network-changed:7d236e6a-9b38-4578-89a7-d101675b8fc0 for instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 on n-h2-854030-1 Aug 22 17:11:25.567139 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-a273f511-8d0d-4138-89ce-770ad33bea2f req-3db59b56-8e1c-4f8b-98d5-9615bf506cf8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=123016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 22 17:11:25.567139 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-a273f511-8d0d-4138-89ce-770ad33bea2f req-3db59b56-8e1c-4f8b-98d5-9615bf506cf8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 22 17:11:25.567139 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e2d361b3-e4e2-4345-ba3b-3c05a7985fa7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:25.567139 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e2d361b3-e4e2-4345-ba3b-3c05a7985fa7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:25.567139 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e2d361b3-e4e2-4345-ba3b-3c05a7985fa7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:25.567640 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e2d361b3-e4e2-4345-ba3b-3c05a7985fa7 None None] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:25.567640 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e2d361b3-e4e2-4345-ba3b-3c05a7985fa7 None None] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:25.567640 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e2d361b3-e4e2-4345-ba3b-3c05a7985fa7 None None] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:25.575452 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.compute.rpcapi [None req-e2d361b3-e4e2-4345-ba3b-3c05a7985fa7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 22 17:11:25.577207 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e2d361b3-e4e2-4345-ba3b-3c05a7985fa7 None None] Releasing lock "compute-rpcapi-router" {{(pid=123016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 22 17:11:25.602470 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e2d361b3-e4e2-4345-ba3b-3c05a7985fa7 None None] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.803295 Aug 22 17:11:25.603443 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 25/58] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:25.610485 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-107d827c-97e2-428d-bca1-7f22b1f308f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:25.611462 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-107d827c-97e2-428d-bca1-7f22b1f308f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:25.629932 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-107d827c-97e2-428d-bca1-7f22b1f308f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:25.635638 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-107d827c-97e2-428d-bca1-7f22b1f308f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:25.635638 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-107d827c-97e2-428d-bca1-7f22b1f308f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:25.635638 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-107d827c-97e2-428d-bca1-7f22b1f308f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:25.635638 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-107d827c-97e2-428d-bca1-7f22b1f308f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:25.636002 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-107d827c-97e2-428d-bca1-7f22b1f308f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:25.779988 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-107d827c-97e2-428d-bca1-7f22b1f308f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:25.791445 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-107d827c-97e2-428d-bca1-7f22b1f308f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1297 microversion: 2.1 time: 0.186023 Aug 22 17:11:25.793424 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 26/59] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:25 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1297 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:26.194385 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-53c97d8f-b473-4b2a-9a01-7afa0c2cca9b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:26.195854 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-53c97d8f-b473-4b2a-9a01-7afa0c2cca9b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:26.207764 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53c97d8f-b473-4b2a-9a01-7afa0c2cca9b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:26.209744 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53c97d8f-b473-4b2a-9a01-7afa0c2cca9b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:26.210425 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53c97d8f-b473-4b2a-9a01-7afa0c2cca9b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:26.212028 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53c97d8f-b473-4b2a-9a01-7afa0c2cca9b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:26.214267 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53c97d8f-b473-4b2a-9a01-7afa0c2cca9b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:26.215733 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53c97d8f-b473-4b2a-9a01-7afa0c2cca9b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:26.428310 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d70a9906-02e9-4a7f-b1b8-91f5fbfbacde tempest-AZAdminNegativeTestJSON-2131757412 tempest-AZAdminNegativeTestJSON-2131757412-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:26.432224 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:26.432224 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:26.433993 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d70a9906-02e9-4a7f-b1b8-91f5fbfbacde tempest-AZAdminNegativeTestJSON-2131757412 tempest-AZAdminNegativeTestJSON-2131757412-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'a431de3e34a24d00a3bb67b7dd6f50b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef200c9ddd841a6a2e6bc47e02fba0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d70a9906-02e9-4a7f-b1b8-91f5fbfbacde tempest-AZAdminNegativeTestJSON-2131757412 tempest-AZAdminNegativeTestJSON-2131757412-project] Request method failure captured: Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7i5IgAciASdhuQ8P55dg-lPBIjCUnNl0X_XSgVZyJ4oLahgV-eHyLHNe6T1wf2UiUjr6mfXtIq9XejP1nBbNTmIby6p9LUI6ImDgBb3gLnWXSdUIcBeOpKNJLM1ux0-Fpkbvh2RhtGnUufgq31LjPNB_zHLTYLm3aYvC_P53lV_F40 Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 9ef200c9ddd841a6a2e6bc47e02fba0f Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-AZAdminNegativeTestJSON-2131757412 Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:11:26.439265 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:11:26.440609 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ef200c9ddd841a6a2e6bc47e02fba0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9ef200c9ddd841a6a2e6bc47e02fba0f", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ef200c9ddd841a6a2e6bc47e02fba0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9ef200c9ddd841a6a2e6bc47e02fba0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:11:26.440609 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-AZAdminNegativeTestJSON-2131757412 Aug 22 17:11:26.440609 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 9ef200c9ddd841a6a2e6bc47e02fba0f Aug 22 17:11:26.440609 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-2131757412 Aug 22 17:11:26.440609 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-AZAdminNegativeTestJSON-2131757412-project Aug 22 17:11:26.440609 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:11:26.440609 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:11:26.440609 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: a431de3e34a24d00a3bb67b7dd6f50b0 Aug 22 17:11:26.440609 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-AZAdminNegativeTestJSON-2131757412-project Aug 22 17:11:26.440609 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:11:26.440609 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 22 17:11:26.440609 n-d-854030-1 devstack@n-api.service[123015]: action_args: {} Aug 22 17:11:26.447943 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:11:26.447943 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:26.447943 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:26.447943 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:26.447943 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:11:26.447943 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:11:26.447943 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:26.447943 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:26.447943 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 22 17:11:26.447943 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 22 17:11:26.447943 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:11:26.447943 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:11:26.447943 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:11:26.447943 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:11:26.447943 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:11:26.447943 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:11:26.447943 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:11:26.447943 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:11:26.447943 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:11:26.449261 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:11:26.449261 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:11:26.449261 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:11:26.449261 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:11:26.449261 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:11:26.449261 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 22 17:11:26.449261 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:26.449261 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:26.449261 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:26.449261 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:26.449261 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:26.449261 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:26.449261 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:11:26.449261 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:11:26.449261 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 22 17:11:26.449261 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:26.449261 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d70a9906-02e9-4a7f-b1b8-91f5fbfbacde tempest-AZAdminNegativeTestJSON-2131757412 tempest-AZAdminNegativeTestJSON-2131757412-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:11:26.452582 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d70a9906-02e9-4a7f-b1b8-91f5fbfbacde tempest-AZAdminNegativeTestJSON-2131757412 tempest-AZAdminNegativeTestJSON-2131757412-project] 10.222.0.96 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.184388 Aug 22 17:11:26.452582 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 34/60] 10.222.0.96 () {58 vars in 1185 bytes} [Mon Aug 22 17:11:25 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1189 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:11:26.642621 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-53c97d8f-b473-4b2a-9a01-7afa0c2cca9b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:26.660345 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-53c97d8f-b473-4b2a-9a01-7afa0c2cca9b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1342 microversion: 2.1 time: 0.470025 Aug 22 17:11:26.665404 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 27/61] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:26 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1342 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:26.816697 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-bef4847f-34b0-4228-b049-5960781a69f8 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:26.817341 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-bef4847f-34b0-4228-b049-5960781a69f8 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:26.828565 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bef4847f-34b0-4228-b049-5960781a69f8 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:26.829565 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bef4847f-34b0-4228-b049-5960781a69f8 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:26.830466 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bef4847f-34b0-4228-b049-5960781a69f8 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:26.831707 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bef4847f-34b0-4228-b049-5960781a69f8 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:26.833048 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bef4847f-34b0-4228-b049-5960781a69f8 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:26.834894 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bef4847f-34b0-4228-b049-5960781a69f8 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:27.010622 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-bef4847f-34b0-4228-b049-5960781a69f8 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:27.026707 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-bef4847f-34b0-4228-b049-5960781a69f8 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1297 microversion: 2.1 time: 0.213836 Aug 22 17:11:27.031944 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 35/62] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:26 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1297 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:27.690565 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-360f7b67-e13d-4fbe-9c52-fb28028283aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:27.691170 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-360f7b67-e13d-4fbe-9c52-fb28028283aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:27.705216 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-360f7b67-e13d-4fbe-9c52-fb28028283aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:27.709193 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-360f7b67-e13d-4fbe-9c52-fb28028283aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:27.709867 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-360f7b67-e13d-4fbe-9c52-fb28028283aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:27.710810 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-360f7b67-e13d-4fbe-9c52-fb28028283aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:27.711509 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-360f7b67-e13d-4fbe-9c52-fb28028283aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:27.712258 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-360f7b67-e13d-4fbe-9c52-fb28028283aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:28.052894 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-58baad43-140e-4626-aa35-12a0f762a6b2 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:28.053603 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-58baad43-140e-4626-aa35-12a0f762a6b2 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:28.063802 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-58baad43-140e-4626-aa35-12a0f762a6b2 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:28.064579 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-58baad43-140e-4626-aa35-12a0f762a6b2 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:28.066277 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-58baad43-140e-4626-aa35-12a0f762a6b2 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:28.067212 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-58baad43-140e-4626-aa35-12a0f762a6b2 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:28.069175 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-58baad43-140e-4626-aa35-12a0f762a6b2 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:28.070081 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-58baad43-140e-4626-aa35-12a0f762a6b2 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:28.162734 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-360f7b67-e13d-4fbe-9c52-fb28028283aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:28.182811 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-360f7b67-e13d-4fbe-9c52-fb28028283aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1342 microversion: 2.1 time: 0.496966 Aug 22 17:11:28.185109 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 28/63] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:27 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1342 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:28.430887 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-58baad43-140e-4626-aa35-12a0f762a6b2 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:28.444698 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-58baad43-140e-4626-aa35-12a0f762a6b2 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1297 microversion: 2.1 time: 0.396007 Aug 22 17:11:28.462942 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 36/64] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:28 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1297 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:11:28.853389 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d9b3cbfd-597d-4b95-9de1-ce0f5c3ecf5f tempest-FlavorsV261TestJSON-2042127863 tempest-FlavorsV261TestJSON-2042127863-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-89804035", "id": 738613620, "os-flavor-access:is_public": "True"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:28.856462 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:28.856462 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:28.976721 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d9b3cbfd-597d-4b95-9de1-ce0f5c3ecf5f tempest-FlavorsV261TestJSON-2042127863 tempest-FlavorsV261TestJSON-2042127863-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 463 microversion: 2.61 time: 0.753624 Aug 22 17:11:28.980565 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 29/65] 10.222.0.96 () {62 vars in 1188 bytes} [Mon Aug 22 17:11:28 2022] POST /compute/v2.1/flavors => generated 463 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:11:28.993607 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=10 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:28.994901 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=12 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:29.207925 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-21cfc162-9890-465f-8fef-d52cf65e1add tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:29.209479 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-21cfc162-9890-465f-8fef-d52cf65e1add tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:29.222453 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21cfc162-9890-465f-8fef-d52cf65e1add tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:29.223058 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21cfc162-9890-465f-8fef-d52cf65e1add tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:29.223868 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21cfc162-9890-465f-8fef-d52cf65e1add tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:29.228363 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21cfc162-9890-465f-8fef-d52cf65e1add tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:29.228363 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21cfc162-9890-465f-8fef-d52cf65e1add tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:29.228363 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21cfc162-9890-465f-8fef-d52cf65e1add tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:29.546921 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-21cfc162-9890-465f-8fef-d52cf65e1add tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:29.562458 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-21cfc162-9890-465f-8fef-d52cf65e1add tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1342 microversion: 2.1 time: 0.360219 Aug 22 17:11:29.578258 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 30/66] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:29 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1342 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:11:29.593987 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e8810029-634c-41a1-99dc-5e7ec0110c6e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:29.595602 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e8810029-634c-41a1-99dc-5e7ec0110c6e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:29.610459 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e8810029-634c-41a1-99dc-5e7ec0110c6e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:29.611626 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e8810029-634c-41a1-99dc-5e7ec0110c6e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:29.612562 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e8810029-634c-41a1-99dc-5e7ec0110c6e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:29.613867 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e8810029-634c-41a1-99dc-5e7ec0110c6e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:29.614594 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e8810029-634c-41a1-99dc-5e7ec0110c6e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:29.616406 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e8810029-634c-41a1-99dc-5e7ec0110c6e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:29.804419 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5bfe9784-12d5-4bf9-b0b5-6003dd84d8a7 tempest-FlavorsV261TestJSON-1527431120 tempest-FlavorsV261TestJSON-1527431120-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:29.829687 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5bfe9784-12d5-4bf9-b0b5-6003dd84d8a7 tempest-FlavorsV261TestJSON-1527431120 tempest-FlavorsV261TestJSON-1527431120-project] 10.222.0.96 "GET /compute/v2.1/flavors/738613620" status: 200 len: 463 microversion: 2.61 time: 0.841866 Aug 22 17:11:29.832492 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 37/67] 10.222.0.96 () {60 vars in 1196 bytes} [Mon Aug 22 17:11:28 2022] GET /compute/v2.1/flavors/738613620 => generated 463 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:11:29.968243 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b2116dce-e8d2-4673-9305-837a2ae49a37 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-917778403", "ram": 512, "vcpus": 1, "disk": 10, "id": 141189205, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:29.976077 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:29.976077 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:30.088202 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=8 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:30.104487 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e8810029-634c-41a1-99dc-5e7ec0110c6e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:30.136294 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e8810029-634c-41a1-99dc-5e7ec0110c6e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1339 microversion: 2.1 time: 0.542026 Aug 22 17:11:30.136294 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 31/68] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:29 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1339 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:30.136294 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c1bbf6c3-95e1-4b15-968f-43ef682ae89a tempest-FlavorsV261TestJSON-2042127863 tempest-FlavorsV261TestJSON-2042127863-project-admin] Action: 'update', calling method: .version_select at 0x7f800c57ad30>, body: {"flavor": {"description": "new"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:30.138248 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b2116dce-e8d2-4673-9305-837a2ae49a37 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.304352 Aug 22 17:11:30.148010 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 38/69] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:11:29 2022] POST /compute/v2.1/flavors => generated 412 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:30.177334 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:30.177334 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:30.318985 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c1bbf6c3-95e1-4b15-968f-43ef682ae89a tempest-FlavorsV261TestJSON-2042127863 tempest-FlavorsV261TestJSON-2042127863-project-admin] 10.222.0.96 "PUT /compute/v2.1/flavors/738613620" status: 200 len: 464 microversion: 2.61 time: 0.194300 Aug 22 17:11:30.321431 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 32/70] 10.222.0.96 () {62 vars in 1216 bytes} [Mon Aug 22 17:11:30 2022] PUT /compute/v2.1/flavors/738613620 => generated 464 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:11:30.339182 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4085df5d-c663-4d00-903c-a5bb923fd67a tempest-FlavorsV261TestJSON-1527431120 tempest-FlavorsV261TestJSON-1527431120-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:30.386603 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4085df5d-c663-4d00-903c-a5bb923fd67a tempest-FlavorsV261TestJSON-1527431120 tempest-FlavorsV261TestJSON-1527431120-project] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 6687 microversion: 2.61 time: 0.056523 Aug 22 17:11:30.388552 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 33/71] 10.222.0.96 () {60 vars in 1187 bytes} [Mon Aug 22 17:11:30 2022] GET /compute/v2.1/flavors/detail => generated 6687 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:11:30.388714 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c2916899-fe36-4423-bc8a-2a5cf78f3d50 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:30.403103 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-c2916899-fe36-4423-bc8a-2a5cf78f3d50 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] HTTP exception thrown: Flavor 141189205 has no extra specs with key hw:cpu_thread_policy. Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c2916899-fe36-4423-bc8a-2a5cf78f3d50 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] Request method failure captured: Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/flavors/141189205/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7i-HulnszCMrpjy1pvj2DtfVzMeT3HDlbOarLpngLSwELFm8oKSNpL8tDG8AXbeIx6XikYT1ayorNQKBxHiO-t9S8MffDxXna9ehNq2PNvFmBUC6RZO0sdG7u3mCouC-GAIZZ4o0lRdUs9yEWDGNvFPIXJiVCxEgieKSZVyNEUKu_g Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: c9de8f16a72b4cf4b7d231894ce23287 Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:11:30.411314 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:11:30.412614 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c9de8f16a72b4cf4b7d231894ce23287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_c9de8f16a72b4cf4b7d231894ce23287", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c9de8f16a72b4cf4b7d231894ce23287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/c9de8f16a72b4cf4b7d231894ce23287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:11:30.412614 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 Aug 22 17:11:30.412614 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: c9de8f16a72b4cf4b7d231894ce23287 Aug 22 17:11:30.412614 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 Aug 22 17:11:30.412614 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project Aug 22 17:11:30.412614 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:11:30.412614 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:11:30.412614 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 57e1470c1fb144bd9b594c5fa13551c5 Aug 22 17:11:30.412614 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project Aug 22 17:11:30.412614 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:11:30.412614 n-d-854030-1 devstack@n-api.service[123015]: exception: Flavor 141189205 has no extra specs with key hw:cpu_thread_policy. Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'flavor_id': '141189205', 'id': 'hw:cpu_thread_policy'} Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 141189205 has no extra specs with key hw:cpu_thread_policy. Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:30.413306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:30.414446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:30.414446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:30.414446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:30.414446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:11:30.414446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:11:30.414446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 141189205 has no extra specs with key hw:cpu_thread_policy. Aug 22 17:11:30.414446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:30.416442 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c2916899-fe36-4423-bc8a-2a5cf78f3d50 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] Returning 404 to user: Flavor 141189205 has no extra specs with key hw:cpu_thread_policy. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:11:30.418603 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c2916899-fe36-4423-bc8a-2a5cf78f3d50 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] 10.222.0.96 "GET /compute/v2.1/flavors/141189205/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.268208 Aug 22 17:11:30.425967 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 39/72] 10.222.0.96 () {58 vars in 1263 bytes} [Mon Aug 22 17:11:30 2022] GET /compute/v2.1/flavors/141189205/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 277 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:11:30.431985 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f5d145e3-41b6-4201-a17e-90add8460abf tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:30.433451 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-313d09e6-734a-488b-9f87-0c81431775b1 tempest-FlavorsV261TestJSON-1527431120 tempest-FlavorsV261TestJSON-1527431120-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:30.435874 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:30.435874 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:30.437039 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f5d145e3-41b6-4201-a17e-90add8460abf tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '57e1470c1fb144bd9b594c5fa13551c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9de8f16a72b4cf4b7d231894ce23287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f5d145e3-41b6-4201-a17e-90add8460abf tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] Request method failure captured: Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/flavors/141189205/os-extra_specs HTTP/1.1 Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 66 Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7i-HulnszCMrpjy1pvj2DtfVzMeT3HDlbOarLpngLSwELFm8oKSNpL8tDG8AXbeIx6XikYT1ayorNQKBxHiO-t9S8MffDxXna9ehNq2PNvFmBUC6RZO0sdG7u3mCouC-GAIZZ4o0lRdUs9yEWDGNvFPIXJiVCxEgieKSZVyNEUKu_g Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: c9de8f16a72b4cf4b7d231894ce23287 Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:11:30.439053 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:11:30.440172 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c9de8f16a72b4cf4b7d231894ce23287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_c9de8f16a72b4cf4b7d231894ce23287", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c9de8f16a72b4cf4b7d231894ce23287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/c9de8f16a72b4cf4b7d231894ce23287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:11:30.440172 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 Aug 22 17:11:30.440172 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: c9de8f16a72b4cf4b7d231894ce23287 Aug 22 17:11:30.440172 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 Aug 22 17:11:30.440172 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project Aug 22 17:11:30.440172 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:11:30.440172 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:11:30.440172 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 57e1470c1fb144bd9b594c5fa13551c5 Aug 22 17:11:30.440172 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project Aug 22 17:11:30.440172 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:11:30.440172 n-d-854030-1 devstack@n-api.service[123015]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 22 17:11:30.440172 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:11:30.441517 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 22 17:11:30.441517 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'flavor_id': '141189205', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 22 17:11:30.441517 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:11:30.441517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:30.441517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:30.441517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:30.441517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:11:30.441517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:11:30.441517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:30.441517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:30.441517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:30.441517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:30.441517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 22 17:11:30.441517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 22 17:11:30.441517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:11:30.441517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:11:30.441517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:11:30.441517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:11:30.441517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 22 17:11:30.442545 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:30.443543 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f5d145e3-41b6-4201-a17e-90add8460abf tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:11:30.443543 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f5d145e3-41b6-4201-a17e-90add8460abf tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] 10.222.0.96 "POST /compute/v2.1/flavors/141189205/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.013039 Aug 22 17:11:30.443543 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 40/73] 10.222.0.96 () {60 vars in 1221 bytes} [Mon Aug 22 17:11:30 2022] POST /compute/v2.1/flavors/141189205/os-extra_specs => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:11:30.454602 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9c81b160-1629-4f2c-a653-5835e2bfb428 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:30.504304 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-313d09e6-734a-488b-9f87-0c81431775b1 tempest-FlavorsV261TestJSON-1527431120 tempest-FlavorsV261TestJSON-1527431120-project] 10.222.0.96 "GET /compute/v2.1/flavors" status: 200 len: 3401 microversion: 2.61 time: 0.090004 Aug 22 17:11:30.531048 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 34/74] 10.222.0.96 () {60 vars in 1166 bytes} [Mon Aug 22 17:11:30 2022] GET /compute/v2.1/flavors => generated 3401 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:11:30.540405 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e4b60889-3e46-4e17-a0f7-ff18edda0d49 tempest-FlavorsV261TestJSON-2042127863 tempest-FlavorsV261TestJSON-2042127863-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:30.561917 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:30.561917 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:30.688536 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9c81b160-1629-4f2c-a653-5835e2bfb428 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors/141189205/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.236753 Aug 22 17:11:30.693573 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 41/75] 10.222.0.96 () {60 vars in 1221 bytes} [Mon Aug 22 17:11:30 2022] POST /compute/v2.1/flavors/141189205/os-extra_specs => generated 66 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:11:30.709154 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e4b60889-3e46-4e17-a0f7-ff18edda0d49 tempest-FlavorsV261TestJSON-2042127863 tempest-FlavorsV261TestJSON-2042127863-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/738613620" status: 202 len: 0 microversion: 2.61 time: 0.176513 Aug 22 17:11:30.710161 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 35/76] 10.222.0.96 () {60 vars in 1199 bytes} [Mon Aug 22 17:11:30 2022] DELETE /compute/v2.1/flavors/738613620 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:11:30.721481 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-58a92838-240d-42a8-8629-5751fca28c59 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:30.725448 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:30.725448 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:30.728549 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1cd1b170-2806-4484-bde7-7cb11b28ef7c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:30.730114 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-58a92838-240d-42a8-8629-5751fca28c59 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '57e1470c1fb144bd9b594c5fa13551c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9de8f16a72b4cf4b7d231894ce23287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:30.740309 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-1cd1b170-2806-4484-bde7-7cb11b28ef7c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-58a92838-240d-42a8-8629-5751fca28c59 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] Request method failure captured: Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: request: DELETE /compute/v2.1/flavors/141189205/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7i-HulnszCMrpjy1pvj2DtfVzMeT3HDlbOarLpngLSwELFm8oKSNpL8tDG8AXbeIx6XikYT1ayorNQKBxHiO-t9S8MffDxXna9ehNq2PNvFmBUC6RZO0sdG7u3mCouC-GAIZZ4o0lRdUs9yEWDGNvFPIXJiVCxEgieKSZVyNEUKu_g Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: c9de8f16a72b4cf4b7d231894ce23287 Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:11:30.743320 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:11:30.744857 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c9de8f16a72b4cf4b7d231894ce23287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_c9de8f16a72b4cf4b7d231894ce23287", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c9de8f16a72b4cf4b7d231894ce23287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/c9de8f16a72b4cf4b7d231894ce23287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:11:30.744857 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 Aug 22 17:11:30.744857 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: c9de8f16a72b4cf4b7d231894ce23287 Aug 22 17:11:30.744857 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 Aug 22 17:11:30.744857 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project Aug 22 17:11:30.744857 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:11:30.744857 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:11:30.744857 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 57e1470c1fb144bd9b594c5fa13551c5 Aug 22 17:11:30.744857 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project Aug 22 17:11:30.744857 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:11:30.744857 n-d-854030-1 devstack@n-api.service[123016]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'flavor_id': '141189205', 'id': 'hw:numa_nodes'} Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:11:30.747917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:11:30.750127 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:11:30.750127 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:11:30.750127 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:11:30.750127 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:11:30.750127 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:11:30.750127 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 22 17:11:30.750127 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:30.750127 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:30.750127 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:30.750127 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:30.750127 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:30.750127 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:30.750127 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:11:30.750127 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:11:30.750127 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 22 17:11:30.750127 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:30.754358 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-58a92838-240d-42a8-8629-5751fca28c59 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:11:30.761273 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-58a92838-240d-42a8-8629-5751fca28c59 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] 10.222.0.96 "DELETE /compute/v2.1/flavors/141189205/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.047593 Aug 22 17:11:30.765278 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 36/77] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:11:30 2022] DELETE /compute/v2.1/flavors/141189205/os-extra_specs/hw:numa_nodes => generated 124 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:11:30.781046 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1cd1b170-2806-4484-bde7-7cb11b28ef7c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:30.785283 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1cd1b170-2806-4484-bde7-7cb11b28ef7c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:30.788717 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1cd1b170-2806-4484-bde7-7cb11b28ef7c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:30.790214 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d2f96135-b60b-4591-b4dd-2b2c01c7b94b tempest-FlavorsV261TestJSON-2042127863 tempest-FlavorsV261TestJSON-2042127863-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:30.790784 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1cd1b170-2806-4484-bde7-7cb11b28ef7c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:30.791269 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1cd1b170-2806-4484-bde7-7cb11b28ef7c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:30.791700 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1cd1b170-2806-4484-bde7-7cb11b28ef7c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:30.877041 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d2f96135-b60b-4591-b4dd-2b2c01c7b94b tempest-FlavorsV261TestJSON-2042127863 tempest-FlavorsV261TestJSON-2042127863-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 6280 microversion: 2.61 time: 0.108490 Aug 22 17:11:30.883823 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 37/78] 10.222.0.96 () {60 vars in 1187 bytes} [Mon Aug 22 17:11:30 2022] GET /compute/v2.1/flavors/detail => generated 6280 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:11:30.908190 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-419bfb17-9aa4-4347-abbd-09cc418d937a tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:30.916988 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:30.916988 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:30.974064 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-419bfb17-9aa4-4347-abbd-09cc418d937a tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors/141189205/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.087975 Aug 22 17:11:30.977202 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 38/79] 10.222.0.96 () {60 vars in 1221 bytes} [Mon Aug 22 17:11:30 2022] POST /compute/v2.1/flavors/141189205/os-extra_specs => generated 66 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:11:31.008977 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-63d6d18c-c138-480b-b447-cfcb625d107f tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:31.013768 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:31.013768 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:31.015191 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-63d6d18c-c138-480b-b447-cfcb625d107f tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '57e1470c1fb144bd9b594c5fa13551c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9de8f16a72b4cf4b7d231894ce23287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-63d6d18c-c138-480b-b447-cfcb625d107f tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] Request method failure captured: Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: request: PUT /compute/v2.1/flavors/141189205/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 22 Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7i-HulnszCMrpjy1pvj2DtfVzMeT3HDlbOarLpngLSwELFm8oKSNpL8tDG8AXbeIx6XikYT1ayorNQKBxHiO-t9S8MffDxXna9ehNq2PNvFmBUC6RZO0sdG7u3mCouC-GAIZZ4o0lRdUs9yEWDGNvFPIXJiVCxEgieKSZVyNEUKu_g Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: c9de8f16a72b4cf4b7d231894ce23287 Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:11:31.017163 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:11:31.018619 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c9de8f16a72b4cf4b7d231894ce23287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_c9de8f16a72b4cf4b7d231894ce23287", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c9de8f16a72b4cf4b7d231894ce23287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/c9de8f16a72b4cf4b7d231894ce23287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:11:31.018619 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 Aug 22 17:11:31.018619 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: c9de8f16a72b4cf4b7d231894ce23287 Aug 22 17:11:31.018619 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 Aug 22 17:11:31.018619 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project Aug 22 17:11:31.018619 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:11:31.018619 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:11:31.018619 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 57e1470c1fb144bd9b594c5fa13551c5 Aug 22 17:11:31.018619 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project Aug 22 17:11:31.018619 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:11:31.018619 n-d-854030-1 devstack@n-api.service[123016]: {"hw:numa_nodes": "1"} Aug 22 17:11:31.018619 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:11:31.018619 n-d-854030-1 devstack@n-api.service[123016]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 22 17:11:31.019438 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'flavor_id': '141189205', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 22 17:11:31.019438 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:11:31.019438 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:31.019438 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:31.019438 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:31.019438 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:11:31.019438 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:11:31.019438 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:31.019438 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:31.019438 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:31.019438 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:31.019438 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 22 17:11:31.019438 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 22 17:11:31.019438 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:11:31.019438 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:11:31.019438 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:11:31.019438 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:11:31.019438 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:11:31.019438 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:11:31.020616 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:11:31.020616 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:11:31.020616 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:11:31.020616 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:11:31.020616 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:11:31.020616 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:11:31.020616 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:11:31.020616 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:11:31.020616 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 22 17:11:31.020616 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:31.020616 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:31.020616 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:31.020616 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:31.020616 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:31.020616 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:31.020616 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:11:31.020616 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:11:31.020616 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 22 17:11:31.020616 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:31.025062 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-63d6d18c-c138-480b-b447-cfcb625d107f tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:11:31.027412 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-63d6d18c-c138-480b-b447-cfcb625d107f tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164 tempest-FlavorsExtraSpecsNegativeTestJSON-1221970164-project] 10.222.0.96 "PUT /compute/v2.1/flavors/141189205/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.043815 Aug 22 17:11:31.028607 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 39/80] 10.222.0.96 () {60 vars in 1262 bytes} [Mon Aug 22 17:11:30 2022] PUT /compute/v2.1/flavors/141189205/os-extra_specs/hw:numa_nodes => generated 124 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:11:31.038946 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c30dc047-5d7a-4aa5-adc5-b05c8ec72f3e tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:31.051486 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-c30dc047-5d7a-4aa5-adc5-b05c8ec72f3e tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] HTTP exception thrown: Flavor 141189205 has no extra specs with key hw:cpu_thread_policy. Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c30dc047-5d7a-4aa5-adc5-b05c8ec72f3e tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] Request method failure captured: Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: request: DELETE /compute/v2.1/flavors/141189205/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7jBBurZ539rb4HqV2AXHDPxcoA4NF6k0qZzJQ-alres483TfgwjO08WM11c45md-FEkRYWnqWNsi2701YD9NMLNis4-rNnowEtNKjDvf1RbMmtHWc_tujIgJ0I5ztl1PjTT0P6mEIT7wX2nT9fWAZiHNzmtV3rBanERj9YEvexw6Fc Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: aa5c9520bc6d4dda851fd705213495f9 Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:11:31.053533 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:11:31.054692 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/aa5c9520bc6d4dda851fd705213495f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_aa5c9520bc6d4dda851fd705213495f9", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/aa5c9520bc6d4dda851fd705213495f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/aa5c9520bc6d4dda851fd705213495f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:11:31.054692 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 Aug 22 17:11:31.054692 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: aa5c9520bc6d4dda851fd705213495f9 Aug 22 17:11:31.054692 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 Aug 22 17:11:31.054692 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin Aug 22 17:11:31.054692 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:11:31.054692 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:11:31.054692 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 08799a9a12034b898906ee7946002ee8 Aug 22 17:11:31.054692 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin Aug 22 17:11:31.054692 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:11:31.054692 n-d-854030-1 devstack@n-api.service[123016]: exception: Flavor 141189205 has no extra specs with key hw:cpu_thread_policy. Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'flavor_id': '141189205', 'id': 'hw:cpu_thread_policy'} Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 141189205 has no extra specs with key hw:cpu_thread_policy. Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:31.055279 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:31.056391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:31.056391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:31.056391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:31.056391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:11:31.056391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:11:31.056391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 141189205 has no extra specs with key hw:cpu_thread_policy. Aug 22 17:11:31.056391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:31.058765 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c30dc047-5d7a-4aa5-adc5-b05c8ec72f3e tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] Returning 404 to user: Flavor 141189205 has no extra specs with key hw:cpu_thread_policy. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:11:31.061122 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c30dc047-5d7a-4aa5-adc5-b05c8ec72f3e tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/141189205/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.025512 Aug 22 17:11:31.061945 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 40/81] 10.222.0.96 () {58 vars in 1266 bytes} [Mon Aug 22 17:11:31 2022] DELETE /compute/v2.1/flavors/141189205/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:11:31.078377 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-98ab8497-eb03-4e1e-9560-45ab4f1c9b55 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:31.083530 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-98ab8497-eb03-4e1e-9560-45ab4f1c9b55 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-98ab8497-eb03-4e1e-9560-45ab4f1c9b55 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] Request method failure captured: Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: request: PUT /compute/v2.1/flavors/141189205/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 27 Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7jBBurZ539rb4HqV2AXHDPxcoA4NF6k0qZzJQ-alres483TfgwjO08WM11c45md-FEkRYWnqWNsi2701YD9NMLNis4-rNnowEtNKjDvf1RbMmtHWc_tujIgJ0I5ztl1PjTT0P6mEIT7wX2nT9fWAZiHNzmtV3rBanERj9YEvexw6Fc Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: aa5c9520bc6d4dda851fd705213495f9 Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:11:31.085159 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:11:31.086396 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/aa5c9520bc6d4dda851fd705213495f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_aa5c9520bc6d4dda851fd705213495f9", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/aa5c9520bc6d4dda851fd705213495f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/aa5c9520bc6d4dda851fd705213495f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:11:31.086396 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 Aug 22 17:11:31.086396 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: aa5c9520bc6d4dda851fd705213495f9 Aug 22 17:11:31.086396 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 Aug 22 17:11:31.086396 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin Aug 22 17:11:31.086396 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:11:31.086396 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:11:31.086396 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 08799a9a12034b898906ee7946002ee8 Aug 22 17:11:31.086396 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin Aug 22 17:11:31.086396 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:11:31.086396 n-d-854030-1 devstack@n-api.service[123016]: {"hw:cpu_policy": "shared"} Aug 22 17:11:31.086396 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:11:31.086396 n-d-854030-1 devstack@n-api.service[123016]: exception: Request body and URI mismatch Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'flavor_id': '141189205', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:31.087090 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:31.088128 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:11:31.088128 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:11:31.088128 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 22 17:11:31.088128 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:31.091639 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-98ab8497-eb03-4e1e-9560-45ab4f1c9b55 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:11:31.099906 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-98ab8497-eb03-4e1e-9560-45ab4f1c9b55 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] 10.222.0.96 "PUT /compute/v2.1/flavors/141189205/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.022745 Aug 22 17:11:31.099906 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 41/82] 10.222.0.96 () {60 vars in 1262 bytes} [Mon Aug 22 17:11:31 2022] PUT /compute/v2.1/flavors/141189205/os-extra_specs/hw:numa_nodes => generated 73 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 22 17:11:31.110294 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e741539b-ef32-4b81-925b-6d80cf7b56e9 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e741539b-ef32-4b81-925b-6d80cf7b56e9 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] Request method failure captured: Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: request: PUT /compute/v2.1/flavors/141189205/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 49 Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7jBBurZ539rb4HqV2AXHDPxcoA4NF6k0qZzJQ-alres483TfgwjO08WM11c45md-FEkRYWnqWNsi2701YD9NMLNis4-rNnowEtNKjDvf1RbMmtHWc_tujIgJ0I5ztl1PjTT0P6mEIT7wX2nT9fWAZiHNzmtV3rBanERj9YEvexw6Fc Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: aa5c9520bc6d4dda851fd705213495f9 Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:11:31.127682 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:11:31.128864 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/aa5c9520bc6d4dda851fd705213495f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_aa5c9520bc6d4dda851fd705213495f9", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/aa5c9520bc6d4dda851fd705213495f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/aa5c9520bc6d4dda851fd705213495f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:11:31.128864 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 Aug 22 17:11:31.128864 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: aa5c9520bc6d4dda851fd705213495f9 Aug 22 17:11:31.128864 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 Aug 22 17:11:31.128864 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin Aug 22 17:11:31.128864 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:11:31.128864 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:11:31.128864 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 08799a9a12034b898906ee7946002ee8 Aug 22 17:11:31.128864 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin Aug 22 17:11:31.128864 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:11:31.128864 n-d-854030-1 devstack@n-api.service[123016]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 22 17:11:31.128864 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'flavor_id': '141189205', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi On instance: Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 22 17:11:31.129646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:31.130783 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:31.131815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:31.131815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:31.131815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:11:31.131815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:11:31.131815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 22 17:11:31.131815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:31.131815 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e741539b-ef32-4b81-925b-6d80cf7b56e9 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:11:31.131815 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e741539b-ef32-4b81-925b-6d80cf7b56e9 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] 10.222.0.96 "PUT /compute/v2.1/flavors/141189205/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.025485 Aug 22 17:11:31.132235 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 42/83] 10.222.0.96 () {60 vars in 1262 bytes} [Mon Aug 22 17:11:31 2022] PUT /compute/v2.1/flavors/141189205/os-extra_specs/hw:numa_nodes => generated 117 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:11:31.160714 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f2e1051f-f0d5-4aea-8d02-ec913dd46784 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:31.324678 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1cd1b170-2806-4484-bde7-7cb11b28ef7c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:31.336412 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1cd1b170-2806-4484-bde7-7cb11b28ef7c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1342 microversion: 2.1 time: 0.640738 Aug 22 17:11:31.337071 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 42/84] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:30 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1342 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:31.345194 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f41b86e3-30fa-4956-9894-6893a59f103e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:31.346187 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f41b86e3-30fa-4956-9894-6893a59f103e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:31.353563 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f2e1051f-f0d5-4aea-8d02-ec913dd46784 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/141189205" status: 202 len: 0 microversion: 2.1 time: 0.210780 Aug 22 17:11:31.355573 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 43/85] 10.222.0.96 () {58 vars in 1158 bytes} [Mon Aug 22 17:11:31 2022] DELETE /compute/v2.1/flavors/141189205 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:11:31.368380 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-09b023fd-4aa1-4b3c-ad66-c3a76a5c2307 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:31.387067 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f41b86e3-30fa-4956-9894-6893a59f103e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:31.387619 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f41b86e3-30fa-4956-9894-6893a59f103e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:31.388065 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f41b86e3-30fa-4956-9894-6893a59f103e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:31.388819 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f41b86e3-30fa-4956-9894-6893a59f103e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:31.401400 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f41b86e3-30fa-4956-9894-6893a59f103e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:31.427563 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f41b86e3-30fa-4956-9894-6893a59f103e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:31.450759 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-09b023fd-4aa1-4b3c-ad66-c3a76a5c2307 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044 tempest-FlavorsExtraSpecsNegativeTestJSON-1470135044-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.086457 Aug 22 17:11:31.453729 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 44/86] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:11:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:32.038349 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f41b86e3-30fa-4956-9894-6893a59f103e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:32.061328 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f41b86e3-30fa-4956-9894-6893a59f103e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1339 microversion: 2.1 time: 0.716957 Aug 22 17:11:32.064479 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 43/87] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:31 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1339 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:32.360925 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4a06c374-e000-4a82-9a9c-8ff19403a8aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:32.363527 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-4a06c374-e000-4a82-9a9c-8ff19403a8aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:32.375304 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4a06c374-e000-4a82-9a9c-8ff19403a8aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:32.378928 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4a06c374-e000-4a82-9a9c-8ff19403a8aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:32.380495 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4a06c374-e000-4a82-9a9c-8ff19403a8aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:32.382548 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4a06c374-e000-4a82-9a9c-8ff19403a8aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:32.383194 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4a06c374-e000-4a82-9a9c-8ff19403a8aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:32.384057 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4a06c374-e000-4a82-9a9c-8ff19403a8aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:32.547677 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-4a06c374-e000-4a82-9a9c-8ff19403a8aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:32.556150 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4a06c374-e000-4a82-9a9c-8ff19403a8aa tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1342 microversion: 2.1 time: 0.201774 Aug 22 17:11:32.556833 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 45/88] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:32 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:33.085727 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-103f49ec-0eb8-4024-bc29-feedf4e320ca tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:33.086447 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-103f49ec-0eb8-4024-bc29-feedf4e320ca tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:33.094032 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-103f49ec-0eb8-4024-bc29-feedf4e320ca tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:33.094591 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-103f49ec-0eb8-4024-bc29-feedf4e320ca tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:33.095889 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-103f49ec-0eb8-4024-bc29-feedf4e320ca tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:33.096795 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-103f49ec-0eb8-4024-bc29-feedf4e320ca tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:33.097436 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-103f49ec-0eb8-4024-bc29-feedf4e320ca tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:33.097980 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-103f49ec-0eb8-4024-bc29-feedf4e320ca tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:33.256740 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-103f49ec-0eb8-4024-bc29-feedf4e320ca tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:33.264540 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-103f49ec-0eb8-4024-bc29-feedf4e320ca tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1339 microversion: 2.1 time: 0.183321 Aug 22 17:11:33.265129 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 44/89] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:33 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1339 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:33.578128 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f44eaa80-3be0-4f51-9478-2aa9e7f41a03 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:33.578673 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-f44eaa80-3be0-4f51-9478-2aa9e7f41a03 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:33.584792 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f44eaa80-3be0-4f51-9478-2aa9e7f41a03 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:33.585318 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f44eaa80-3be0-4f51-9478-2aa9e7f41a03 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:33.585763 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f44eaa80-3be0-4f51-9478-2aa9e7f41a03 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:33.586465 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f44eaa80-3be0-4f51-9478-2aa9e7f41a03 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:33.586924 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f44eaa80-3be0-4f51-9478-2aa9e7f41a03 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:33.587353 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f44eaa80-3be0-4f51-9478-2aa9e7f41a03 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:33.618904 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=13,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:33.736418 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-f44eaa80-3be0-4f51-9478-2aa9e7f41a03 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:33.744652 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f44eaa80-3be0-4f51-9478-2aa9e7f41a03 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1342 microversion: 2.1 time: 0.170489 Aug 22 17:11:33.745401 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 46/90] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:33 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1342 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:34.285440 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d218e5ea-2b2f-45d7-81a9-a7f756f7d520 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:34.286432 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d218e5ea-2b2f-45d7-81a9-a7f756f7d520 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:34.292241 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d218e5ea-2b2f-45d7-81a9-a7f756f7d520 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:34.292760 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d218e5ea-2b2f-45d7-81a9-a7f756f7d520 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:34.293244 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d218e5ea-2b2f-45d7-81a9-a7f756f7d520 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:34.298100 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d218e5ea-2b2f-45d7-81a9-a7f756f7d520 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:34.298100 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d218e5ea-2b2f-45d7-81a9-a7f756f7d520 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:34.298100 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d218e5ea-2b2f-45d7-81a9-a7f756f7d520 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:34.561470 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d218e5ea-2b2f-45d7-81a9-a7f756f7d520 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:34.573373 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d218e5ea-2b2f-45d7-81a9-a7f756f7d520 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1339 microversion: 2.1 time: 0.291312 Aug 22 17:11:34.577521 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 45/91] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:34 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1339 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:34.593660 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-91ca4239-65ce-4a6c-9c95-221d473518fc req-161d45a8-0095-485c-8a18-fcf649cf260b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f52f344-5753-4cab-9879-b33d702cf01a", "tag": "6f557d42-01c9-44ea-845d-011d61fc88b4"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:34.620337 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-91ca4239-65ce-4a6c-9c95-221d473518fc req-161d45a8-0095-485c-8a18-fcf649cf260b service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:34.623208 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-91ca4239-65ce-4a6c-9c95-221d473518fc req-161d45a8-0095-485c-8a18-fcf649cf260b service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:34.627524 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-91ca4239-65ce-4a6c-9c95-221d473518fc req-161d45a8-0095-485c-8a18-fcf649cf260b service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:34.642967 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-91ca4239-65ce-4a6c-9c95-221d473518fc req-161d45a8-0095-485c-8a18-fcf649cf260b service nova] Creating event network-changed:6f557d42-01c9-44ea-845d-011d61fc88b4 for instance 7f52f344-5753-4cab-9879-b33d702cf01a on n-h2-854030-1 Aug 22 17:11:34.648339 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-91ca4239-65ce-4a6c-9c95-221d473518fc req-161d45a8-0095-485c-8a18-fcf649cf260b service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236665 Aug 22 17:11:34.649514 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 47/92] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:11:34.766959 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-04fd5499-1838-4722-a5ca-5cb69d191929 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:34.767644 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-04fd5499-1838-4722-a5ca-5cb69d191929 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:34.773947 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-04fd5499-1838-4722-a5ca-5cb69d191929 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:34.774464 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-04fd5499-1838-4722-a5ca-5cb69d191929 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:34.774988 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-04fd5499-1838-4722-a5ca-5cb69d191929 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:34.775937 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-04fd5499-1838-4722-a5ca-5cb69d191929 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:34.776541 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-04fd5499-1838-4722-a5ca-5cb69d191929 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:34.776965 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-04fd5499-1838-4722-a5ca-5cb69d191929 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:34.945641 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-04fd5499-1838-4722-a5ca-5cb69d191929 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:34.954116 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-04fd5499-1838-4722-a5ca-5cb69d191929 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1342 microversion: 2.1 time: 0.192255 Aug 22 17:11:34.955049 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 46/93] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:34 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1342 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:35.600307 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1ff13163-9e72-4c62-8c44-e189d4b90f32 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:35.601265 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-1ff13163-9e72-4c62-8c44-e189d4b90f32 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:35.603861 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:35.617229 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1ff13163-9e72-4c62-8c44-e189d4b90f32 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:35.623938 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1ff13163-9e72-4c62-8c44-e189d4b90f32 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:35.623938 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1ff13163-9e72-4c62-8c44-e189d4b90f32 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:35.623938 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1ff13163-9e72-4c62-8c44-e189d4b90f32 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:35.623938 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1ff13163-9e72-4c62-8c44-e189d4b90f32 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:35.624297 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1ff13163-9e72-4c62-8c44-e189d4b90f32 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:35.648537 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=100 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:35.954435 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-1ff13163-9e72-4c62-8c44-e189d4b90f32 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:35.961988 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1ff13163-9e72-4c62-8c44-e189d4b90f32 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1339 microversion: 2.1 time: 0.371919 Aug 22 17:11:35.962602 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 48/94] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:35 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1339 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:35.989858 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5916c603-a000-45da-9c55-f136855a3c27 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:35.990532 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-5916c603-a000-45da-9c55-f136855a3c27 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:36.006036 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5916c603-a000-45da-9c55-f136855a3c27 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:36.008907 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5916c603-a000-45da-9c55-f136855a3c27 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:36.010753 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5916c603-a000-45da-9c55-f136855a3c27 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:36.014368 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5916c603-a000-45da-9c55-f136855a3c27 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:36.014368 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5916c603-a000-45da-9c55-f136855a3c27 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:36.014368 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5916c603-a000-45da-9c55-f136855a3c27 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:36.237095 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-5916c603-a000-45da-9c55-f136855a3c27 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:36.244827 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5916c603-a000-45da-9c55-f136855a3c27 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1342 microversion: 2.1 time: 0.273797 Aug 22 17:11:36.245423 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 47/95] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:35 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1342 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:36.828796 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-15bc7dcd-44d1-429d-b69e-a0e4934a99b9 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1590580785", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "fdc9ccda-2ee0-4687-8e99-c6ce209572f9"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:36.909570 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-15bc7dcd-44d1-429d-b69e-a0e4934a99b9 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] validate_networks() for [('fdc9ccda-2ee0-4687-8e99-c6ce209572f9', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:11:36.991759 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6483a7d3-3138-42dc-9539-850ad9cef362 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:36.992366 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-6483a7d3-3138-42dc-9539-850ad9cef362 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:37.003702 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6483a7d3-3138-42dc-9539-850ad9cef362 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:37.004201 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6483a7d3-3138-42dc-9539-850ad9cef362 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:37.004764 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6483a7d3-3138-42dc-9539-850ad9cef362 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:37.005545 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6483a7d3-3138-42dc-9539-850ad9cef362 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:37.007270 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6483a7d3-3138-42dc-9539-850ad9cef362 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:37.007704 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6483a7d3-3138-42dc-9539-850ad9cef362 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:37.441043 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6483a7d3-3138-42dc-9539-850ad9cef362 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:37.472493 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6483a7d3-3138-42dc-9539-850ad9cef362 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1339 microversion: 2.1 time: 0.484524 Aug 22 17:11:37.483102 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 48/96] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:36 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1339 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:37.497029 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-727c26db-9b42-4bf0-9e0a-4d4707de6ed1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:37.503550 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-727c26db-9b42-4bf0-9e0a-4d4707de6ed1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:37.507178 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-727c26db-9b42-4bf0-9e0a-4d4707de6ed1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:37.507664 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-727c26db-9b42-4bf0-9e0a-4d4707de6ed1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:37.508093 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-727c26db-9b42-4bf0-9e0a-4d4707de6ed1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:37.508992 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-727c26db-9b42-4bf0-9e0a-4d4707de6ed1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:37.509544 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-727c26db-9b42-4bf0-9e0a-4d4707de6ed1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:37.510002 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-727c26db-9b42-4bf0-9e0a-4d4707de6ed1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:37.701177 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-15bc7dcd-44d1-429d-b69e-a0e4934a99b9 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-143b2164-7ba2-41db-99ea-63535d43fe7f) Aug 22 17:11:37.701177 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:37.701177 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:37.701177 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:37.701177 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:37.701177 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:37.701177 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:37.701177 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:37.701177 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:37.701177 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:37.701177 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:11:37.701177 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:11:37.701177 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:11:37.701177 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:11:37.701177 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:11:37.701177 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:11:37.702439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:11:37.702439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:11:37.702439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:11:37.702439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:11:37.702439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:11:37.702439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:11:37.702439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:11:37.702439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:11:37.702439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:11:37.702439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:11:37.702439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:11:37.702439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:37.702439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:37.702439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:11:37.702439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:11:37.702439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:37.702439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:37.702439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:11:37.704555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:11:37.704555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:37.704555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:37.704555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:11:37.704555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:11:37.704555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:37.704555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:37.704555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:11:37.704555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:11:37.704555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:11:37.704555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:11:37.704555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:11:37.704555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:11:37.704555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:11:37.704555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:11:37.704555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:11:37.704555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:11:37.704555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:11:37.705838 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:11:37.705838 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:11:37.705838 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:11:37.705838 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:11:37.705838 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:11:37.705838 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:11:37.705838 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:11:37.705838 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:11:37.705838 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:11:37.705838 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:11:37.705838 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:11:37.705838 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:11:37.705838 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:11:37.705838 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:11:37.705838 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-143b2164-7ba2-41db-99ea-63535d43fe7f) Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-15bc7dcd-44d1-429d-b69e-a0e4934a99b9 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-15bc7dcd-44d1-429d-b69e-a0e4934a99b9 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Request method failure captured: Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 203 Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7i00XIted51SRgiyV5pAhir8FTEq23YkCIJUz0ya_ROxErxKEnH_Lg59kvaS9UiroD-f6GQRmzIgeDn2uLeWFMJYJ__6lnPnVkQ2uGAAXUl9FSd5SHblMfVv907QYMDRNu-Fy91G6CqDgyc6PinbWYoGdS41dDpH8-Dssg6vayPSNA Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 8322e3f6eb26483d8dcad0662e1ec3ff Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-LiveMigrationTest-1154936269 Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:11:37.706828 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:11:37.720868 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8322e3f6eb26483d8dcad0662e1ec3ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_8322e3f6eb26483d8dcad0662e1ec3ff", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8322e3f6eb26483d8dcad0662e1ec3ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/8322e3f6eb26483d8dcad0662e1ec3ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:11:37.720868 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-LiveMigrationTest-1154936269 Aug 22 17:11:37.720868 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 8322e3f6eb26483d8dcad0662e1ec3ff Aug 22 17:11:37.720868 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-LiveMigrationTest-1154936269 Aug 22 17:11:37.720868 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-LiveMigrationTest-1154936269-project Aug 22 17:11:37.720868 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:11:37.720868 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:11:37.720868 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 53ebbab2867a4b4c9dd3744fedd1c779 Aug 22 17:11:37.720868 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-LiveMigrationTest-1154936269-project Aug 22 17:11:37.720868 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:11:37.720868 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-LiveMigrationTest-server-1590580785", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "fdc9ccda-2ee0-4687-8e99-c6ce209572f9"}]}} Aug 22 17:11:37.720868 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:11:37.721852 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:11:37.721852 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:11:37.721852 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-1590580785', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'fdc9ccda-2ee0-4687-8e99-c6ce209572f9'}]}}} Aug 22 17:11:37.721852 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:11:37.721852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:37.721852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:37.721852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:37.721852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:37.721852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:37.721852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:37.721852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:37.721852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:37.721852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:37.721852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:11:37.721852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:11:37.721852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:11:37.721852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:11:37.721852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:11:37.721852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:11:37.723086 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:11:37.723086 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:11:37.723086 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:11:37.723086 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:11:37.723086 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:11:37.723086 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:11:37.723086 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:11:37.723086 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:11:37.723086 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:11:37.723086 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:11:37.723086 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:11:37.723086 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:37.723086 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:37.723086 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:11:37.723086 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:11:37.723086 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:37.723086 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:37.723086 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:11:37.724501 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:11:37.724501 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:37.724501 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:37.724501 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:11:37.724501 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:11:37.724501 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:37.724501 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:37.724501 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:11:37.724501 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:11:37.724501 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:11:37.724501 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:11:37.724501 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:11:37.724501 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:11:37.724501 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:11:37.724501 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:11:37.724501 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:11:37.724501 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:11:37.724501 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:11:37.731787 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:11:37.731787 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:11:37.731787 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:11:37.731787 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:11:37.731787 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:11:37.731787 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:11:37.731787 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:11:37.731787 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:11:37.731787 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:11:37.731787 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:11:37.731787 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:11:37.731787 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:11:37.731787 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:11:37.731787 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:11:37.731787 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:11:37.732605 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-143b2164-7ba2-41db-99ea-63535d43fe7f) Aug 22 17:11:37.732605 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:37.732605 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:37.732605 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:37.732605 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:37.732605 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:37.732605 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:37.732605 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:11:37.732605 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:11:37.732605 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:11:37.732605 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:11:37.732605 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:11:37.732605 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:37.732605 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:37.732605 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:37.732605 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:37.732605 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:37.732605 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:37.732605 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:37.733654 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:11:37.733654 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:11:37.733654 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:11:37.733654 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:37.733654 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:37.733654 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-15bc7dcd-44d1-429d-b69e-a0e4934a99b9 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:11:37.733654 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:11:37.733654 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-15bc7dcd-44d1-429d-b69e-a0e4934a99b9 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.315105 Aug 22 17:11:37.733654 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 49/97] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:11:36 2022] POST /compute/v2.1/servers => generated 214 bytes in 1316 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:11:37.817629 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-727c26db-9b42-4bf0-9e0a-4d4707de6ed1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:37.822940 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=100 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:37.826849 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-727c26db-9b42-4bf0-9e0a-4d4707de6ed1 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1342 microversion: 2.1 time: 0.342170 Aug 22 17:11:37.846472 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 49/98] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:37 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1342 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:37.967652 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-da2c8683-37bd-4d56-873e-4046da7d3ea3 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-946157964", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "fdc9ccda-2ee0-4687-8e99-c6ce209572f9"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:37.984481 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=87,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:38.081948 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-da2c8683-37bd-4d56-873e-4046da7d3ea3 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] validate_networks() for [('fdc9ccda-2ee0-4687-8e99-c6ce209572f9', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:11:38.227276 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-13420d3a-f40c-4906-ba49-eeca58ec9d37 tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-40903745", "ram": 512, "vcpus": 1, "disk": 10, "id": 524821500, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:38.230092 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:38.230092 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:38.374695 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-13420d3a-f40c-4906-ba49-eeca58ec9d37 tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.526394 Aug 22 17:11:38.375304 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 50/99] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:11:37 2022] POST /compute/v2.1/flavors => generated 411 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:38.388346 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5b6d1d79-bf55-4a9a-b1ad-fb35fdbbcb15 tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:38.390993 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:38.390993 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:38.528819 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5b6d1d79-bf55-4a9a-b1ad-fb35fdbbcb15 tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors/524821500/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.144171 Aug 22 17:11:38.529757 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 51/100] 10.222.0.96 () {60 vars in 1221 bytes} [Mon Aug 22 17:11:38 2022] POST /compute/v2.1/flavors/524821500/os-extra_specs => generated 66 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 22 17:11:38.541593 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0bc4acc5-10a5-40d5-8d9f-5724c1f479f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:38.545564 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-0bc4acc5-10a5-40d5-8d9f-5724c1f479f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:38.561448 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0bc4acc5-10a5-40d5-8d9f-5724c1f479f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:38.561946 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0bc4acc5-10a5-40d5-8d9f-5724c1f479f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:38.563456 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0bc4acc5-10a5-40d5-8d9f-5724c1f479f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:38.564211 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0bc4acc5-10a5-40d5-8d9f-5724c1f479f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:38.564809 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0bc4acc5-10a5-40d5-8d9f-5724c1f479f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:38.569609 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0bc4acc5-10a5-40d5-8d9f-5724c1f479f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:38.806584 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-da2c8683-37bd-4d56-873e-4046da7d3ea3 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-381662fe-8e9e-4785-b6c0-9d5ba941ca0e) Aug 22 17:11:38.806584 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:38.806584 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:38.806584 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:38.806584 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:38.806584 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:38.806584 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:38.806584 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:38.806584 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:38.806584 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:38.806584 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:11:38.806584 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:11:38.806584 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:11:38.806584 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:11:38.806584 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:11:38.806584 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:11:38.809637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:11:38.809637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:11:38.809637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:11:38.809637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:11:38.809637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:11:38.809637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:11:38.809637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:11:38.809637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:11:38.809637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:11:38.809637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:11:38.809637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:11:38.809637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:38.809637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:38.809637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:11:38.809637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:11:38.809637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:38.809637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:38.809637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:11:38.810768 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:11:38.810768 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:38.810768 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:38.810768 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:11:38.810768 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:11:38.810768 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:38.810768 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:38.810768 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:11:38.810768 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:11:38.810768 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:11:38.810768 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:11:38.810768 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:11:38.810768 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:11:38.810768 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:11:38.810768 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:11:38.810768 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:11:38.810768 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:11:38.810768 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:11:38.811900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:11:38.811900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:11:38.811900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:11:38.811900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:11:38.811900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:11:38.811900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:11:38.811900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:11:38.811900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:11:38.811900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:11:38.811900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:11:38.811900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:11:38.811900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:11:38.811900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:11:38.811900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:11:38.811900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:11:38.812882 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-381662fe-8e9e-4785-b6c0-9d5ba941ca0e) Aug 22 17:11:38.812882 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:38.812882 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-da2c8683-37bd-4d56-873e-4046da7d3ea3 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:11:38.812882 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-da2c8683-37bd-4d56-873e-4046da7d3ea3 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Request method failure captured: Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 202 Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7i00XIted51SRgiyV5pAhir8FTEq23YkCIJUz0ya_ROxErxKEnH_Lg59kvaS9UiroD-f6GQRmzIgeDn2uLeWFMJYJ__6lnPnVkQ2uGAAXUl9FSd5SHblMfVv907QYMDRNu-Fy91G6CqDgyc6PinbWYoGdS41dDpH8-Dssg6vayPSNA Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 8322e3f6eb26483d8dcad0662e1ec3ff Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-LiveMigrationTest-1154936269 Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:11:38.822657 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:11:38.823931 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8322e3f6eb26483d8dcad0662e1ec3ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_8322e3f6eb26483d8dcad0662e1ec3ff", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8322e3f6eb26483d8dcad0662e1ec3ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/8322e3f6eb26483d8dcad0662e1ec3ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:11:38.823931 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-LiveMigrationTest-1154936269 Aug 22 17:11:38.823931 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 8322e3f6eb26483d8dcad0662e1ec3ff Aug 22 17:11:38.823931 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-LiveMigrationTest-1154936269 Aug 22 17:11:38.823931 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-LiveMigrationTest-1154936269-project Aug 22 17:11:38.823931 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:11:38.823931 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:11:38.823931 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 53ebbab2867a4b4c9dd3744fedd1c779 Aug 22 17:11:38.823931 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-LiveMigrationTest-1154936269-project Aug 22 17:11:38.823931 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:11:38.823931 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-LiveMigrationTest-server-946157964", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "fdc9ccda-2ee0-4687-8e99-c6ce209572f9"}]}} Aug 22 17:11:38.823931 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:11:38.825208 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:11:38.825208 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:11:38.825208 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-946157964', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'fdc9ccda-2ee0-4687-8e99-c6ce209572f9'}]}}} Aug 22 17:11:38.825208 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:11:38.825208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:38.825208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:38.825208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:38.825208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:38.825208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:38.825208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:38.825208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:38.825208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:38.825208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:38.825208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:11:38.825208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:11:38.825208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:11:38.825208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:11:38.825208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:11:38.825208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:11:38.826517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:11:38.826517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:11:38.826517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:11:38.826517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:11:38.826517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:11:38.826517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:11:38.826517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:11:38.826517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:11:38.826517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:11:38.826517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:11:38.826517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:11:38.826517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:38.826517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:38.826517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:11:38.826517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:11:38.826517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:38.826517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:38.826517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:11:38.827711 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:11:38.827711 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:38.827711 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:38.827711 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:11:38.827711 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:11:38.827711 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:38.827711 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:38.827711 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:11:38.827711 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:11:38.827711 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:11:38.827711 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:11:38.827711 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:11:38.827711 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:11:38.827711 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:11:38.827711 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:11:38.827711 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:11:38.827711 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:11:38.827711 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:11:38.828694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:11:38.828694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:11:38.828694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:11:38.828694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:11:38.828694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:11:38.828694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:11:38.828694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:11:38.828694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:11:38.828694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:11:38.828694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:11:38.828694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:11:38.828694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:11:38.828694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:11:38.828694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:11:38.828694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:11:38.829620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-381662fe-8e9e-4785-b6c0-9d5ba941ca0e) Aug 22 17:11:38.829620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:38.829620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:38.829620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:38.829620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:38.829620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:38.829620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:38.829620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:11:38.829620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:11:38.829620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:11:38.829620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:11:38.829620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:11:38.829620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:38.829620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:38.829620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:38.829620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:38.829620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:38.829620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:38.829620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:38.830840 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:11:38.830840 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:11:38.830840 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:11:38.830840 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:38.830840 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:11:38.830840 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-da2c8683-37bd-4d56-873e-4046da7d3ea3 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:11:38.830840 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:11:38.830840 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-da2c8683-37bd-4d56-873e-4046da7d3ea3 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.861800 Aug 22 17:11:38.830840 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 50/101] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:11:37 2022] POST /compute/v2.1/servers => generated 214 bytes in 863 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 22 17:11:38.842951 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-0bc4acc5-10a5-40d5-8d9f-5724c1f479f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:38.853718 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0bc4acc5-10a5-40d5-8d9f-5724c1f479f3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1339 microversion: 2.1 time: 0.316485 Aug 22 17:11:38.854719 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 52/102] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:38 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1339 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:38.860530 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-dce6fd90-983e-4d2b-92fe-7eb68b7aac0e tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Action: 'create', calling method: .version_select at 0x7f800a1eb790>, body: {"keypair": {"name": "tempest-keypair-609065396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGhAbZtM6QsaMLyQrGQSOnNYxQC30ReaPqxVUf+2qa9rNOUEl5RXEalRLxho6Iwwu/Ki3N2foDikX1ck2ssbfGVUsYjaHiYPTSwiVw+hAnX7KnBQ07XH/60z3q7LWyKcA=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:38.889935 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-dce6fd90-983e-4d2b-92fe-7eb68b7aac0e tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Getting quotas for project 8322e3f6eb26483d8dcad0662e1ec3ff. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:11:38.895949 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-dce6fd90-983e-4d2b-92fe-7eb68b7aac0e tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Getting quotas for user 53ebbab2867a4b4c9dd3744fedd1c779 and project 8322e3f6eb26483d8dcad0662e1ec3ff. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:11:39.023938 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-dce6fd90-983e-4d2b-92fe-7eb68b7aac0e tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.167732 Aug 22 17:11:39.027995 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 53/103] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:11:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:39.039122 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e7b68068-1097-4e97-ba8e-ab8fdfed83ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:39.039944 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e7b68068-1097-4e97-ba8e-ab8fdfed83ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:39.048009 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e7b68068-1097-4e97-ba8e-ab8fdfed83ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:39.048605 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e7b68068-1097-4e97-ba8e-ab8fdfed83ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:39.049042 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e7b68068-1097-4e97-ba8e-ab8fdfed83ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:39.050042 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e7b68068-1097-4e97-ba8e-ab8fdfed83ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:39.051105 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e7b68068-1097-4e97-ba8e-ab8fdfed83ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:39.051735 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e7b68068-1097-4e97-ba8e-ab8fdfed83ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:39.252318 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2eb8a856-6518-46eb-8b1e-9df61a0fb64e tempest-FlavorsExtraSpecsTestJSON-963990024 tempest-FlavorsExtraSpecsTestJSON-963990024-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:39.275592 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2eb8a856-6518-46eb-8b1e-9df61a0fb64e tempest-FlavorsExtraSpecsTestJSON-963990024 tempest-FlavorsExtraSpecsTestJSON-963990024-project] 10.222.0.96 "GET /compute/v2.1/flavors/524821500/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.448383 Aug 22 17:11:39.276338 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 51/104] 10.222.0.96 () {58 vars in 1200 bytes} [Mon Aug 22 17:11:38 2022] GET /compute/v2.1/flavors/524821500/os-extra_specs => generated 66 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:11:39.293260 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5186c8fc-d815-4781-b39e-f3975819619d tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:39.301795 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:39.301795 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:39.308612 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e7b68068-1097-4e97-ba8e-ab8fdfed83ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:39.323098 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e7b68068-1097-4e97-ba8e-ab8fdfed83ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1342 microversion: 2.1 time: 0.288437 Aug 22 17:11:39.325959 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5186c8fc-d815-4781-b39e-f3975819619d tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors/524821500/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040795 Aug 22 17:11:39.326951 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 52/105] 10.222.0.96 () {60 vars in 1221 bytes} [Mon Aug 22 17:11:39 2022] POST /compute/v2.1/flavors/524821500/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:11:39.327185 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 54/106] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:39 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1342 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:39.347530 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1cc32124-8ab1-442b-97cc-45c25251ead2 tempest-FlavorsExtraSpecsTestJSON-963990024 tempest-FlavorsExtraSpecsTestJSON-963990024-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:39.357204 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1cc32124-8ab1-442b-97cc-45c25251ead2 tempest-FlavorsExtraSpecsTestJSON-963990024 tempest-FlavorsExtraSpecsTestJSON-963990024-project] 10.222.0.96 "GET /compute/v2.1/flavors/524821500/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.023701 Aug 22 17:11:39.358156 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 53/107] 10.222.0.96 () {58 vars in 1242 bytes} [Mon Aug 22 17:11:39 2022] GET /compute/v2.1/flavors/524821500/os-extra_specs/hw:numa_nodes => generated 22 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:11:39.370866 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-34d2ee43-5c33-4a1f-a898-c408e55737c7 tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:39.373513 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:39.373513 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:39.409278 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-34d2ee43-5c33-4a1f-a898-c408e55737c7 tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors/524821500/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043075 Aug 22 17:11:39.410524 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 55/108] 10.222.0.96 () {60 vars in 1221 bytes} [Mon Aug 22 17:11:39 2022] POST /compute/v2.1/flavors/524821500/os-extra_specs => generated 66 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:11:39.422022 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7f4e272a-0437-4208-a644-094ce1f551cf tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:39.433696 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7f4e272a-0437-4208-a644-094ce1f551cf tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/524821500/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.017320 Aug 22 17:11:39.434251 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 54/109] 10.222.0.96 () {58 vars in 1200 bytes} [Mon Aug 22 17:11:39 2022] GET /compute/v2.1/flavors/524821500/os-extra_specs => generated 66 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 22 17:11:39.443609 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9b8d9085-efbe-49e7-9f01-98b445d2de9f tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:39.446535 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:39.446535 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:39.572834 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9b8d9085-efbe-49e7-9f01-98b445d2de9f tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] 10.222.0.96 "PUT /compute/v2.1/flavors/524821500/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.132756 Aug 22 17:11:39.573708 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 56/110] 10.222.0.96 () {60 vars in 1262 bytes} [Mon Aug 22 17:11:39 2022] PUT /compute/v2.1/flavors/524821500/os-extra_specs/hw:numa_nodes => generated 22 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:11:39.590479 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9181affe-3330-46c7-8fa3-7ba8802cdd87 tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:39.606295 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9181affe-3330-46c7-8fa3-7ba8802cdd87 tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/524821500/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.019918 Aug 22 17:11:39.610930 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 55/111] 10.222.0.96 () {58 vars in 1200 bytes} [Mon Aug 22 17:11:39 2022] GET /compute/v2.1/flavors/524821500/os-extra_specs => generated 66 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:11:39.622128 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-537de9f8-2451-4f00-996f-562b284946ed tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:39.622996 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:39.622996 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:39.751154 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-537de9f8-2451-4f00-996f-562b284946ed tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/524821500/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.134249 Aug 22 17:11:39.758303 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 57/112] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:11:39 2022] DELETE /compute/v2.1/flavors/524821500/os-extra_specs/hw:numa_nodes => generated 0 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 22 17:11:39.761396 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-681e17a2-6f1c-434f-b8f4-75e7ad122375 tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:39.763028 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:39.763028 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:39.871826 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-681e17a2-6f1c-434f-b8f4-75e7ad122375 tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/524821500/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.112598 Aug 22 17:11:39.885193 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7e222aff-7112-44d7-b211-820093dd1dce tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:39.887370 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-7e222aff-7112-44d7-b211-820093dd1dce tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:39.890624 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 56/113] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:11:39 2022] DELETE /compute/v2.1/flavors/524821500/os-extra_specs/hw:cpu_policy => generated 0 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 22 17:11:39.906250 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e222aff-7112-44d7-b211-820093dd1dce tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:39.906250 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e222aff-7112-44d7-b211-820093dd1dce tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:39.906396 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6092b43c-71a3-4213-b2df-b2ecd434a5e7 tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:39.906468 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e222aff-7112-44d7-b211-820093dd1dce tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:39.906468 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e222aff-7112-44d7-b211-820093dd1dce tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:39.906468 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e222aff-7112-44d7-b211-820093dd1dce tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:39.906852 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e222aff-7112-44d7-b211-820093dd1dce tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:39.932166 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6092b43c-71a3-4213-b2df-b2ecd434a5e7 tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/524821500/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.033624 Aug 22 17:11:39.932817 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 57/114] 10.222.0.96 () {58 vars in 1200 bytes} [Mon Aug 22 17:11:39 2022] GET /compute/v2.1/flavors/524821500/os-extra_specs => generated 19 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:11:40.141821 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-7e222aff-7112-44d7-b211-820093dd1dce tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:40.151865 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7e222aff-7112-44d7-b211-820093dd1dce tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1339 microversion: 2.1 time: 0.276427 Aug 22 17:11:40.165108 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 58/115] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:39 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1339 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:40.170891 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5cd1025a-aaf6-4919-a3eb-a39bfdf59338 tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:40.172054 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:40.172054 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:40.267264 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5cd1025a-aaf6-4919-a3eb-a39bfdf59338 tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/524821500" status: 202 len: 0 microversion: 2.1 time: 0.112620 Aug 22 17:11:40.270497 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 59/116] 10.222.0.96 () {58 vars in 1158 bytes} [Mon Aug 22 17:11:40 2022] DELETE /compute/v2.1/flavors/524821500 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:11:40.281848 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9a11b09f-b7e7-4e4c-8685-d81940ac7edc tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:40.285467 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-50fdc3ff-f27a-4190-b0eb-b937bacba108 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Calling method '.version_select at 0x7f800a0cfc10>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:40.286410 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:40.286410 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:40.287569 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-50fdc3ff-f27a-4190-b0eb-b937bacba108 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.288603 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-50fdc3ff-f27a-4190-b0eb-b937bacba108 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.289980 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-50fdc3ff-f27a-4190-b0eb-b937bacba108 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.314547 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-50fdc3ff-f27a-4190-b0eb-b937bacba108 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.315359 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-50fdc3ff-f27a-4190-b0eb-b937bacba108 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.315935 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-50fdc3ff-f27a-4190-b0eb-b937bacba108 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.322679 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9a11b09f-b7e7-4e4c-8685-d81940ac7edc tempest-FlavorsExtraSpecsTestJSON-656611147 tempest-FlavorsExtraSpecsTestJSON-656611147-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047944 Aug 22 17:11:40.335829 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 60/117] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:11:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:11:40.348412 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-eee7bd7a-506b-45b3-b922-d8792ce358ed tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:40.349246 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-eee7bd7a-506b-45b3-b922-d8792ce358ed tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:40.353990 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-50fdc3ff-f27a-4190-b0eb-b937bacba108 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.354492 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-50fdc3ff-f27a-4190-b0eb-b937bacba108 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.355141 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-50fdc3ff-f27a-4190-b0eb-b937bacba108 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.357356 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eee7bd7a-506b-45b3-b922-d8792ce358ed tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.357857 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eee7bd7a-506b-45b3-b922-d8792ce358ed tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.358295 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eee7bd7a-506b-45b3-b922-d8792ce358ed tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.370106 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eee7bd7a-506b-45b3-b922-d8792ce358ed tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.371216 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eee7bd7a-506b-45b3-b922-d8792ce358ed tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.371691 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eee7bd7a-506b-45b3-b922-d8792ce358ed tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.371929 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-50fdc3ff-f27a-4190-b0eb-b937bacba108 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.428038 Aug 22 17:11:40.379368 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 58/118] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:11:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:40.408270 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f6ca315c-1ca6-4eaf-9693-cfd953c7cb78 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Calling method '.version_select at 0x7f800a3025e0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:40.412780 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:40.412780 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:40.412780 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f6ca315c-1ca6-4eaf-9693-cfd953c7cb78 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.412780 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f6ca315c-1ca6-4eaf-9693-cfd953c7cb78 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.419947 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f6ca315c-1ca6-4eaf-9693-cfd953c7cb78 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.456019 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f6ca315c-1ca6-4eaf-9693-cfd953c7cb78 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.456738 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f6ca315c-1ca6-4eaf-9693-cfd953c7cb78 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.457210 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f6ca315c-1ca6-4eaf-9693-cfd953c7cb78 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.486346 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f6ca315c-1ca6-4eaf-9693-cfd953c7cb78 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.487172 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f6ca315c-1ca6-4eaf-9693-cfd953c7cb78 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.487914 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f6ca315c-1ca6-4eaf-9693-cfd953c7cb78 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.514177 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f6ca315c-1ca6-4eaf-9693-cfd953c7cb78 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.133155 Aug 22 17:11:40.515759 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 59/119] 10.222.0.96 () {58 vars in 1167 bytes} [Mon Aug 22 17:11:40 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:40.540267 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0efb2b64-eac8-4f58-b890-22c498202844 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Calling method '.version_select at 0x7f800a0cfee0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:40.541637 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:40.541637 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:40.555038 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0efb2b64-eac8-4f58-b890-22c498202844 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.557816 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0efb2b64-eac8-4f58-b890-22c498202844 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.558890 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0efb2b64-eac8-4f58-b890-22c498202844 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.588835 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0efb2b64-eac8-4f58-b890-22c498202844 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.590228 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0efb2b64-eac8-4f58-b890-22c498202844 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.591329 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0efb2b64-eac8-4f58-b890-22c498202844 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.607328 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0efb2b64-eac8-4f58-b890-22c498202844 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.608161 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0efb2b64-eac8-4f58-b890-22c498202844 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.608849 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0efb2b64-eac8-4f58-b890-22c498202844 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.618930 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0efb2b64-eac8-4f58-b890-22c498202844 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.092197 Aug 22 17:11:40.621185 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 60/120] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:11:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:40.631112 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e41c58b1-a679-4208-8051-d21c0f5ddce2 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Calling method '.version_select at 0x7f800a31dd30>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:40.631899 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:40.631899 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:40.633013 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e41c58b1-a679-4208-8051-d21c0f5ddce2 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.633544 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e41c58b1-a679-4208-8051-d21c0f5ddce2 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.634192 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e41c58b1-a679-4208-8051-d21c0f5ddce2 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.652547 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e41c58b1-a679-4208-8051-d21c0f5ddce2 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.653537 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e41c58b1-a679-4208-8051-d21c0f5ddce2 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.654198 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e41c58b1-a679-4208-8051-d21c0f5ddce2 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.661495 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e41c58b1-a679-4208-8051-d21c0f5ddce2 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.033906 Aug 22 17:11:40.675028 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 61/121] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:11:40 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:11:40.680115 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-08ee62e1-ea2b-4bca-94c2-ed654172b036 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Calling method '.version_select at 0x7f800a0cfe50>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:40.681870 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:40.681870 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:40.683440 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-08ee62e1-ea2b-4bca-94c2-ed654172b036 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.684508 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-08ee62e1-ea2b-4bca-94c2-ed654172b036 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.685356 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-08ee62e1-ea2b-4bca-94c2-ed654172b036 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.704577 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-08ee62e1-ea2b-4bca-94c2-ed654172b036 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.027842 Aug 22 17:11:40.706592 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 62/122] 10.222.0.96 () {58 vars in 1179 bytes} [Mon Aug 22 17:11:40 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:40.717531 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-08ee62e1-ea2b-4bca-94c2-ed654172b036 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:40.724622 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-08ee62e1-ea2b-4bca-94c2-ed654172b036 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] 10.222.0.96 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001863 Aug 22 17:11:40.724622 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 63/123] 10.222.0.96 () {56 vars in 886 bytes} [Mon Aug 22 17:11:40 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 22 17:11:40.724622 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fbb455da-7e17-45a7-bf28-af6275c819c8 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Calling method '.version_select at 0x7f800a3d8310>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:40.725433 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:40.725433 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:40.727059 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fbb455da-7e17-45a7-bf28-af6275c819c8 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.727615 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fbb455da-7e17-45a7-bf28-af6275c819c8 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.728089 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fbb455da-7e17-45a7-bf28-af6275c819c8 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.744734 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fbb455da-7e17-45a7-bf28-af6275c819c8 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.745602 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fbb455da-7e17-45a7-bf28-af6275c819c8 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.746831 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fbb455da-7e17-45a7-bf28-af6275c819c8 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.760305 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fbb455da-7e17-45a7-bf28-af6275c819c8 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.761104 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fbb455da-7e17-45a7-bf28-af6275c819c8 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.762972 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fbb455da-7e17-45a7-bf28-af6275c819c8 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.771037 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fbb455da-7e17-45a7-bf28-af6275c819c8 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.050865 Aug 22 17:11:40.778768 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 64/124] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:11:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:40.784122 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-78e089b3-21e3-4fed-9598-e2066b0d810e tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Calling method '.version_select at 0x7f800a0cfa60>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:40.785268 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:40.785268 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:40.786682 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78e089b3-21e3-4fed-9598-e2066b0d810e tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.787378 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78e089b3-21e3-4fed-9598-e2066b0d810e tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.787987 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78e089b3-21e3-4fed-9598-e2066b0d810e tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.808412 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78e089b3-21e3-4fed-9598-e2066b0d810e tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.810405 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78e089b3-21e3-4fed-9598-e2066b0d810e tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.811270 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78e089b3-21e3-4fed-9598-e2066b0d810e tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.827877 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-78e089b3-21e3-4fed-9598-e2066b0d810e tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.042193 Aug 22 17:11:40.830420 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 65/125] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:11:40 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:40.842040 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b3524701-b086-4bb7-8cbb-1e9854464361 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Calling method '.version_select at 0x7f800a3d85e0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:40.842843 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:40.842843 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:40.859537 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b3524701-b086-4bb7-8cbb-1e9854464361 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.859914 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b3524701-b086-4bb7-8cbb-1e9854464361 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.861245 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b3524701-b086-4bb7-8cbb-1e9854464361 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.879520 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b3524701-b086-4bb7-8cbb-1e9854464361 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.880826 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b3524701-b086-4bb7-8cbb-1e9854464361 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.882908 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b3524701-b086-4bb7-8cbb-1e9854464361 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.885596 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-eee7bd7a-506b-45b3-b922-d8792ce358ed tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:40.897677 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-eee7bd7a-506b-45b3-b922-d8792ce358ed tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1342 microversion: 2.1 time: 0.551993 Aug 22 17:11:40.900532 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 61/126] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:40 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1342 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:11:40.904912 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b3524701-b086-4bb7-8cbb-1e9854464361 tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.068852 Aug 22 17:11:40.906522 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 66/127] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:11:40 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:40.930585 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-cb0af5d8-c700-4767-ab58-28b88282d54c tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Calling method '.version_select at 0x7f800a18d790>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:40.931712 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:40.931712 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:40.933179 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb0af5d8-c700-4767-ab58-28b88282d54c tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.934223 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb0af5d8-c700-4767-ab58-28b88282d54c tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.934864 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb0af5d8-c700-4767-ab58-28b88282d54c tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:40.976495 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb0af5d8-c700-4767-ab58-28b88282d54c tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:40.977330 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb0af5d8-c700-4767-ab58-28b88282d54c tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:40.979706 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb0af5d8-c700-4767-ab58-28b88282d54c tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:41.000937 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb0af5d8-c700-4767-ab58-28b88282d54c tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:41.015224 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb0af5d8-c700-4767-ab58-28b88282d54c tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:41.016001 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb0af5d8-c700-4767-ab58-28b88282d54c tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:41.058900 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-cb0af5d8-c700-4767-ab58-28b88282d54c tempest-HypervisorAdminTestJSON-1843712905 tempest-HypervisorAdminTestJSON-1843712905-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.130872 Aug 22 17:11:41.062163 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 62/128] 10.222.0.96 () {58 vars in 1173 bytes} [Mon Aug 22 17:11:40 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:41.174999 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8d6b5e46-a21d-449a-ace3-91c67ff28ba4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:41.177643 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8d6b5e46-a21d-449a-ace3-91c67ff28ba4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:41.182200 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8d6b5e46-a21d-449a-ace3-91c67ff28ba4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:41.182676 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8d6b5e46-a21d-449a-ace3-91c67ff28ba4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:41.183133 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8d6b5e46-a21d-449a-ace3-91c67ff28ba4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:41.184130 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8d6b5e46-a21d-449a-ace3-91c67ff28ba4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:41.184578 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8d6b5e46-a21d-449a-ace3-91c67ff28ba4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:41.184999 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8d6b5e46-a21d-449a-ace3-91c67ff28ba4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:41.397133 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8d6b5e46-a21d-449a-ace3-91c67ff28ba4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:41.410196 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8d6b5e46-a21d-449a-ace3-91c67ff28ba4 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1339 microversion: 2.1 time: 0.238850 Aug 22 17:11:41.425299 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 67/129] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:41 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1339 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:41.950892 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-84b8fe3b-6ae5-454c-ad9a-58840835d1dd tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:41.951726 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-84b8fe3b-6ae5-454c-ad9a-58840835d1dd tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:41.977352 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-84b8fe3b-6ae5-454c-ad9a-58840835d1dd tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:41.978371 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-84b8fe3b-6ae5-454c-ad9a-58840835d1dd tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:41.979632 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-84b8fe3b-6ae5-454c-ad9a-58840835d1dd tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:41.981536 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-84b8fe3b-6ae5-454c-ad9a-58840835d1dd tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:41.982222 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-84b8fe3b-6ae5-454c-ad9a-58840835d1dd tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:41.982914 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-84b8fe3b-6ae5-454c-ad9a-58840835d1dd tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:42.432072 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9dc87495-b5ee-4df9-a085-11422a92a190 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:42.432694 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9dc87495-b5ee-4df9-a085-11422a92a190 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:42.443118 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9dc87495-b5ee-4df9-a085-11422a92a190 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:42.443610 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9dc87495-b5ee-4df9-a085-11422a92a190 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:42.449916 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9dc87495-b5ee-4df9-a085-11422a92a190 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:42.449916 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9dc87495-b5ee-4df9-a085-11422a92a190 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:42.449916 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9dc87495-b5ee-4df9-a085-11422a92a190 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:42.449916 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9dc87495-b5ee-4df9-a085-11422a92a190 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:42.479637 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-84b8fe3b-6ae5-454c-ad9a-58840835d1dd tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:42.488144 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-84b8fe3b-6ae5-454c-ad9a-58840835d1dd tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1342 microversion: 2.1 time: 0.566905 Aug 22 17:11:42.489417 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 63/130] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:41 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1342 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:42.650001 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9dc87495-b5ee-4df9-a085-11422a92a190 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:42.663546 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9dc87495-b5ee-4df9-a085-11422a92a190 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1339 microversion: 2.1 time: 0.235448 Aug 22 17:11:42.665948 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 68/131] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:42 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1339 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:11:42.722570 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8d554e4e-3a63-40ad-b477-98c8d6f7b50a tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-714167932", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "fdc9ccda-2ee0-4687-8e99-c6ce209572f9"}], "security_groups": [{"name": "tempest-securitygroup--741632028"}], "key_name": "tempest-keypair-609065396", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:42.952822 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-8d554e4e-3a63-40ad-b477-98c8d6f7b50a tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] validate_networks() for [('fdc9ccda-2ee0-4687-8e99-c6ce209572f9', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:11:43.766644 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-340450bf-afae-404a-bbdb-6a67c38660b3 req-7114d656-b390-407f-b81a-3544a51936d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337beedf-68a6-4cf9-b6f3-7f451f1cd496", "name": "network-vif-plugged", "status": "completed", "tag": "7d236e6a-9b38-4578-89a7-d101675b8fc0"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:43.811617 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-8d554e4e-3a63-40ad-b477-98c8d6f7b50a tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1a7dc693-d9da-4539-9d1a-d03e896b5bb8) Aug 22 17:11:43.811617 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:43.811617 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:43.811617 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:43.811617 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:43.811617 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:43.811617 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:43.811617 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:43.811617 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:43.811617 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:43.811617 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:11:43.811617 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:11:43.811617 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:11:43.811617 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:11:43.811617 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:11:43.811617 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:11:43.812696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:11:43.812696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:11:43.812696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:11:43.812696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:11:43.812696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:11:43.812696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:11:43.812696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:11:43.812696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:11:43.812696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:11:43.812696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:11:43.812696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:11:43.812696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:43.812696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:43.812696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:11:43.812696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:11:43.812696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:43.812696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:43.812696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:11:43.813657 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:11:43.813657 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:43.813657 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:43.813657 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:11:43.813657 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:11:43.813657 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:43.813657 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:43.813657 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:11:43.813657 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:11:43.813657 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:11:43.813657 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:11:43.813657 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:11:43.813657 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:11:43.813657 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:11:43.813657 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:11:43.813657 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:11:43.813657 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:11:43.813657 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:11:43.814609 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:11:43.814609 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:11:43.814609 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:11:43.814609 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:11:43.814609 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:11:43.814609 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:11:43.814609 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:11:43.814609 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:11:43.814609 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:11:43.814609 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:11:43.814609 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:11:43.814609 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:11:43.814609 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:11:43.814609 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:11:43.814609 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:11:43.815422 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1a7dc693-d9da-4539-9d1a-d03e896b5bb8) Aug 22 17:11:43.815422 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:43.815422 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-8d554e4e-3a63-40ad-b477-98c8d6f7b50a tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:11:43.815422 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8d554e4e-3a63-40ad-b477-98c8d6f7b50a tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Request method failure captured: Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 455 Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7i00XIted51SRgiyV5pAhir8FTEq23YkCIJUz0ya_ROxErxKEnH_Lg59kvaS9UiroD-f6GQRmzIgeDn2uLeWFMJYJ__6lnPnVkQ2uGAAXUl9FSd5SHblMfVv907QYMDRNu-Fy91G6CqDgyc6PinbWYoGdS41dDpH8-Dssg6vayPSNA Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 8322e3f6eb26483d8dcad0662e1ec3ff Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-LiveMigrationTest-1154936269 Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:11:43.816245 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:11:43.817681 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8322e3f6eb26483d8dcad0662e1ec3ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_8322e3f6eb26483d8dcad0662e1ec3ff", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8322e3f6eb26483d8dcad0662e1ec3ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/8322e3f6eb26483d8dcad0662e1ec3ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:11:43.817681 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-LiveMigrationTest-1154936269 Aug 22 17:11:43.817681 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 8322e3f6eb26483d8dcad0662e1ec3ff Aug 22 17:11:43.817681 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-LiveMigrationTest-1154936269 Aug 22 17:11:43.817681 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-LiveMigrationTest-1154936269-project Aug 22 17:11:43.817681 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:11:43.817681 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:11:43.817681 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 53ebbab2867a4b4c9dd3744fedd1c779 Aug 22 17:11:43.817681 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-LiveMigrationTest-1154936269-project Aug 22 17:11:43.817681 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:11:43.818271 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-LiveMigrationTest-server-714167932", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "fdc9ccda-2ee0-4687-8e99-c6ce209572f9"}], "security_groups": [{"name": "tempest-securitygroup--741632028"}], "key_name": "tempest-keypair-609065396", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 22 17:11:43.818271 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:11:43.818271 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:11:43.818271 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:11:43.818271 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-714167932', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'fdc9ccda-2ee0-4687-8e99-c6ce209572f9'}], 'security_groups': [{'name': 'tempest-securitygroup--741632028'}], 'key_name': 'tempest-keypair-609065396', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 22 17:11:43.818271 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:11:43.818271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:43.818271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:43.818271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:43.818271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:43.818271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:43.818271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:43.818271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:43.818991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:11:43.818991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:11:43.818991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:11:43.818991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:11:43.818991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:11:43.818991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:11:43.818991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:11:43.818991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:11:43.818991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:11:43.818991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:11:43.818991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:11:43.818991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:11:43.818991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:11:43.818991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:11:43.818991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:11:43.818991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:11:43.818991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:11:43.818991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:11:43.819919 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:11:43.819919 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:43.819919 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:43.819919 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:11:43.819919 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:11:43.819919 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:43.819919 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:43.819919 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:11:43.819919 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:11:43.819919 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:43.819919 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:43.819919 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:11:43.819919 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:11:43.819919 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:11:43.819919 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:11:43.819919 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:11:43.819919 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:11:43.819919 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:11:43.820833 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:11:43.820833 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:11:43.820833 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:11:43.820833 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:11:43.820833 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:11:43.820833 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:11:43.820833 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:11:43.820833 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:11:43.820833 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:11:43.820833 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:11:43.820833 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:11:43.820833 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:11:43.820833 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:11:43.820833 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:11:43.820833 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:11:43.820833 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:11:43.820833 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:11:43.823065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:11:43.823065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:11:43.823065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:11:43.823065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:11:43.823065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:11:43.823065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:11:43.823065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1a7dc693-d9da-4539-9d1a-d03e896b5bb8) Aug 22 17:11:43.823065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:43.823065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:43.823065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:43.823065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:43.823065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:43.823065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:43.823065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:11:43.823065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:11:43.823065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:11:43.823065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:11:43.827718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:11:43.827718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:43.827718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:43.827718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:43.827718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:43.827718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:43.827718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:43.827718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:43.827718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:11:43.827718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:11:43.827718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:11:43.827718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:43.827718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:43.842678 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-340450bf-afae-404a-bbdb-6a67c38660b3 req-7114d656-b390-407f-b81a-3544a51936d9 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:43.843083 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8d554e4e-3a63-40ad-b477-98c8d6f7b50a tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:11:43.843083 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:11:43.843318 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-340450bf-afae-404a-bbdb-6a67c38660b3 req-7114d656-b390-407f-b81a-3544a51936d9 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:43.843318 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-340450bf-afae-404a-bbdb-6a67c38660b3 req-7114d656-b390-407f-b81a-3544a51936d9 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:43.843445 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8d554e4e-3a63-40ad-b477-98c8d6f7b50a tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.109559 Aug 22 17:11:43.845344 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 64/132] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:11:42 2022] POST /compute/v2.1/servers => generated 214 bytes in 1128 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:11:43.852559 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0e357b10-4c46-4737-b757-b28a59484ee6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:43.853512 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-0e357b10-4c46-4737-b757-b28a59484ee6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:43.857043 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:43.862713 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0e357b10-4c46-4737-b757-b28a59484ee6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:43.863811 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0e357b10-4c46-4737-b757-b28a59484ee6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:43.864433 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0e357b10-4c46-4737-b757-b28a59484ee6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:43.865820 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0e357b10-4c46-4737-b757-b28a59484ee6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:43.866470 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0e357b10-4c46-4737-b757-b28a59484ee6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:43.867078 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0e357b10-4c46-4737-b757-b28a59484ee6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:43.888741 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-340450bf-afae-404a-bbdb-6a67c38660b3 req-7114d656-b390-407f-b81a-3544a51936d9 service nova] Creating event network-vif-plugged:7d236e6a-9b38-4578-89a7-d101675b8fc0 for instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 on n-h2-854030-1 Aug 22 17:11:43.891857 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-340450bf-afae-404a-bbdb-6a67c38660b3 req-7114d656-b390-407f-b81a-3544a51936d9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=123015) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 22 17:11:43.892370 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-340450bf-afae-404a-bbdb-6a67c38660b3 req-7114d656-b390-407f-b81a-3544a51936d9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123015) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 22 17:11:43.893747 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-747f2d94-df41-40ac-89d0-75eb7d642ab5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:43.894298 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-747f2d94-df41-40ac-89d0-75eb7d642ab5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:43.897528 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-747f2d94-df41-40ac-89d0-75eb7d642ab5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:43.898425 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-747f2d94-df41-40ac-89d0-75eb7d642ab5 None None] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:43.899112 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-747f2d94-df41-40ac-89d0-75eb7d642ab5 None None] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:43.902348 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-747f2d94-df41-40ac-89d0-75eb7d642ab5 None None] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:43.921489 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.compute.rpcapi [None req-747f2d94-df41-40ac-89d0-75eb7d642ab5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 22 17:11:43.929506 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-747f2d94-df41-40ac-89d0-75eb7d642ab5 None None] Releasing lock "compute-rpcapi-router" {{(pid=123015) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 22 17:11:43.972150 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-747f2d94-df41-40ac-89d0-75eb7d642ab5 None None] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.779611 Aug 22 17:11:43.973165 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 69/133] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:11:43.978780 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c5220f63-ccf0-494d-a00b-183f3a289032 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:43.981115 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-c5220f63-ccf0-494d-a00b-183f3a289032 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:43.996767 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c5220f63-ccf0-494d-a00b-183f3a289032 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:44.003477 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c5220f63-ccf0-494d-a00b-183f3a289032 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:44.003934 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c5220f63-ccf0-494d-a00b-183f3a289032 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:44.004929 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c5220f63-ccf0-494d-a00b-183f3a289032 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:44.008820 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c5220f63-ccf0-494d-a00b-183f3a289032 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:44.009536 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c5220f63-ccf0-494d-a00b-183f3a289032 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:44.619278 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-0e357b10-4c46-4737-b757-b28a59484ee6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:44.638109 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c5220f63-ccf0-494d-a00b-183f3a289032 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:44.639458 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0e357b10-4c46-4737-b757-b28a59484ee6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1342 microversion: 2.1 time: 0.791996 Aug 22 17:11:44.642146 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 65/134] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:43 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1342 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:44.661260 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c5220f63-ccf0-494d-a00b-183f3a289032 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1339 microversion: 2.1 time: 0.686658 Aug 22 17:11:44.662499 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 70/135] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:43 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1339 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:45.665905 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5b0b8375-4609-46e7-96e3-4123ed80e290 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:45.667176 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5b0b8375-4609-46e7-96e3-4123ed80e290 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:45.685195 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6bff3c31-3660-418c-9d54-b51b6278d42d tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:45.686726 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-6bff3c31-3660-418c-9d54-b51b6278d42d tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:45.705498 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6bff3c31-3660-418c-9d54-b51b6278d42d tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:45.705982 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6bff3c31-3660-418c-9d54-b51b6278d42d tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:45.706522 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6bff3c31-3660-418c-9d54-b51b6278d42d tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:45.706981 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5b0b8375-4609-46e7-96e3-4123ed80e290 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:45.707502 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5b0b8375-4609-46e7-96e3-4123ed80e290 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:45.707934 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5b0b8375-4609-46e7-96e3-4123ed80e290 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:45.708651 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5b0b8375-4609-46e7-96e3-4123ed80e290 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:45.709131 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5b0b8375-4609-46e7-96e3-4123ed80e290 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:45.713816 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5b0b8375-4609-46e7-96e3-4123ed80e290 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:45.714147 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6bff3c31-3660-418c-9d54-b51b6278d42d tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:45.714147 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6bff3c31-3660-418c-9d54-b51b6278d42d tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:45.714588 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6bff3c31-3660-418c-9d54-b51b6278d42d tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:45.930206 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6bff3c31-3660-418c-9d54-b51b6278d42d tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:45.942811 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6bff3c31-3660-418c-9d54-b51b6278d42d tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1339 microversion: 2.1 time: 0.263913 Aug 22 17:11:45.946202 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 71/136] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:45 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1339 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:45.997988 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-12e4b538-f8f9-4c44-ad28-e4b56d77979d req-1ad11a83-b1ef-44bf-9f99-c30a956741d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f52f344-5753-4cab-9879-b33d702cf01a", "name": "network-vif-plugged", "status": "completed", "tag": "6f557d42-01c9-44ea-845d-011d61fc88b4"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:46.012691 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-12e4b538-f8f9-4c44-ad28-e4b56d77979d req-1ad11a83-b1ef-44bf-9f99-c30a956741d2 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:46.013537 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-12e4b538-f8f9-4c44-ad28-e4b56d77979d req-1ad11a83-b1ef-44bf-9f99-c30a956741d2 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:46.014179 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-12e4b538-f8f9-4c44-ad28-e4b56d77979d req-1ad11a83-b1ef-44bf-9f99-c30a956741d2 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:46.050250 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-12e4b538-f8f9-4c44-ad28-e4b56d77979d req-1ad11a83-b1ef-44bf-9f99-c30a956741d2 service nova] Creating event network-vif-plugged:6f557d42-01c9-44ea-845d-011d61fc88b4 for instance 7f52f344-5753-4cab-9879-b33d702cf01a on n-h2-854030-1 Aug 22 17:11:46.062105 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-12e4b538-f8f9-4c44-ad28-e4b56d77979d req-1ad11a83-b1ef-44bf-9f99-c30a956741d2 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071279 Aug 22 17:11:46.063313 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 72/137] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:11:46.100764 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-5b0b8375-4609-46e7-96e3-4123ed80e290 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:46.120951 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5b0b8375-4609-46e7-96e3-4123ed80e290 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1342 microversion: 2.1 time: 0.460669 Aug 22 17:11:46.133252 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 66/138] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:45 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1342 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:46.971959 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-26bd26d6-bf9f-4d92-91df-8c5b9c336a26 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:46.973665 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-26bd26d6-bf9f-4d92-91df-8c5b9c336a26 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:46.991552 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-26bd26d6-bf9f-4d92-91df-8c5b9c336a26 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:46.996902 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-26bd26d6-bf9f-4d92-91df-8c5b9c336a26 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:46.997663 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-26bd26d6-bf9f-4d92-91df-8c5b9c336a26 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:46.998765 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-26bd26d6-bf9f-4d92-91df-8c5b9c336a26 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:47.005390 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-26bd26d6-bf9f-4d92-91df-8c5b9c336a26 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:47.005390 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-26bd26d6-bf9f-4d92-91df-8c5b9c336a26 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:47.142798 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d46e770a-b203-439a-a1bc-3c3079783366 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:47.143479 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-d46e770a-b203-439a-a1bc-3c3079783366 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:47.161353 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d46e770a-b203-439a-a1bc-3c3079783366 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:47.161851 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d46e770a-b203-439a-a1bc-3c3079783366 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:47.162286 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d46e770a-b203-439a-a1bc-3c3079783366 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:47.168994 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d46e770a-b203-439a-a1bc-3c3079783366 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:47.170654 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d46e770a-b203-439a-a1bc-3c3079783366 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:47.171255 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d46e770a-b203-439a-a1bc-3c3079783366 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:47.306194 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-26bd26d6-bf9f-4d92-91df-8c5b9c336a26 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:47.330834 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-26bd26d6-bf9f-4d92-91df-8c5b9c336a26 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1339 microversion: 2.1 time: 0.368255 Aug 22 17:11:47.331832 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 73/139] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:46 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1339 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:47.781109 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-d46e770a-b203-439a-a1bc-3c3079783366 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:47.791388 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d46e770a-b203-439a-a1bc-3c3079783366 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1342 microversion: 2.1 time: 0.652895 Aug 22 17:11:47.792925 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 67/140] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:47 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1342 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:11:48.353071 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6832c249-375a-47c7-97c6-e3240ddba490 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:48.354473 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-6832c249-375a-47c7-97c6-e3240ddba490 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:48.368994 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6832c249-375a-47c7-97c6-e3240ddba490 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:48.370741 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6832c249-375a-47c7-97c6-e3240ddba490 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:48.375286 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6832c249-375a-47c7-97c6-e3240ddba490 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:48.377881 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6832c249-375a-47c7-97c6-e3240ddba490 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:48.380132 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6832c249-375a-47c7-97c6-e3240ddba490 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:48.380760 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6832c249-375a-47c7-97c6-e3240ddba490 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:48.652215 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6832c249-375a-47c7-97c6-e3240ddba490 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:48.661487 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6832c249-375a-47c7-97c6-e3240ddba490 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1489 microversion: 2.1 time: 0.312912 Aug 22 17:11:48.669121 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 74/141] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:48 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1489 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:48.695597 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e6c6ebc8-414b-4ab3-bd5d-8bc219f485cc tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:48.697522 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e6c6ebc8-414b-4ab3-bd5d-8bc219f485cc tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:48.706961 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e6c6ebc8-414b-4ab3-bd5d-8bc219f485cc tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:48.711640 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e6c6ebc8-414b-4ab3-bd5d-8bc219f485cc tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:48.711640 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e6c6ebc8-414b-4ab3-bd5d-8bc219f485cc tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:48.711640 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e6c6ebc8-414b-4ab3-bd5d-8bc219f485cc tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:48.711640 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e6c6ebc8-414b-4ab3-bd5d-8bc219f485cc tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:48.711991 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e6c6ebc8-414b-4ab3-bd5d-8bc219f485cc tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:48.814761 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-19456242-de5f-4b63-be8e-9c9d75814850 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:48.815568 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-19456242-de5f-4b63-be8e-9c9d75814850 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:48.830921 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-19456242-de5f-4b63-be8e-9c9d75814850 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:48.831693 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-19456242-de5f-4b63-be8e-9c9d75814850 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:48.832295 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-19456242-de5f-4b63-be8e-9c9d75814850 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:48.833115 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-19456242-de5f-4b63-be8e-9c9d75814850 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:48.833587 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-19456242-de5f-4b63-be8e-9c9d75814850 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:48.834015 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-19456242-de5f-4b63-be8e-9c9d75814850 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:48.905833 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:49.108173 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-19456242-de5f-4b63-be8e-9c9d75814850 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:49.126739 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-19456242-de5f-4b63-be8e-9c9d75814850 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1491 microversion: 2.1 time: 0.315828 Aug 22 17:11:49.127351 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 75/142] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:48 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1491 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:49.444893 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e6c6ebc8-414b-4ab3-bd5d-8bc219f485cc tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1640 microversion: 2.1 time: 0.755287 Aug 22 17:11:49.444893 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 68/143] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:48 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1640 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:49.566019 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-557c54e7-101c-47aa-aa5e-c820da78bb82 tempest-DeleteServersAdminTestJSON-128876406 tempest-DeleteServersAdminTestJSON-128876406-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:49.571004 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-557c54e7-101c-47aa-aa5e-c820da78bb82 tempest-DeleteServersAdminTestJSON-128876406 tempest-DeleteServersAdminTestJSON-128876406-project-admin] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:49.575064 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-557c54e7-101c-47aa-aa5e-c820da78bb82 tempest-DeleteServersAdminTestJSON-128876406 tempest-DeleteServersAdminTestJSON-128876406-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:49.575834 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-557c54e7-101c-47aa-aa5e-c820da78bb82 tempest-DeleteServersAdminTestJSON-128876406 tempest-DeleteServersAdminTestJSON-128876406-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:49.576473 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-557c54e7-101c-47aa-aa5e-c820da78bb82 tempest-DeleteServersAdminTestJSON-128876406 tempest-DeleteServersAdminTestJSON-128876406-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:49.577366 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-557c54e7-101c-47aa-aa5e-c820da78bb82 tempest-DeleteServersAdminTestJSON-128876406 tempest-DeleteServersAdminTestJSON-128876406-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:49.578066 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-557c54e7-101c-47aa-aa5e-c820da78bb82 tempest-DeleteServersAdminTestJSON-128876406 tempest-DeleteServersAdminTestJSON-128876406-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:49.578503 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-557c54e7-101c-47aa-aa5e-c820da78bb82 tempest-DeleteServersAdminTestJSON-128876406 tempest-DeleteServersAdminTestJSON-128876406-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:49.670559 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f10c88c8-ebfb-465f-8e52-fb805becfee8 tempest-FlavorsV255TestJSON-1371501193 tempest-FlavorsV255TestJSON-1371501193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1607256621", "id": 168699531, "os-flavor-access:is_public": "True"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:49.670827 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-557c54e7-101c-47aa-aa5e-c820da78bb82 tempest-DeleteServersAdminTestJSON-128876406 tempest-DeleteServersAdminTestJSON-128876406-project-admin] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Going to try to terminate instance {{(pid=123015) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:11:49.676489 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:49.676489 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:49.796932 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f10c88c8-ebfb-465f-8e52-fb805becfee8 tempest-FlavorsV255TestJSON-1371501193 tempest-FlavorsV255TestJSON-1371501193-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.352142 Aug 22 17:11:49.801686 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 69/144] 10.222.0.96 () {62 vars in 1188 bytes} [Mon Aug 22 17:11:49 2022] POST /compute/v2.1/flavors => generated 446 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:11:49.818718 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5be27970-f3b5-4b74-9e85-938849a3c13e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:49.819949 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5be27970-f3b5-4b74-9e85-938849a3c13e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:49.840258 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5be27970-f3b5-4b74-9e85-938849a3c13e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:49.840702 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5be27970-f3b5-4b74-9e85-938849a3c13e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:49.841896 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5be27970-f3b5-4b74-9e85-938849a3c13e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:49.845564 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5be27970-f3b5-4b74-9e85-938849a3c13e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:49.846787 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5be27970-f3b5-4b74-9e85-938849a3c13e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:49.850200 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5be27970-f3b5-4b74-9e85-938849a3c13e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:49.877049 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5be27970-f3b5-4b74-9e85-938849a3c13e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Going to try to terminate instance {{(pid=123016) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:11:49.961929 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:50.708423 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-557c54e7-101c-47aa-aa5e-c820da78bb82 tempest-DeleteServersAdminTestJSON-128876406 tempest-DeleteServersAdminTestJSON-128876406-project-admin] 10.222.0.96 "DELETE /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 204 len: 0 microversion: 2.1 time: 1.561179 Aug 22 17:11:50.717600 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 76/145] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:11:49 2022] DELETE /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 0 bytes in 1568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:11:50.817915 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5be27970-f3b5-4b74-9e85-938849a3c13e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "DELETE /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 204 len: 0 microversion: 2.1 time: 1.014047 Aug 22 17:11:50.818558 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 70/146] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:11:49 2022] DELETE /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 0 bytes in 1016 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:11:51.080665 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2ff4abeb-59f0-49e9-af19-498640bb9264 tempest-FlavorsV255TestJSON-472087555 tempest-FlavorsV255TestJSON-472087555-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:51.107165 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2ff4abeb-59f0-49e9-af19-498640bb9264 tempest-FlavorsV255TestJSON-472087555 tempest-FlavorsV255TestJSON-472087555-project] 10.222.0.96 "GET /compute/v2.1/flavors/168699531" status: 200 len: 446 microversion: 2.55 time: 0.387669 Aug 22 17:11:51.113603 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 77/147] 10.222.0.96 () {60 vars in 1196 bytes} [Mon Aug 22 17:11:50 2022] GET /compute/v2.1/flavors/168699531 => generated 446 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:11:51.122163 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d579e711-bfc1-4c24-ab99-75b2d6d01716 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:51.122892 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d579e711-bfc1-4c24-ab99-75b2d6d01716 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:51.150634 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d579e711-bfc1-4c24-ab99-75b2d6d01716 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:51.152018 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d579e711-bfc1-4c24-ab99-75b2d6d01716 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:51.154362 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d579e711-bfc1-4c24-ab99-75b2d6d01716 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:51.158058 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d579e711-bfc1-4c24-ab99-75b2d6d01716 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:51.159502 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d579e711-bfc1-4c24-ab99-75b2d6d01716 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:51.160468 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d579e711-bfc1-4c24-ab99-75b2d6d01716 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:51.279198 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f1269e24-06dd-4649-a937-14b756371827 tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] Action: 'create', calling method: .version_select at 0x7f800a15b4c0>, body: {"keypair": {"name": "tempest-keypair-1962177687", "type": "ssh", "user_id": "69d9f55025c24ed2a065349ece841013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCS5p3fV28NmtAKCBxkO4h/EQ5urLUSqNEGM2sanaKV6FNAG4gb5PNwuTyTkmvI3qatSO7PDHbjC8diG+Fvaj8DpUvf/OB8dRbi8j3QnaESPxN6CPz1NrdmWPDnWmgUYNw=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:51.298442 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-f1269e24-06dd-4649-a937-14b756371827 tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] Getting quotas for project e3116a4c5e6b405db46a2cb8794d724a. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:11:51.303674 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-f1269e24-06dd-4649-a937-14b756371827 tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] Getting quotas for user 639286090e704263bc1a51e9ed17e450 and project e3116a4c5e6b405db46a2cb8794d724a. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:11:51.360774 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d579e711-bfc1-4c24-ab99-75b2d6d01716 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:51.372934 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d579e711-bfc1-4c24-ab99-75b2d6d01716 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1497 microversion: 2.1 time: 0.260709 Aug 22 17:11:51.373963 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 78/148] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:51 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1497 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:51.434347 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f1269e24-06dd-4649-a937-14b756371827 tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.614081 Aug 22 17:11:51.442002 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 71/149] 10.222.0.96 () {62 vars in 1200 bytes} [Mon Aug 22 17:11:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 623 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 22 17:11:51.447851 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d6e0ea14-6eb0-4fe8-a7fd-44ca12398f93 tempest-FlavorsV255TestJSON-1371501193 tempest-FlavorsV255TestJSON-1371501193-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:51.450663 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:51.450663 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:51.452362 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3511c252-d811-437c-9473-279f25818d3e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:51.454128 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-3511c252-d811-437c-9473-279f25818d3e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:51.477872 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3511c252-d811-437c-9473-279f25818d3e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:51.478438 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3511c252-d811-437c-9473-279f25818d3e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:51.479958 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3511c252-d811-437c-9473-279f25818d3e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:51.482383 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3511c252-d811-437c-9473-279f25818d3e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:51.483817 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3511c252-d811-437c-9473-279f25818d3e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:51.484399 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3511c252-d811-437c-9473-279f25818d3e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:51.570362 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d6e0ea14-6eb0-4fe8-a7fd-44ca12398f93 tempest-FlavorsV255TestJSON-1371501193 tempest-FlavorsV255TestJSON-1371501193-project-admin] 10.222.0.96 "PUT /compute/v2.1/flavors/168699531" status: 200 len: 447 microversion: 2.55 time: 0.126421 Aug 22 17:11:51.571058 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 72/150] 10.222.0.96 () {62 vars in 1216 bytes} [Mon Aug 22 17:11:51 2022] PUT /compute/v2.1/flavors/168699531 => generated 447 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:11:51.589850 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9f57c63c-d21b-414c-82cb-73f45bb0d859 tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] Action: 'create', calling method: .version_select at 0x7f800a0ff0d0>, body: {"keypair": {"name": "tempest-keypair-1443803270", "type": "ssh", "user_id": "69d9f55025c24ed2a065349ece841013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvIqL+Bsf4UOKIFBFgVFSX4Sz9nwoVuPfK801R9LzCujdqWZJtFbAuYSnv8IAybXXSzA3j2c0LVmXyvpns0iz9XeY4a7JC4oqKxxsRd4wSNvtuSTfwYZTOKcr4SnaRRFA=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:51.627553 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-9f57c63c-d21b-414c-82cb-73f45bb0d859 tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] Getting quotas for project e3116a4c5e6b405db46a2cb8794d724a. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:11:51.643094 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-9f57c63c-d21b-414c-82cb-73f45bb0d859 tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] Getting quotas for user 639286090e704263bc1a51e9ed17e450 and project e3116a4c5e6b405db46a2cb8794d724a. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:11:51.740214 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9f57c63c-d21b-414c-82cb-73f45bb0d859 tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.158069 Aug 22 17:11:51.745390 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 73/151] 10.222.0.96 () {62 vars in 1200 bytes} [Mon Aug 22 17:11:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 170 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 22 17:11:51.748109 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d3e6e306-30c3-4b86-8fdf-8289a4bd8e5e tempest-FlavorsV255TestJSON-472087555 tempest-FlavorsV255TestJSON-472087555-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:51.780392 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-3511c252-d811-437c-9473-279f25818d3e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:51.784673 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d3e6e306-30c3-4b86-8fdf-8289a4bd8e5e tempest-FlavorsV255TestJSON-472087555 tempest-FlavorsV255TestJSON-472087555-project] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.041945 Aug 22 17:11:51.789602 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 74/152] 10.222.0.96 () {60 vars in 1187 bytes} [Mon Aug 22 17:11:51 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:11:51.790673 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3511c252-d811-437c-9473-279f25818d3e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1495 microversion: 2.1 time: 0.401253 Aug 22 17:11:51.793680 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 79/153] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:51 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1495 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:51.796389 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-eefad0d8-e223-4224-a2ac-7d7af002a2f4 tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] Calling method '.version_select at 0x7f800a0e4dc0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:51.806247 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-eefad0d8-e223-4224-a2ac-7d7af002a2f4 tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] 10.222.0.96 "GET /compute/v2.1/os-keypairs/tempest-keypair-1962177687?user_id=69d9f55025c24ed2a065349ece841013" status: 200 len: 512 microversion: 2.10 time: 0.015087 Aug 22 17:11:51.808022 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 75/154] 10.222.0.96 () {60 vars in 1340 bytes} [Mon Aug 22 17:11:51 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1962177687?user_id=69d9f55025c24ed2a065349ece841013 => generated 512 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:11:51.814938 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-04503d85-13f7-4159-b367-ba2ae571df95 tempest-FlavorsV255TestJSON-472087555 tempest-FlavorsV255TestJSON-472087555-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:51.840141 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-04503d85-13f7-4159-b367-ba2ae571df95 tempest-FlavorsV255TestJSON-472087555 tempest-FlavorsV255TestJSON-472087555-project] 10.222.0.96 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.029022 Aug 22 17:11:51.842602 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 76/155] 10.222.0.96 () {60 vars in 1166 bytes} [Mon Aug 22 17:11:51 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:11:51.847861 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0acd24ae-d677-4b12-98ae-2aef4863621e tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] Action: 'create', calling method: .version_select at 0x7f800a193b80>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-783237088", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGU3jg+dJ2j3jbmzOrlShJkX2DFysnEGGkbwDUVkKZd3t+NTen3XYfclFZS62iBJrTiunxuFaq5KSdBKqRs5nZmu+yBtt0+J74PC2MqHf+nDznecYb2ACn5fs+nvzzinMw=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:51.889261 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-0acd24ae-d677-4b12-98ae-2aef4863621e tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] Getting quotas for project e3116a4c5e6b405db46a2cb8794d724a. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:11:51.896864 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-0acd24ae-d677-4b12-98ae-2aef4863621e tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] Getting quotas for user 639286090e704263bc1a51e9ed17e450 and project e3116a4c5e6b405db46a2cb8794d724a. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:11:51.993773 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e65fe275-cd74-4edd-b387-9908f0fcf2bf tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Calling method '.version_select at 0x7f800a03d1f0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:51.993773 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:51.993773 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:51.993773 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e65fe275-cd74-4edd-b387-9908f0fcf2bf tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:51.993773 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e65fe275-cd74-4edd-b387-9908f0fcf2bf tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:51.994405 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e65fe275-cd74-4edd-b387-9908f0fcf2bf tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:52.017993 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e65fe275-cd74-4edd-b387-9908f0fcf2bf tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:52.018998 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e65fe275-cd74-4edd-b387-9908f0fcf2bf tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:52.019792 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e65fe275-cd74-4edd-b387-9908f0fcf2bf tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:52.026711 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0acd24ae-d677-4b12-98ae-2aef4863621e tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.181430 Aug 22 17:11:52.027367 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 77/156] 10.222.0.96 () {62 vars in 1200 bytes} [Mon Aug 22 17:11:51 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 184 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 22 17:11:52.034026 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-df134aaa-bc7d-4789-8c3a-4f5e3410b138 tempest-FlavorsV255TestJSON-1371501193 tempest-FlavorsV255TestJSON-1371501193-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:52.034820 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:52.034820 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:52.047202 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e65fe275-cd74-4edd-b387-9908f0fcf2bf tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:52.048684 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e65fe275-cd74-4edd-b387-9908f0fcf2bf tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:52.049886 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e65fe275-cd74-4edd-b387-9908f0fcf2bf tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:52.058502 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e65fe275-cd74-4edd-b387-9908f0fcf2bf tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.263640 Aug 22 17:11:52.059223 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 80/157] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:11:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:52.067359 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-41cc5741-8bbb-43ea-a18c-c13ae2763de8 tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] Calling method '.version_select at 0x7f800a03ddc0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:52.073568 n-d-854030-1 devstack@n-api.service[123015]: WARNING oslo_db.sqlalchemy.utils [None req-41cc5741-8bbb-43ea-a18c-c13ae2763de8 tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 22 17:11:52.105044 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-41cc5741-8bbb-43ea-a18c-c13ae2763de8 tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] 10.222.0.96 "GET /compute/v2.1/os-keypairs?user_id=69d9f55025c24ed2a065349ece841013" status: 200 len: 726 microversion: 2.10 time: 0.043312 Aug 22 17:11:52.106988 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 81/158] 10.222.0.96 () {60 vars in 1259 bytes} [Mon Aug 22 17:11:52 2022] GET /compute/v2.1/os-keypairs?user_id=69d9f55025c24ed2a065349ece841013 => generated 726 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:11:52.116117 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-47fcceb8-0d46-4a09-886c-c2a8c4a4a361 tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Calling method '.version_select at 0x7f8009fb6700>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:52.119843 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:52.119843 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:52.120166 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-47fcceb8-0d46-4a09-886c-c2a8c4a4a361 tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:52.121171 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-47fcceb8-0d46-4a09-886c-c2a8c4a4a361 tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:52.122204 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-47fcceb8-0d46-4a09-886c-c2a8c4a4a361 tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:52.138585 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-df134aaa-bc7d-4789-8c3a-4f5e3410b138 tempest-FlavorsV255TestJSON-1371501193 tempest-FlavorsV255TestJSON-1371501193-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/168699531" status: 202 len: 0 microversion: 2.55 time: 0.109992 Aug 22 17:11:52.139773 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 78/159] 10.222.0.96 () {60 vars in 1199 bytes} [Mon Aug 22 17:11:52 2022] DELETE /compute/v2.1/flavors/168699531 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:11:52.145493 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-662af168-7300-4d3c-86e1-e54644865335 tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] Calling method '.version_select at 0x7f800a18ddc0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:52.153365 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-47fcceb8-0d46-4a09-886c-c2a8c4a4a361 tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:52.153365 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-47fcceb8-0d46-4a09-886c-c2a8c4a4a361 tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:52.154325 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-47fcceb8-0d46-4a09-886c-c2a8c4a4a361 tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:52.200826 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-47fcceb8-0d46-4a09-886c-c2a8c4a4a361 tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:52.201308 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-47fcceb8-0d46-4a09-886c-c2a8c4a4a361 tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:52.201747 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-47fcceb8-0d46-4a09-886c-c2a8c4a4a361 tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:52.210502 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-47fcceb8-0d46-4a09-886c-c2a8c4a4a361 tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/n-h2-854030-1/servers" status: 200 len: 275 microversion: 2.1 time: 0.101738 Aug 22 17:11:52.216049 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 82/160] 10.222.0.96 () {58 vars in 1212 bytes} [Mon Aug 22 17:11:52 2022] GET /compute/v2.1/os-hypervisors/n-h2-854030-1/servers => generated 275 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:52.217977 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8c6130f7-60c8-4e10-87c0-d145806a66bb tempest-FlavorsV255TestJSON-1371501193 tempest-FlavorsV255TestJSON-1371501193-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:52.237423 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-662af168-7300-4d3c-86e1-e54644865335 tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-783237088" status: 204 len: 0 microversion: 2.10 time: 0.096234 Aug 22 17:11:52.238675 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 79/161] 10.222.0.96 () {60 vars in 1322 bytes} [Mon Aug 22 17:11:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-783237088 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 17:11:52.244116 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0f7c8ba2-9866-4b13-84c5-df8fd3a0105a tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Calling method '.version_select at 0x7f800a16e820>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:52.245219 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:52.245219 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:52.249263 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8c6130f7-60c8-4e10-87c0-d145806a66bb tempest-FlavorsV255TestJSON-1371501193 tempest-FlavorsV255TestJSON-1371501193-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.033755 Aug 22 17:11:52.249374 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0f7c8ba2-9866-4b13-84c5-df8fd3a0105a tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:52.249458 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 83/162] 10.222.0.96 () {60 vars in 1187 bytes} [Mon Aug 22 17:11:52 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:11:52.249528 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0f7c8ba2-9866-4b13-84c5-df8fd3a0105a tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:52.249528 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0f7c8ba2-9866-4b13-84c5-df8fd3a0105a tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:52.251664 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e7b1babb-1663-44fb-89e6-877c9c7f63da tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] Calling method '.version_select at 0x7f8009f4cee0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:52.266792 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=94,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:52.285385 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0f7c8ba2-9866-4b13-84c5-df8fd3a0105a tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:52.286162 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0f7c8ba2-9866-4b13-84c5-df8fd3a0105a tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:52.286768 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0f7c8ba2-9866-4b13-84c5-df8fd3a0105a tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:52.301533 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0f7c8ba2-9866-4b13-84c5-df8fd3a0105a tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:52.302255 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0f7c8ba2-9866-4b13-84c5-df8fd3a0105a tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:52.302849 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0f7c8ba2-9866-4b13-84c5-df8fd3a0105a tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:52.309963 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0f7c8ba2-9866-4b13-84c5-df8fd3a0105a tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.069925 Aug 22 17:11:52.311157 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 80/163] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:11:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:52.320847 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8c5fb1d2-fafa-4312-bc83-2fb07a44c521 tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Calling method '.version_select at 0x7f800a16e940>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:52.321956 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:52.321956 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:52.323906 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c5fb1d2-fafa-4312-bc83-2fb07a44c521 tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:52.324510 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c5fb1d2-fafa-4312-bc83-2fb07a44c521 tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:52.325200 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c5fb1d2-fafa-4312-bc83-2fb07a44c521 tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:52.359904 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c5fb1d2-fafa-4312-bc83-2fb07a44c521 tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:52.360751 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c5fb1d2-fafa-4312-bc83-2fb07a44c521 tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:52.360876 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c5fb1d2-fafa-4312-bc83-2fb07a44c521 tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:52.369016 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8c5fb1d2-fafa-4312-bc83-2fb07a44c521 tempest-HypervisorAdminUnderV252Test-2018612266 tempest-HypervisorAdminUnderV252Test-2018612266-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/n-h2-854030-1/search" status: 200 len: 104 microversion: 2.1 time: 0.051831 Aug 22 17:11:52.376257 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 81/164] 10.222.0.96 () {58 vars in 1209 bytes} [Mon Aug 22 17:11:52 2022] GET /compute/v2.1/os-hypervisors/n-h2-854030-1/search => generated 104 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:52.395460 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9ce9cc4f-bb99-4c01-bffe-7991c3c3bced tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:52.396205 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-9ce9cc4f-bb99-4c01-bffe-7991c3c3bced tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:52.406264 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9ce9cc4f-bb99-4c01-bffe-7991c3c3bced tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:52.406761 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9ce9cc4f-bb99-4c01-bffe-7991c3c3bced tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:52.407196 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9ce9cc4f-bb99-4c01-bffe-7991c3c3bced tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:52.408507 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9ce9cc4f-bb99-4c01-bffe-7991c3c3bced tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:52.408507 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9ce9cc4f-bb99-4c01-bffe-7991c3c3bced tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:52.408839 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9ce9cc4f-bb99-4c01-bffe-7991c3c3bced tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:52.433099 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e7b1babb-1663-44fb-89e6-877c9c7f63da tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1443803270?user_id=69d9f55025c24ed2a065349ece841013" status: 204 len: 0 microversion: 2.10 time: 0.185463 Aug 22 17:11:52.433982 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 84/165] 10.222.0.96 () {60 vars in 1343 bytes} [Mon Aug 22 17:11:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1443803270?user_id=69d9f55025c24ed2a065349ece841013 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 17:11:52.445971 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-bf6da3e0-0cdd-4593-8c86-6d42db15c545 tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] Calling method '.version_select at 0x7f8009efd1f0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:52.567638 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-bf6da3e0-0cdd-4593-8c86-6d42db15c545 tempest-KeyPairsV210TestJSON-822130621 tempest-KeyPairsV210TestJSON-822130621-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1962177687?user_id=69d9f55025c24ed2a065349ece841013" status: 204 len: 0 microversion: 2.10 time: 0.128310 Aug 22 17:11:52.568745 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 85/166] 10.222.0.96 () {60 vars in 1343 bytes} [Mon Aug 22 17:11:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1962177687?user_id=69d9f55025c24ed2a065349ece841013 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 17:11:52.643414 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9ce9cc4f-bb99-4c01-bffe-7991c3c3bced tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:52.653029 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9ce9cc4f-bb99-4c01-bffe-7991c3c3bced tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1497 microversion: 2.1 time: 0.261543 Aug 22 17:11:52.653656 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 82/167] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:52 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1497 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:52.815858 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6b5cde98-7df2-4338-967f-a3bccb55cea1 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:52.816801 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-6b5cde98-7df2-4338-967f-a3bccb55cea1 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:52.827214 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6b5cde98-7df2-4338-967f-a3bccb55cea1 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:52.827704 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6b5cde98-7df2-4338-967f-a3bccb55cea1 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:52.828421 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6b5cde98-7df2-4338-967f-a3bccb55cea1 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:52.829980 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6b5cde98-7df2-4338-967f-a3bccb55cea1 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:52.830449 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6b5cde98-7df2-4338-967f-a3bccb55cea1 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:52.830880 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6b5cde98-7df2-4338-967f-a3bccb55cea1 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:53.022889 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6b5cde98-7df2-4338-967f-a3bccb55cea1 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:53.032269 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6b5cde98-7df2-4338-967f-a3bccb55cea1 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1495 microversion: 2.1 time: 0.219846 Aug 22 17:11:53.048735 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 86/168] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:52 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1495 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:53.677786 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d4a4da22-fff0-40b3-a960-0edb0bf02244 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:53.679363 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-d4a4da22-fff0-40b3-a960-0edb0bf02244 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:53.690305 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d4a4da22-fff0-40b3-a960-0edb0bf02244 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:53.691165 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d4a4da22-fff0-40b3-a960-0edb0bf02244 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:53.692101 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d4a4da22-fff0-40b3-a960-0edb0bf02244 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:53.693655 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d4a4da22-fff0-40b3-a960-0edb0bf02244 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:53.694788 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d4a4da22-fff0-40b3-a960-0edb0bf02244 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:53.696106 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d4a4da22-fff0-40b3-a960-0edb0bf02244 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:53.985309 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:54.058355 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b03957d6-5d1b-4b8c-80f9-3c9026e16313 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:54.058983 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b03957d6-5d1b-4b8c-80f9-3c9026e16313 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:54.062317 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:54.070100 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b03957d6-5d1b-4b8c-80f9-3c9026e16313 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:54.077430 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b03957d6-5d1b-4b8c-80f9-3c9026e16313 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:54.077430 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b03957d6-5d1b-4b8c-80f9-3c9026e16313 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:54.077430 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b03957d6-5d1b-4b8c-80f9-3c9026e16313 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:54.077430 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b03957d6-5d1b-4b8c-80f9-3c9026e16313 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:54.077958 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b03957d6-5d1b-4b8c-80f9-3c9026e16313 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:54.456765 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-d4a4da22-fff0-40b3-a960-0edb0bf02244 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:54.477495 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d4a4da22-fff0-40b3-a960-0edb0bf02244 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1455 microversion: 2.1 time: 0.806034 Aug 22 17:11:54.481623 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 83/169] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:53 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1455 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:54.487621 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-3ae2d37d-1328-476c-b694-dd2776d207d7 req-6b8b77f5-bfe5-4716-bda2-ffc28dcd46f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337beedf-68a6-4cf9-b6f3-7f451f1cd496", "name": "network-vif-deleted", "tag": "7d236e6a-9b38-4578-89a7-d101675b8fc0"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:54.497631 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:11:54.527480 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-3ae2d37d-1328-476c-b694-dd2776d207d7 req-6b8b77f5-bfe5-4716-bda2-ffc28dcd46f8 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:54.527480 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-3ae2d37d-1328-476c-b694-dd2776d207d7 req-6b8b77f5-bfe5-4716-bda2-ffc28dcd46f8 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:54.527480 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-3ae2d37d-1328-476c-b694-dd2776d207d7 req-6b8b77f5-bfe5-4716-bda2-ffc28dcd46f8 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:54.552685 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-3ae2d37d-1328-476c-b694-dd2776d207d7 req-6b8b77f5-bfe5-4716-bda2-ffc28dcd46f8 service nova] Creating event network-vif-deleted:7d236e6a-9b38-4578-89a7-d101675b8fc0 for instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 on n-h2-854030-1 Aug 22 17:11:54.560378 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-3ae2d37d-1328-476c-b694-dd2776d207d7 req-6b8b77f5-bfe5-4716-bda2-ffc28dcd46f8 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077024 Aug 22 17:11:54.561539 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 84/170] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:54.630992 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b03957d6-5d1b-4b8c-80f9-3c9026e16313 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:54.643155 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b03957d6-5d1b-4b8c-80f9-3c9026e16313 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1495 microversion: 2.1 time: 0.586843 Aug 22 17:11:54.649395 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 87/171] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:54 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1495 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:55.459811 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-30d399a0-b8c9-489d-9b1b-6c1b57cf0a27 req-4f189671-ac09-4ec3-a245-77116865aaeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f52f344-5753-4cab-9879-b33d702cf01a", "name": "network-vif-deleted", "tag": "6f557d42-01c9-44ea-845d-011d61fc88b4"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:55.493585 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-30d399a0-b8c9-489d-9b1b-6c1b57cf0a27 req-4f189671-ac09-4ec3-a245-77116865aaeb service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:55.494547 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-30d399a0-b8c9-489d-9b1b-6c1b57cf0a27 req-4f189671-ac09-4ec3-a245-77116865aaeb service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:55.503285 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-30d399a0-b8c9-489d-9b1b-6c1b57cf0a27 req-4f189671-ac09-4ec3-a245-77116865aaeb service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:55.504220 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-45067139-8668-4302-8ba6-446c92afb181 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:55.504846 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-45067139-8668-4302-8ba6-446c92afb181 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:55.521199 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-45067139-8668-4302-8ba6-446c92afb181 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:55.522156 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-45067139-8668-4302-8ba6-446c92afb181 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:55.522796 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-45067139-8668-4302-8ba6-446c92afb181 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:55.524449 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-45067139-8668-4302-8ba6-446c92afb181 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:55.525183 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-45067139-8668-4302-8ba6-446c92afb181 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:55.525762 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-45067139-8668-4302-8ba6-446c92afb181 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:55.546288 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-30d399a0-b8c9-489d-9b1b-6c1b57cf0a27 req-4f189671-ac09-4ec3-a245-77116865aaeb service nova] Creating event network-vif-deleted:6f557d42-01c9-44ea-845d-011d61fc88b4 for instance 7f52f344-5753-4cab-9879-b33d702cf01a on n-h2-854030-1 Aug 22 17:11:55.570370 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-30d399a0-b8c9-489d-9b1b-6c1b57cf0a27 req-4f189671-ac09-4ec3-a245-77116865aaeb service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120814 Aug 22 17:11:55.574320 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 85/172] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:55.666441 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-dd96a839-9102-4ea7-9bb5-98fc76f05ccd tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:55.667392 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-dd96a839-9102-4ea7-9bb5-98fc76f05ccd tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:55.698461 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dd96a839-9102-4ea7-9bb5-98fc76f05ccd tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:55.699447 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dd96a839-9102-4ea7-9bb5-98fc76f05ccd tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:55.699911 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dd96a839-9102-4ea7-9bb5-98fc76f05ccd tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:55.700757 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dd96a839-9102-4ea7-9bb5-98fc76f05ccd tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:55.701254 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dd96a839-9102-4ea7-9bb5-98fc76f05ccd tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:55.710767 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dd96a839-9102-4ea7-9bb5-98fc76f05ccd tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:55.935501 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-dd96a839-9102-4ea7-9bb5-98fc76f05ccd tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64571f795f2748fcb657ca3f9031f35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1897a03823894ee8a981bd1e47cb5050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:55.956953 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-dd96a839-9102-4ea7-9bb5-98fc76f05ccd tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 200 len: 1324 microversion: 2.1 time: 0.296705 Aug 22 17:11:55.957835 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 86/173] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:55 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 1324 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:11:56.037577 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-45067139-8668-4302-8ba6-446c92afb181 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:56.038338 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-45067139-8668-4302-8ba6-446c92afb181 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:56.038915 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-45067139-8668-4302-8ba6-446c92afb181 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:56.039522 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-45067139-8668-4302-8ba6-446c92afb181 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lazy-loading 'fault' on Instance uuid 337beedf-68a6-4cf9-b6f3-7f451f1cd496 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:11:56.184771 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-45067139-8668-4302-8ba6-446c92afb181 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:56.194789 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-45067139-8668-4302-8ba6-446c92afb181 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 200 len: 1332 microversion: 2.1 time: 0.697102 Aug 22 17:11:56.204664 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 88/174] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:55 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 1332 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:56.979428 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b7d3143b-3eaa-466e-a7e2-042bcc0998d3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:56.980045 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b7d3143b-3eaa-466e-a7e2-042bcc0998d3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:56.989431 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b7d3143b-3eaa-466e-a7e2-042bcc0998d3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:56.999966 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b7d3143b-3eaa-466e-a7e2-042bcc0998d3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:56.999966 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b7d3143b-3eaa-466e-a7e2-042bcc0998d3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:56.999966 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b7d3143b-3eaa-466e-a7e2-042bcc0998d3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:56.999966 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b7d3143b-3eaa-466e-a7e2-042bcc0998d3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:57.000360 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b7d3143b-3eaa-466e-a7e2-042bcc0998d3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:57.019673 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-b7d3143b-3eaa-466e-a7e2-042bcc0998d3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] HTTP exception thrown: Instance 7f52f344-5753-4cab-9879-b33d702cf01a could not be found. Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b7d3143b-3eaa-466e-a7e2-042bcc0998d3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Request method failure captured: Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a HTTP/1.1 Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7irGxtsuZxycKZ6cf92UATzDhEuHQoeRVqLof1iEbSL3xE-ASKIXeQab0UwmrFK0HllZ9da6dEzfOIa2S6jJsJMeOqyKmwuLLJFCmdg88PtMJajCZ9_rn936MVYJNxFp6WOSsURLmvLbwywbmkpXfybUTDksIUQIpj08csKUln-BFk Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 1897a03823894ee8a981bd1e47cb5050 Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-AggregatesAdminTestJSON-1924046837 Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:11:57.021709 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:11:57.022924 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1897a03823894ee8a981bd1e47cb5050"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_1897a03823894ee8a981bd1e47cb5050", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1897a03823894ee8a981bd1e47cb5050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/1897a03823894ee8a981bd1e47cb5050"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:11:57.022924 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-AggregatesAdminTestJSON-1924046837 Aug 22 17:11:57.022924 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 1897a03823894ee8a981bd1e47cb5050 Aug 22 17:11:57.022924 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1924046837 Aug 22 17:11:57.022924 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-AggregatesAdminTestJSON-1924046837-project Aug 22 17:11:57.022924 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:11:57.022924 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:11:57.022924 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 64571f795f2748fcb657ca3f9031f35e Aug 22 17:11:57.022924 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-AggregatesAdminTestJSON-1924046837-project Aug 22 17:11:57.022924 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:11:57.022924 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance 7f52f344-5753-4cab-9879-b33d702cf01a could not be found. Aug 22 17:11:57.022924 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '7f52f344-5753-4cab-9879-b33d702cf01a'} Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f52f344-5753-4cab-9879-b33d702cf01a could not be found. Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:11:57.023808 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:57.026394 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:57.026394 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:11:57.026394 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:11:57.026394 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:11:57.026394 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:11:57.026394 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:11:57.026394 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:11:57.026394 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f52f344-5753-4cab-9879-b33d702cf01a could not be found. Aug 22 17:11:57.026394 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:57.026394 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:57.026394 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:57.026394 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:57.026394 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:57.026394 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:57.026394 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:11:57.026394 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:11:57.026394 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f52f344-5753-4cab-9879-b33d702cf01a could not be found. Aug 22 17:11:57.026394 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:57.028848 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b7d3143b-3eaa-466e-a7e2-042bcc0998d3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Returning 404 to user: Instance 7f52f344-5753-4cab-9879-b33d702cf01a could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:11:57.028848 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b7d3143b-3eaa-466e-a7e2-042bcc0998d3 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 404 len: 111 microversion: 2.1 time: 0.048016 Aug 22 17:11:57.028848 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 87/175] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:56 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:11:57.035809 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-85c810a5-4d59-4e32-a907-80350d6fb421 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854030-1"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:57.051382 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:57.051382 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:57.094147 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-85c810a5-4d59-4e32-a907-80350d6fb421 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:57.094962 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-85c810a5-4d59-4e32-a907-80350d6fb421 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:57.096951 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-85c810a5-4d59-4e32-a907-80350d6fb421 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:57.239640 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e19e2bd2-f461-48bd-b170-cff33c89647b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:57.239640 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e19e2bd2-f461-48bd-b170-cff33c89647b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:57.248107 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e19e2bd2-f461-48bd-b170-cff33c89647b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:57.248937 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e19e2bd2-f461-48bd-b170-cff33c89647b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:57.249767 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e19e2bd2-f461-48bd-b170-cff33c89647b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:57.250821 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e19e2bd2-f461-48bd-b170-cff33c89647b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:57.251437 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e19e2bd2-f461-48bd-b170-cff33c89647b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:57.252072 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e19e2bd2-f461-48bd-b170-cff33c89647b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:57.277558 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-e19e2bd2-f461-48bd-b170-cff33c89647b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] HTTP exception thrown: Instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 could not be found. Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e19e2bd2-f461-48bd-b170-cff33c89647b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Request method failure captured: Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 HTTP/1.1 Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7irNrrRU2r6Naw6eycAJSqnAryJKahZl1ebo5v7zfl7mihEuf4-GwljgQje3Wd5x5oSdyYfISxabKBFi5xYcp5dipCCWoLDNek0LCzib4l5jekbxlrtk8SdlH5-9Znt_2Hv4j1QibLvuQiGvGYB63HjMVq2sx9sHKfSnp83LYS1o3k Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 7d39044d6ce2411fbecee39e30eb5b6e Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1793908082 Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:11:57.281792 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:11:57.296037 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7d39044d6ce2411fbecee39e30eb5b6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7d39044d6ce2411fbecee39e30eb5b6e", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7d39044d6ce2411fbecee39e30eb5b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7d39044d6ce2411fbecee39e30eb5b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:11:57.296037 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-DeleteServersAdminTestJSON-1793908082 Aug 22 17:11:57.296037 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 7d39044d6ce2411fbecee39e30eb5b6e Aug 22 17:11:57.296037 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1793908082 Aug 22 17:11:57.296037 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-DeleteServersAdminTestJSON-1793908082-project Aug 22 17:11:57.296037 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:11:57.296037 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:11:57.296037 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 25b8f088a9d54406b1d670d7f8feecd9 Aug 22 17:11:57.296037 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-DeleteServersAdminTestJSON-1793908082-project Aug 22 17:11:57.296037 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:11:57.296037 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 could not be found. Aug 22 17:11:57.296037 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '337beedf-68a6-4cf9-b6f3-7f451f1cd496'} Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 could not be found. Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:11:57.296729 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:11:57.297794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:11:57.297794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:11:57.297794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:11:57.297794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:11:57.297794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:11:57.297794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:11:57.297794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:11:57.297794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 could not be found. Aug 22 17:11:57.297794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:57.297794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:11:57.297794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:57.297794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:11:57.297794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:11:57.297794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:11:57.297794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:11:57.297794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:11:57.297794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 could not be found. Aug 22 17:11:57.297794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:11:57.298738 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e19e2bd2-f461-48bd-b170-cff33c89647b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Returning 404 to user: Instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:11:57.298738 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e19e2bd2-f461-48bd-b170-cff33c89647b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 404 len: 111 microversion: 2.1 time: 0.050277 Aug 22 17:11:57.298738 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 88/176] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:57 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:11:57.733457 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d46518e7-a70d-4ec5-b193-1c090bb249f0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-281618336", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:57.854300 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-d46518e7-a70d-4ec5-b193-1c090bb249f0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] validate_networks() for None {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:11:58.273957 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-d46518e7-a70d-4ec5-b193-1c090bb249f0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:11:58.274618 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-d46518e7-a70d-4ec5-b193-1c090bb249f0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:11:58.274877 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-d46518e7-a70d-4ec5-b193-1c090bb249f0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:11:58.275546 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-d46518e7-a70d-4ec5-b193-1c090bb249f0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:11:58.275962 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-d46518e7-a70d-4ec5-b193-1c090bb249f0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:11:58.286118 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d46518e7-a70d-4ec5-b193-1c090bb249f0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:58.286905 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d46518e7-a70d-4ec5-b193-1c090bb249f0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:58.287771 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d46518e7-a70d-4ec5-b193-1c090bb249f0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:58.288741 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d46518e7-a70d-4ec5-b193-1c090bb249f0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:58.289317 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d46518e7-a70d-4ec5-b193-1c090bb249f0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:58.290014 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d46518e7-a70d-4ec5-b193-1c090bb249f0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:58.310886 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-d46518e7-a70d-4ec5-b193-1c090bb249f0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Getting quotas for project 7d39044d6ce2411fbecee39e30eb5b6e. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:11:58.317041 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-d46518e7-a70d-4ec5-b193-1c090bb249f0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Getting quotas for user 25b8f088a9d54406b1d670d7f8feecd9 and project 7d39044d6ce2411fbecee39e30eb5b6e. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:11:58.337184 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-d46518e7-a70d-4ec5-b193-1c090bb249f0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Going to run 1 instances... {{(pid=123016) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:11:58.340611 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-d46518e7-a70d-4ec5-b193-1c090bb249f0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:11:58.351508 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-85c810a5-4d59-4e32-a907-80350d6fb421 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 299 microversion: 2.1 time: 1.319686 Aug 22 17:11:58.356485 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 89/177] 10.222.0.96 () {60 vars in 1191 bytes} [Mon Aug 22 17:11:57 2022] POST /compute/v2.1/os-aggregates/2/action => generated 299 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:58.369015 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9e6620bd-5879-4735-b935-5faba37c393d tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:58.375113 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:58.375113 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:58.519223 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9e6620bd-5879-4735-b935-5faba37c393d tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.154733 Aug 22 17:11:58.519546 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d46518e7-a70d-4ec5-b193-1c090bb249f0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790149 Aug 22 17:11:58.523110 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 90/178] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:11:58 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 22 17:11:58.530179 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 89/179] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:11:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:11:58.541015 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d58111fa-cdbd-4624-8b45-7a87562e968d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:58.542465 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d58111fa-cdbd-4624-8b45-7a87562e968d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:58.569285 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5963a8ac-7ee9-4494-93ab-00d6984dcb9f tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1581371838"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:58.581028 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:58.581028 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:58.582427 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.aggregate [None req-5963a8ac-7ee9-4494-93ab-00d6984dcb9f tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Generated uuid 7cb12469-9968-451e-b3a0-02e984935e91 for aggregate {{(pid=123016) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:11:58.679867 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d58111fa-cdbd-4624-8b45-7a87562e968d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:58.689559 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d58111fa-cdbd-4624-8b45-7a87562e968d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1219 microversion: 2.1 time: 0.158602 Aug 22 17:11:58.691082 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 91/180] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:58 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1219 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:11:58.766232 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5963a8ac-7ee9-4494-93ab-00d6984dcb9f tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.227812 Aug 22 17:11:58.766842 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 90/181] 10.222.0.96 () {60 vars in 1164 bytes} [Mon Aug 22 17:11:58 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:58.779711 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-33ff398a-936a-4f30-8bba-709fefbdf8e2 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854030-1"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:58.782431 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:58.782431 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:58.797980 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-33ff398a-936a-4f30-8bba-709fefbdf8e2 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:58.799148 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-33ff398a-936a-4f30-8bba-709fefbdf8e2 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:58.800024 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-33ff398a-936a-4f30-8bba-709fefbdf8e2 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:59.143347 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-33ff398a-936a-4f30-8bba-709fefbdf8e2 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.368176 Aug 22 17:11:59.144164 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 92/182] 10.222.0.96 () {60 vars in 1191 bytes} [Mon Aug 22 17:11:58 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:59.156877 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-71a3c701-4b91-4c6e-8000-11f9437b76c1 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:59.158478 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:59.158478 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:59.174706 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-71a3c701-4b91-4c6e-8000-11f9437b76c1 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 242 microversion: 2.1 time: 0.022449 Aug 22 17:11:59.191137 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8b35d943-1896-447a-ade8-0e4d28f4a97e tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854030-1"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:59.194341 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 91/183] 10.222.0.96 () {58 vars in 1149 bytes} [Mon Aug 22 17:11:59 2022] GET /compute/v2.1/os-aggregates/3 => generated 242 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:59.194824 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:59.194824 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:11:59.206590 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8b35d943-1896-447a-ade8-0e4d28f4a97e tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:11:59.207399 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8b35d943-1896-447a-ade8-0e4d28f4a97e tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:11:59.208014 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8b35d943-1896-447a-ade8-0e4d28f4a97e tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:11:59.640625 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8b35d943-1896-447a-ade8-0e4d28f4a97e tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.454082 Aug 22 17:11:59.649226 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 93/184] 10.222.0.96 () {60 vars in 1191 bytes} [Mon Aug 22 17:11:59 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:11:59.661386 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d903da13-c17b-4023-96fa-eff73924ae14 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:59.666530 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:59.666530 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:59.721428 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9ed1dd19-e197-4fb0-afb0-e486ce9471a0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:11:59.722199 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9ed1dd19-e197-4fb0-afb0-e486ce9471a0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:11:59.819930 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d903da13-c17b-4023-96fa-eff73924ae14 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.163892 Aug 22 17:11:59.820601 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 92/185] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:11:59 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 22 17:11:59.836709 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d95110ad-3949-4547-92ac-65556908125e tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1682634327"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:11:59.859294 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:11:59.859294 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:11:59.860429 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.aggregate [None req-d95110ad-3949-4547-92ac-65556908125e tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Generated uuid bf5bce91-e9ed-47c7-a9c3-7afc190d7a31 for aggregate {{(pid=123016) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:11:59.927806 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9ed1dd19-e197-4fb0-afb0-e486ce9471a0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:11:59.939738 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9ed1dd19-e197-4fb0-afb0-e486ce9471a0 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1219 microversion: 2.1 time: 0.230471 Aug 22 17:11:59.943291 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 94/186] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:11:59 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1219 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:11:59.989620 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d95110ad-3949-4547-92ac-65556908125e tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.160589 Aug 22 17:12:00.001275 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 93/187] 10.222.0.96 () {60 vars in 1164 bytes} [Mon Aug 22 17:11:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:00.010066 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-61f71c54-55eb-4a25-873c-90fa63781911 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854030-1"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:00.013979 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:00.013979 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:00.028132 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-61f71c54-55eb-4a25-873c-90fa63781911 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:00.029682 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-61f71c54-55eb-4a25-873c-90fa63781911 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:00.030557 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-61f71c54-55eb-4a25-873c-90fa63781911 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:00.452396 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-61f71c54-55eb-4a25-873c-90fa63781911 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.446341 Aug 22 17:12:00.454929 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 95/188] 10.222.0.96 () {60 vars in 1191 bytes} [Mon Aug 22 17:12:00 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:00.465472 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-47891d5d-29a1-499f-a0bb-93e358a4e040 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:00.466373 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:00.466373 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:00.475069 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-47891d5d-29a1-499f-a0bb-93e358a4e040 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.013797 Aug 22 17:12:00.476014 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 94/189] 10.222.0.96 () {58 vars in 1143 bytes} [Mon Aug 22 17:12:00 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:00.487556 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e40ef221-ee0a-481e-bf64-d9631cef64e9 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854030-1"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:00.490475 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:00.490475 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:00.503645 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e40ef221-ee0a-481e-bf64-d9631cef64e9 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:00.504357 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e40ef221-ee0a-481e-bf64-d9631cef64e9 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:00.505053 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e40ef221-ee0a-481e-bf64-d9631cef64e9 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:00.964453 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-703449cf-332e-4645-8878-55c6a4019bc5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:00.965069 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-703449cf-332e-4645-8878-55c6a4019bc5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:00.967322 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e40ef221-ee0a-481e-bf64-d9631cef64e9 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.483401 Aug 22 17:12:00.971618 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 96/190] 10.222.0.96 () {60 vars in 1191 bytes} [Mon Aug 22 17:12:00 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:00.987901 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3a708127-c50e-4107-bc70-701b8c498f88 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:00.989350 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-703449cf-332e-4645-8878-55c6a4019bc5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:00.990018 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-703449cf-332e-4645-8878-55c6a4019bc5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:00.995954 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:00.995954 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:00.998826 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-703449cf-332e-4645-8878-55c6a4019bc5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:00.999968 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-703449cf-332e-4645-8878-55c6a4019bc5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:01.002042 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-703449cf-332e-4645-8878-55c6a4019bc5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:01.005359 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-703449cf-332e-4645-8878-55c6a4019bc5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:01.144088 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-703449cf-332e-4645-8878-55c6a4019bc5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:01.161846 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3a708127-c50e-4107-bc70-701b8c498f88 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.182484 Aug 22 17:12:01.163073 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 97/191] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:12:00 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 22 17:12:01.181144 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-60fb175c-5efb-48df-aac5-ff14606dacde tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1116052484"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:01.184706 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-703449cf-332e-4645-8878-55c6a4019bc5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1271 microversion: 2.1 time: 0.227325 Aug 22 17:12:01.210250 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 95/192] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:00 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1271 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:01.210633 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:01.210633 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:01.210633 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.aggregate [None req-60fb175c-5efb-48df-aac5-ff14606dacde tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Generated uuid 92edffbc-98bb-4521-9242-274e7e075b1f for aggregate {{(pid=123015) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:12:01.318759 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-60fb175c-5efb-48df-aac5-ff14606dacde tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.142607 Aug 22 17:12:01.321851 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 98/193] 10.222.0.96 () {60 vars in 1164 bytes} [Mon Aug 22 17:12:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:01.353410 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-af898242-ddeb-42f9-b704-64c08e9d8412 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854030-1"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:01.356146 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:01.356146 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:01.376776 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af898242-ddeb-42f9-b704-64c08e9d8412 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:01.377316 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af898242-ddeb-42f9-b704-64c08e9d8412 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:01.377760 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af898242-ddeb-42f9-b704-64c08e9d8412 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:01.788755 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-af898242-ddeb-42f9-b704-64c08e9d8412 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.452823 Aug 22 17:12:01.788755 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 96/194] 10.222.0.96 () {60 vars in 1191 bytes} [Mon Aug 22 17:12:01 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:01.798380 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9da7bf0c-5c8b-4ae9-9538-3f95f1f3add4 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854030-1"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:01.801472 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:01.801472 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:01.817421 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9da7bf0c-5c8b-4ae9-9538-3f95f1f3add4 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:01.817907 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9da7bf0c-5c8b-4ae9-9538-3f95f1f3add4 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:01.820302 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9da7bf0c-5c8b-4ae9-9538-3f95f1f3add4 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:02.240178 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9da7bf0c-5c8b-4ae9-9538-3f95f1f3add4 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.445446 Aug 22 17:12:02.242244 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 99/195] 10.222.0.96 () {60 vars in 1191 bytes} [Mon Aug 22 17:12:01 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:02.250188 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b2d40338-3b94-49fd-a645-bfbe09874f0c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:02.251020 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b2d40338-3b94-49fd-a645-bfbe09874f0c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:02.261470 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b2d40338-3b94-49fd-a645-bfbe09874f0c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:02.262355 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b2d40338-3b94-49fd-a645-bfbe09874f0c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:02.262948 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b2d40338-3b94-49fd-a645-bfbe09874f0c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:02.263818 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b2d40338-3b94-49fd-a645-bfbe09874f0c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:02.264848 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b2d40338-3b94-49fd-a645-bfbe09874f0c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:02.265625 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b2d40338-3b94-49fd-a645-bfbe09874f0c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:02.379511 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b2d40338-3b94-49fd-a645-bfbe09874f0c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:02.394260 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b2d40338-3b94-49fd-a645-bfbe09874f0c tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1277 microversion: 2.1 time: 0.150400 Aug 22 17:12:02.394858 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 100/196] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:02 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1277 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:02.401872 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d233abea-d15e-4d4d-ba75-94d523fb3af9 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:02.402714 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:02.402714 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:02.428269 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-77c4703f-a16c-4c9b-9f64-556151c6105f tempest-ServersWithSpecificFlavorTestJSON-1098471236 tempest-ServersWithSpecificFlavorTestJSON-1098471236-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:02.452872 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-77c4703f-a16c-4c9b-9f64-556151c6105f tempest-ServersWithSpecificFlavorTestJSON-1098471236 tempest-ServersWithSpecificFlavorTestJSON-1098471236-project] 10.222.0.96 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.538325 Aug 22 17:12:02.457143 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 97/197] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:12:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:02.499937 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d233abea-d15e-4d4d-ba75-94d523fb3af9 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.103685 Aug 22 17:12:02.500524 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 101/198] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:12:02 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 22 17:12:02.510475 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0990f791-5f96-428c-96a5-89b115ed67a8 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1160455911"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:02.516014 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:02.516014 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:02.517123 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.aggregate [None req-0990f791-5f96-428c-96a5-89b115ed67a8 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Generated uuid fe5f8911-3d58-41d3-86b5-1e15e0b36cc4 for aggregate {{(pid=123015) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:12:02.664165 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0990f791-5f96-428c-96a5-89b115ed67a8 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.157802 Aug 22 17:12:02.665454 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 102/199] 10.222.0.96 () {60 vars in 1164 bytes} [Mon Aug 22 17:12:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:02.679223 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1f633955-b0dc-4248-be06-47e9d5056e81 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1633542336"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:02.685447 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:02.685447 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:02.693038 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.aggregate [None req-1f633955-b0dc-4248-be06-47e9d5056e81 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Generated uuid d88d806f-3b20-4765-84ce-e4b131828120 for aggregate {{(pid=123015) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:12:02.817666 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1f633955-b0dc-4248-be06-47e9d5056e81 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.143208 Aug 22 17:12:02.819332 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 103/200] 10.222.0.96 () {60 vars in 1164 bytes} [Mon Aug 22 17:12:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:03.195307 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8dcc2a36-094a-46cc-b8e8-3741ea2866af tempest-ServersWithSpecificFlavorTestJSON-794947646 tempest-ServersWithSpecificFlavorTestJSON-794947646-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-794797256", "id": 1443085873, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:03.200138 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:03.200138 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:03.309625 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8dcc2a36-094a-46cc-b8e8-3741ea2866af tempest-ServersWithSpecificFlavorTestJSON-794947646 tempest-ServersWithSpecificFlavorTestJSON-794947646-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.846583 Aug 22 17:12:03.316103 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 98/201] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:02 2022] POST /compute/v2.1/flavors => generated 424 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:12:03.329510 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a9c06cb9-98ce-4986-9d2a-cfc5a33f802b tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:03.330690 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:03.330690 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:03.496502 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a9c06cb9-98ce-4986-9d2a-cfc5a33f802b tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.178615 Aug 22 17:12:03.497824 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 99/202] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:12:03 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 22 17:12:03.505068 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-561d2c8b-e999-4e51-9d7f-91b2469cfb08 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854030-1"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:03.509352 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:03.509352 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:03.536107 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-561d2c8b-e999-4e51-9d7f-91b2469cfb08 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:03.536630 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-561d2c8b-e999-4e51-9d7f-91b2469cfb08 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:03.537357 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-561d2c8b-e999-4e51-9d7f-91b2469cfb08 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:03.594987 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b5de4a6d-040f-4bae-b7ff-80be8504caed tempest-QuotaClassesAdmin257Test-2070649055 tempest-QuotaClassesAdmin257Test-2070649055-project-admin] Calling method '.version_select at 0x7f8009f4c550>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:03.596263 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:03.596263 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:03.598640 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:DELETE=12,nova_api:SELECT=83,nova_api:INSERT=5 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:03.616472 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b5de4a6d-040f-4bae-b7ff-80be8504caed tempest-QuotaClassesAdmin257Test-2070649055 tempest-QuotaClassesAdmin257Test-2070649055-project-admin] 10.222.0.96 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.795366 Aug 22 17:12:03.618089 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 104/203] 10.222.0.96 () {60 vars in 1226 bytes} [Mon Aug 22 17:12:02 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:12:03.623998 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-098be457-1afa-48d6-83e6-8e9e85d8ef8d tempest-ServersWithSpecificFlavorTestJSON-794947646 tempest-ServersWithSpecificFlavorTestJSON-794947646-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:03.635151 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-098be457-1afa-48d6-83e6-8e9e85d8ef8d tempest-ServersWithSpecificFlavorTestJSON-794947646 tempest-ServersWithSpecificFlavorTestJSON-794947646-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015650 Aug 22 17:12:03.636430 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 105/204] 10.222.0.96 () {58 vars in 1182 bytes} [Mon Aug 22 17:12:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:12:03.641704 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-02f2ca4c-2cad-41fc-a647-5abb5ccad402 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:03.670058 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-02f2ca4c-2cad-41fc-a647-5abb5ccad402 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:03.694098 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-02f2ca4c-2cad-41fc-a647-5abb5ccad402 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:03.696561 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-02f2ca4c-2cad-41fc-a647-5abb5ccad402 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:03.696561 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-02f2ca4c-2cad-41fc-a647-5abb5ccad402 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:03.696561 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-02f2ca4c-2cad-41fc-a647-5abb5ccad402 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:03.697379 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-02f2ca4c-2cad-41fc-a647-5abb5ccad402 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:03.697379 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-02f2ca4c-2cad-41fc-a647-5abb5ccad402 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:03.866313 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-02f2ca4c-2cad-41fc-a647-5abb5ccad402 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:03.879317 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-02f2ca4c-2cad-41fc-a647-5abb5ccad402 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1319 microversion: 2.1 time: 0.241511 Aug 22 17:12:03.881207 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 106/205] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:03 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:04.033906 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-561d2c8b-e999-4e51-9d7f-91b2469cfb08 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 242 microversion: 2.1 time: 0.534682 Aug 22 17:12:04.042539 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 100/206] 10.222.0.96 () {60 vars in 1191 bytes} [Mon Aug 22 17:12:03 2022] POST /compute/v2.1/os-aggregates/7/action => generated 242 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:04.049025 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-59bbdc37-569a-4c1e-b7c6-d078f792929c tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:04.050136 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:04.050136 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:04.063321 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-59bbdc37-569a-4c1e-b7c6-d078f792929c tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-59bbdc37-569a-4c1e-b7c6-d078f792929c tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Request method failure captured: Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7ius5FRO2oMeoDcwn-CWhYp2Z0cgpv0eUKdsB7l72VvQuJvcC3MY6DNWH7GMXgSNv3qgLJzClezH1DNZGAxzkxzzsJYedK7kXo46ksJlCf9TdKyxVAIruSsdvis_pUyIKCr0XkTBWkl36DpCuMJG-BheHY58C1SsTvDDrMqd3U3jOk Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 157bdd8a62f74b5882e35941d155fcfe Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-AggregatesAdminTestJSON-874832260 Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:12:04.065983 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:12:04.067395 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/157bdd8a62f74b5882e35941d155fcfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_157bdd8a62f74b5882e35941d155fcfe", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/157bdd8a62f74b5882e35941d155fcfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/157bdd8a62f74b5882e35941d155fcfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:04.067395 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-AggregatesAdminTestJSON-874832260 Aug 22 17:12:04.067395 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 157bdd8a62f74b5882e35941d155fcfe Aug 22 17:12:04.067395 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-874832260 Aug 22 17:12:04.067395 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-AggregatesAdminTestJSON-874832260-project-admin Aug 22 17:12:04.067395 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:12:04.067395 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:12:04.067395 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 7951126845c5415a9c228f3b77f6c0f0 Aug 22 17:12:04.067395 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-AggregatesAdminTestJSON-874832260-project-admin Aug 22 17:12:04.067395 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:12:04.067395 n-d-854030-1 devstack@n-api.service[123016]: exception: Aggregate 6 could not be found. Aug 22 17:12:04.067395 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '6'} Aug 22 17:12:04.067395 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:04.068252 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:04.068252 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 22 17:12:04.068252 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 22 17:12:04.068252 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 22 17:12:04.068252 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 22 17:12:04.068252 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:12:04.068252 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:12:04.068252 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 22 17:12:04.068252 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 22 17:12:04.068252 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:12:04.068252 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:12:04.068252 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 22 17:12:04.068252 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 22 17:12:04.068252 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 22 17:12:04.068252 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.068252 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:04.068252 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.068252 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:04.068252 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:04.069594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:04.069594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:04.069594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:04.069594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:04.069594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:04.069594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 22 17:12:04.069594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:12:04.069594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 22 17:12:04.069594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.069594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:04.069594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.069594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:04.069594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:04.069594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:04.069594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:04.069594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:04.069594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 22 17:12:04.069594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.072360 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-59bbdc37-569a-4c1e-b7c6-d078f792929c tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:04.073252 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-59bbdc37-569a-4c1e-b7c6-d078f792929c tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.029674 Aug 22 17:12:04.073990 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 101/207] 10.222.0.96 () {58 vars in 1149 bytes} [Mon Aug 22 17:12:04 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:12:04.082925 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-875cbc5f-2c01-47d6-bea9-eef0f2157b41 tempest-QuotaClassesAdmin257Test-2070649055 tempest-QuotaClassesAdmin257Test-2070649055-project-admin] Action: 'update', calling method: .version_select at 0x7f800a0c34c0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:04.086242 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:04.086242 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:04.109753 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9ebd33cd-f18f-4450-ba44-61a421adcdec tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Calling method '.version_select at 0x7f800a76e040>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:04.110700 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:04.110700 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:04.112239 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ebd33cd-f18f-4450-ba44-61a421adcdec tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:04.112795 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ebd33cd-f18f-4450-ba44-61a421adcdec tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:04.113334 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ebd33cd-f18f-4450-ba44-61a421adcdec tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:04.136527 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ebd33cd-f18f-4450-ba44-61a421adcdec tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:04.137674 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ebd33cd-f18f-4450-ba44-61a421adcdec tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:04.138625 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ebd33cd-f18f-4450-ba44-61a421adcdec tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:04.151697 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ebd33cd-f18f-4450-ba44-61a421adcdec tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:04.152259 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ebd33cd-f18f-4450-ba44-61a421adcdec tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:04.152845 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ebd33cd-f18f-4450-ba44-61a421adcdec tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:04.159329 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9ebd33cd-f18f-4450-ba44-61a421adcdec tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.276449 Aug 22 17:12:04.159917 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 107/208] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:04.172117 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c6d1a340-91f7-47c1-90f7-b10ef59f8a07 tempest-ServersWithSpecificFlavorTestJSON-794947646 tempest-ServersWithSpecificFlavorTestJSON-794947646-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-2003354698", "id": 1890595475, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:04.178083 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:04.178083 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:04.293338 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c6d1a340-91f7-47c1-90f7-b10ef59f8a07 tempest-ServersWithSpecificFlavorTestJSON-794947646 tempest-ServersWithSpecificFlavorTestJSON-794947646-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.132048 Aug 22 17:12:04.293963 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 108/209] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:04 2022] POST /compute/v2.1/flavors => generated 425 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:04.386168 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-151cc776-4ed4-416c-90f2-2427d7219844 tempest-InstanceUsageAuditLogTestJSON-861775183 tempest-InstanceUsageAuditLogTestJSON-861775183-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:04.386948 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:04.386948 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:04.419083 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-151cc776-4ed4-416c-90f2-2427d7219844 tempest-InstanceUsageAuditLogTestJSON-861775183 tempest-InstanceUsageAuditLogTestJSON-861775183-project-admin] 10.222.0.96 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-22 17:12:03" status: 200 len: 318 microversion: 2.1 time: 0.116592 Aug 22 17:12:04.420145 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 109/210] 10.222.0.96 () {58 vars in 1251 bytes} [Mon Aug 22 17:12:04 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-22%2017%3A12%3A03 => generated 318 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:04.424771 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-65f6d204-2d70-47d1-9cd3-098da72fb6e5 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854030-1"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:04.427336 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:04.427336 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:04.437498 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65f6d204-2d70-47d1-9cd3-098da72fb6e5 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:04.441886 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65f6d204-2d70-47d1-9cd3-098da72fb6e5 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:04.443105 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65f6d204-2d70-47d1-9cd3-098da72fb6e5 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:04.528072 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-65f6d204-2d70-47d1-9cd3-098da72fb6e5 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h2-854030-1. Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-65f6d204-2d70-47d1-9cd3-098da72fb6e5 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Request method failure captured: Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 39 Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7iu7mwCqVfEPXcvEFE_j7zjSxexRLsSV30DitjvjSs1f8gYXw3dHJKj595-9e2rpdJBmdl4yV7fmore24g90lZGLDaH1yHDkSQxpmXAzhxx4Sz34fwuch6eyjD83KohIRHHGzznpTYRbehq0s642dmgm-r6orhynCByFM2Zg_6KT6Y Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 92d0ec50c9764f48a41a30c944c857c0 Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:12:04.534653 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:12:04.536079 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_92d0ec50c9764f48a41a30c944c857c0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:04.536079 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:04.536079 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 92d0ec50c9764f48a41a30c944c857c0 Aug 22 17:12:04.536079 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:04.536079 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin Aug 22 17:12:04.536079 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:04.536079 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:04.536079 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 6bb1a856d20e4266a583cd270e888485 Aug 22 17:12:04.536079 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin Aug 22 17:12:04.536079 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:12:04.536079 n-d-854030-1 devstack@n-api.service[123015]: {"add_host": {"host": "n-h2-854030-1"}} Aug 22 17:12:04.536079 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:04.536079 n-d-854030-1 devstack@n-api.service[123015]: exception: Aggregate 7 already has host n-h2-854030-1. Aug 22 17:12:04.536945 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h2-854030-1'}}} Aug 22 17:12:04.536945 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:04.536945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:04.536945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 17:12:04.536945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 22 17:12:04.536945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 17:12:04.536945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 22 17:12:04.536945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 17:12:04.536945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 22 17:12:04.536945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 17:12:04.536945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 22 17:12:04.536945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 17:12:04.536945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 17:12:04.536945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 17:12:04.536945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result.read() Aug 22 17:12:04.536945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 17:12:04.536945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 22 17:12:04.536945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 17:12:04.536945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 22 17:12:04.538208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 17:12:04.538208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 22 17:12:04.538208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 17:12:04.538208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 22 17:12:04.538208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-854030-1-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 22 17:12:04.538208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.538208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 22 17:12:04.538208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.538208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:04.538208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 22 17:12:04.538208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 22 17:12:04.538208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 22 17:12:04.538208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi session.flush() Aug 22 17:12:04.538208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 17:12:04.538208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 22 17:12:04.538208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 17:12:04.538208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 22 17:12:04.538208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 17:12:04.538208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 22 17:12:04.539438 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 17:12:04.539438 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception Aug 22 17:12:04.539438 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 17:12:04.539438 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 22 17:12:04.539438 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 17:12:04.539438 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 22 17:12:04.539438 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 17:12:04.539438 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 22 17:12:04.539438 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 17:12:04.539438 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 22 17:12:04.539438 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 22 17:12:04.539438 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 22 17:12:04.539438 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 17:12:04.539438 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 17:12:04.539438 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 17:12:04.539438 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 22 17:12:04.539438 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 17:12:04.539438 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 22 17:12:04.540821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 17:12:04.540821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 22 17:12:04.540821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 17:12:04.540821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 17:12:04.540821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 17:12:04.540821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception Aug 22 17:12:04.540821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 17:12:04.540821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 22 17:12:04.540821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 17:12:04.540821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 22 17:12:04.540821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 17:12:04.540821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 22 17:12:04.540821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 17:12:04.540821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 22 17:12:04.540821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 17:12:04.540821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 17:12:04.540821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 17:12:04.540821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result.read() Aug 22 17:12:04.542002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 17:12:04.542002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 22 17:12:04.542002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 17:12:04.542002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 22 17:12:04.542002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 17:12:04.542002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 22 17:12:04.542002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 17:12:04.542002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 22 17:12:04.542002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-854030-1-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 22 17:12:04.542002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 22 17:12:04.542002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 22, 17, 12, 4, 465511), 'updated_at': None, 'host': 'n-h2-854030-1', 'aggregate_id': 7}] Aug 22 17:12:04.542002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 17:12:04.542002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.542002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:04.542002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.542002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:04.542002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6636, in add_host_to_aggregate Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h2-854030-1. Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.542930 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h2-854030-1. Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:04.544237 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:04.545615 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h2-854030-1. Aug 22 17:12:04.545615 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.545615 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-65f6d204-2d70-47d1-9cd3-098da72fb6e5 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Returning 409 to user: Aggregate 7 already has host n-h2-854030-1. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:04.545615 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-65f6d204-2d70-47d1-9cd3-098da72fb6e5 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 95 microversion: 2.1 time: 0.112614 Aug 22 17:12:04.545615 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 110/211] 10.222.0.96 () {60 vars in 1191 bytes} [Mon Aug 22 17:12:04 2022] POST /compute/v2.1/os-aggregates/7/action => generated 95 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 22 17:12:04.545615 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-09c70a38-9a4c-4374-8923-93eec0188de6 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:04.545615 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:04.545615 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:04.555258 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-09c70a38-9a4c-4374-8923-93eec0188de6 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-09c70a38-9a4c-4374-8923-93eec0188de6 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Request method failure captured: Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7ius5FRO2oMeoDcwn-CWhYp2Z0cgpv0eUKdsB7l72VvQuJvcC3MY6DNWH7GMXgSNv3qgLJzClezH1DNZGAxzkxzzsJYedK7kXo46ksJlCf9TdKyxVAIruSsdvis_pUyIKCr0XkTBWkl36DpCuMJG-BheHY58C1SsTvDDrMqd3U3jOk Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 157bdd8a62f74b5882e35941d155fcfe Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-AggregatesAdminTestJSON-874832260 Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:12:04.557765 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:12:04.559252 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/157bdd8a62f74b5882e35941d155fcfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_157bdd8a62f74b5882e35941d155fcfe", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/157bdd8a62f74b5882e35941d155fcfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/157bdd8a62f74b5882e35941d155fcfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:04.559252 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-AggregatesAdminTestJSON-874832260 Aug 22 17:12:04.559252 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 157bdd8a62f74b5882e35941d155fcfe Aug 22 17:12:04.559252 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-874832260 Aug 22 17:12:04.559252 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-AggregatesAdminTestJSON-874832260-project-admin Aug 22 17:12:04.559252 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:04.559252 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:04.559252 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 7951126845c5415a9c228f3b77f6c0f0 Aug 22 17:12:04.559252 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-AggregatesAdminTestJSON-874832260-project-admin Aug 22 17:12:04.559252 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:04.559252 n-d-854030-1 devstack@n-api.service[123015]: exception: Aggregate 6 could not be found. Aug 22 17:12:04.559252 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '6'} Aug 22 17:12:04.559252 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:04.560062 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:04.560062 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 22 17:12:04.560062 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 22 17:12:04.560062 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 22 17:12:04.560062 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 22 17:12:04.560062 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:12:04.560062 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:12:04.560062 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:12:04.560062 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:12:04.560062 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 22 17:12:04.560062 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 22 17:12:04.560062 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 22 17:12:04.560062 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 22 17:12:04.560062 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:12:04.560062 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:12:04.560062 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 22 17:12:04.560062 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 22 17:12:04.560062 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:12:04.560062 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:04.561067 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:04.569836 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:04.569836 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:04.569836 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:04.569836 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 22 17:12:04.569836 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.569836 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-09c70a38-9a4c-4374-8923-93eec0188de6 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:04.569836 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-09c70a38-9a4c-4374-8923-93eec0188de6 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.022857 Aug 22 17:12:04.569836 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 111/212] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:12:04 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:12:04.679722 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-134d02a3-2702-40f9-ab35-b49bbaa0d152 tempest-HypervisorAdminNegativeUnderV252Test-1907474962 tempest-HypervisorAdminNegativeUnderV252Test-1907474962-project] Calling method '.version_select at 0x7f800a03d430>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:04.681538 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:04.681538 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:04.682636 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-134d02a3-2702-40f9-ab35-b49bbaa0d152 tempest-HypervisorAdminNegativeUnderV252Test-1907474962 tempest-HypervisorAdminNegativeUnderV252Test-1907474962-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '8bb8f5c4fdc34194a6ba24ea6383fc5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99f9ea4073b4c3ba71411f4eaf1f8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-134d02a3-2702-40f9-ab35-b49bbaa0d152 tempest-HypervisorAdminNegativeUnderV252Test-1907474962 tempest-HypervisorAdminNegativeUnderV252Test-1907474962-project] Request method failure captured: Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-hypervisors/n-h2-854030-1/search HTTP/1.1 Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7jgub1TiXdP0Ufu7JNPLWJg9UGP83D4Q2E0xDcRTeIxWKu-QB0RL9WfSFggcG-77rW-ky5T0NP9h_825iYTNpqz9RhjeDSNDeMpm2C6RAhuZjQxogs64SZz2oh-k7wqE0mMekT010H7PEWwokPsby5hI5E_9q5QbkKhJsBJnrngJKE Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: f99f9ea4073b4c3ba71411f4eaf1f8fb Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1907474962 Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:12:04.684558 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:12:04.686075 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/f99f9ea4073b4c3ba71411f4eaf1f8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_f99f9ea4073b4c3ba71411f4eaf1f8fb", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/f99f9ea4073b4c3ba71411f4eaf1f8fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/f99f9ea4073b4c3ba71411f4eaf1f8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:04.686075 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1907474962 Aug 22 17:12:04.686075 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: f99f9ea4073b4c3ba71411f4eaf1f8fb Aug 22 17:12:04.686075 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1907474962 Aug 22 17:12:04.686075 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1907474962-project Aug 22 17:12:04.686075 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:04.686075 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:04.686075 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 8bb8f5c4fdc34194a6ba24ea6383fc5c Aug 22 17:12:04.686075 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1907474962-project Aug 22 17:12:04.686075 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:12:04.686075 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 22 17:12:04.686075 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'n-h2-854030-1'} Aug 22 17:12:04.686921 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:04.686921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:04.686921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:04.686921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:04.686921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:04.686921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:04.686921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:12:04.686921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:12:04.686921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:04.686921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:04.686921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 22 17:12:04.686921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 22 17:12:04.686921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:12:04.686921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:12:04.686921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:12:04.686921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:12:04.686921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:12:04.686921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:12:04.686921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:12:04.688427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:12:04.688427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:12:04.688427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:12:04.688427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:12:04.688427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:12:04.688427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:12:04.688427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:12:04.688427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 22 17:12:04.688427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.688427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:04.688427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.688427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:04.688427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:04.688427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:04.688427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:12:04.688427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:12:04.688427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 22 17:12:04.688427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:04.695187 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-134d02a3-2702-40f9-ab35-b49bbaa0d152 tempest-HypervisorAdminNegativeUnderV252Test-1907474962 tempest-HypervisorAdminNegativeUnderV252Test-1907474962-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:04.695187 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-134d02a3-2702-40f9-ab35-b49bbaa0d152 tempest-HypervisorAdminNegativeUnderV252Test-1907474962 tempest-HypervisorAdminNegativeUnderV252Test-1907474962-project] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/n-h2-854030-1/search" status: 403 len: 117 microversion: 2.1 time: 0.124806 Aug 22 17:12:04.695187 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 112/213] 10.222.0.96 () {58 vars in 1209 bytes} [Mon Aug 22 17:12:04 2022] GET /compute/v2.1/os-hypervisors/n-h2-854030-1/search => generated 117 bytes in 126 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:12:04.695187 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9ac128a4-8d38-46e5-b061-7a91107f8a98 tempest-ServersWithSpecificFlavorTestJSON-794947646 tempest-ServersWithSpecificFlavorTestJSON-794947646-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:04.703308 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9ac128a4-8d38-46e5-b061-7a91107f8a98 tempest-ServersWithSpecificFlavorTestJSON-794947646 tempest-ServersWithSpecificFlavorTestJSON-794947646-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015729 Aug 22 17:12:04.704148 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 113/214] 10.222.0.96 () {58 vars in 1182 bytes} [Mon Aug 22 17:12:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:12:04.708635 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-49cc038a-d2e1-4d2e-8db9-63cb8ba98135 tempest-InstanceUsageAuditLogTestJSON-861775183 tempest-InstanceUsageAuditLogTestJSON-861775183-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:04.709427 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:04.709427 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:04.723225 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-49cc038a-d2e1-4d2e-8db9-63cb8ba98135 tempest-InstanceUsageAuditLogTestJSON-861775183 tempest-InstanceUsageAuditLogTestJSON-861775183-project-admin] 10.222.0.96 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.018028 Aug 22 17:12:04.723904 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 114/215] 10.222.0.96 () {58 vars in 1185 bytes} [Mon Aug 22 17:12:04 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:04.729116 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-74913368-ecb6-455f-bb7e-5bb6acb7aa68 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854030-1"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:04.733466 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:04.733466 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:04.747816 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-74913368-ecb6-455f-bb7e-5bb6acb7aa68 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:04.748564 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-74913368-ecb6-455f-bb7e-5bb6acb7aa68 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:04.748997 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-74913368-ecb6-455f-bb7e-5bb6acb7aa68 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:04.757766 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=13,nova_api:DELETE=4,nova_api:UPDATE=6 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:04.979628 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-875cbc5f-2c01-47d6-bea9-eef0f2157b41 tempest-QuotaClassesAdmin257Test-2070649055 tempest-QuotaClassesAdmin257Test-2070649055-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.904404 Aug 22 17:12:04.980405 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 102/216] 10.222.0.96 () {62 vars in 1247 bytes} [Mon Aug 22 17:12:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:12:04.984941 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-29ad36d4-a925-4af4-81f4-038f458a84b6 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2018018513", "name": "tempest-test_aggregate-958165768"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:04.988268 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:04.988268 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:04.989668 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.aggregate [None req-29ad36d4-a925-4af4-81f4-038f458a84b6 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Generated uuid a5c3ba1e-db2a-4657-a229-0aab79cd6a5c for aggregate {{(pid=123016) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:12:05.066822 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-74913368-ecb6-455f-bb7e-5bb6acb7aa68 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 227 microversion: 2.1 time: 0.338454 Aug 22 17:12:05.066822 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 115/217] 10.222.0.96 () {60 vars in 1191 bytes} [Mon Aug 22 17:12:04 2022] POST /compute/v2.1/os-aggregates/7/action => generated 227 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:05.069262 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-61c1248d-75aa-4f28-968c-a4767e6d7a33 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Calling method '.version_select at 0x7f8009fb6790>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:05.070198 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:05.070198 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:05.072565 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-61c1248d-75aa-4f28-968c-a4767e6d7a33 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:05.073267 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-61c1248d-75aa-4f28-968c-a4767e6d7a33 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:05.073852 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-61c1248d-75aa-4f28-968c-a4767e6d7a33 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:05.081072 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-61c1248d-75aa-4f28-968c-a4767e6d7a33 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-61c1248d-75aa-4f28-968c-a4767e6d7a33 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Request method failure captured: Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7jjMj24ewsdVUoMEg-qvqwkgolzoJWgDT2zPz9e0hbnOLJ-Nlmo_xWsQr_hTNCvM22AXUZPo78cWtOmKduM-h5DMrkY3tRsLXsq2YdFnedzLz8566wUVS1AkgnfafKJgMgmF-fJaJYdYcr2xVgFSH6x6wgh32voryhVjldYH-Ktze4 Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 6691d4a0478d457abbacc52bcf82fa6a Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1816016409 Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:12:05.082795 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:12:05.084222 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/6691d4a0478d457abbacc52bcf82fa6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_6691d4a0478d457abbacc52bcf82fa6a", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/6691d4a0478d457abbacc52bcf82fa6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/6691d4a0478d457abbacc52bcf82fa6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:05.084222 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1816016409 Aug 22 17:12:05.084222 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 6691d4a0478d457abbacc52bcf82fa6a Aug 22 17:12:05.084222 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1816016409 Aug 22 17:12:05.084222 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin Aug 22 17:12:05.084222 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:05.084222 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:05.084222 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: e596fddd6d8c4925ac5a8f9277576783 Aug 22 17:12:05.084222 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin Aug 22 17:12:05.084222 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:12:05.084222 n-d-854030-1 devstack@n-api.service[123015]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 22 17:12:05.084222 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:05.085009 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:05.086367 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:05.086367 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:05.086367 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:05.086367 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 22 17:12:05.086367 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:05.086367 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-61c1248d-75aa-4f28-968c-a4767e6d7a33 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:05.086367 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-61c1248d-75aa-4f28-968c-a4767e6d7a33 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.019100 Aug 22 17:12:05.090716 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 116/218] 10.222.0.96 () {58 vars in 1251 bytes} [Mon Aug 22 17:12:05 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:12:05.098770 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-716a6aec-d230-497f-98fb-28fb5a2ba501 tempest-ServersWithSpecificFlavorTestJSON-1098471236 tempest-ServersWithSpecificFlavorTestJSON-1098471236-project] Action: 'create', calling method: .version_select at 0x7f8009ee4c10>, body: {"keypair": {"name": "tempest-keypair-222436087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCwkaLhU1iqDFPeik1GjgjXObHSzr2IpmFovweoDXmFCrsnxNabC7FOmCjt+BYopMfzQCbu+p1Rk2finFxCsAhQ3DnpBQ6xBG594zhFuPAAFYBSzXym2H9chbEr9MDwzQ=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:05.119221 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-716a6aec-d230-497f-98fb-28fb5a2ba501 tempest-ServersWithSpecificFlavorTestJSON-1098471236 tempest-ServersWithSpecificFlavorTestJSON-1098471236-project] Getting quotas for project afb8266443ae4fa8b123155010efe483. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:12:05.128403 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-29ad36d4-a925-4af4-81f4-038f458a84b6 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.146859 Aug 22 17:12:05.129020 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 103/219] 10.222.0.96 () {60 vars in 1165 bytes} [Mon Aug 22 17:12:04 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:05.136819 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-63678e73-01a0-4c53-a788-8eebf11fd274 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:05.137272 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-716a6aec-d230-497f-98fb-28fb5a2ba501 tempest-ServersWithSpecificFlavorTestJSON-1098471236 tempest-ServersWithSpecificFlavorTestJSON-1098471236-project] Getting quotas for user 285aa300c7e54ef1a7479206c1e595db and project afb8266443ae4fa8b123155010efe483. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:12:05.137841 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-63678e73-01a0-4c53-a788-8eebf11fd274 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:05.147326 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-63678e73-01a0-4c53-a788-8eebf11fd274 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:05.147812 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-63678e73-01a0-4c53-a788-8eebf11fd274 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:05.148296 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-63678e73-01a0-4c53-a788-8eebf11fd274 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:05.150900 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-63678e73-01a0-4c53-a788-8eebf11fd274 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:05.151366 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-63678e73-01a0-4c53-a788-8eebf11fd274 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:05.151961 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-63678e73-01a0-4c53-a788-8eebf11fd274 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:05.235986 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-716a6aec-d230-497f-98fb-28fb5a2ba501 tempest-ServersWithSpecificFlavorTestJSON-1098471236 tempest-ServersWithSpecificFlavorTestJSON-1098471236-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.143208 Aug 22 17:12:05.236983 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 117/220] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:12:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:05.243401 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-07726aa2-f9f6-42f3-b0cb-c59c4a1e741b tempest-QuotaClassesAdmin257Test-2070649055 tempest-QuotaClassesAdmin257Test-2070649055-project-admin] Calling method '.version_select at 0x7f8009f28d30>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:05.246083 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:05.246083 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:05.262017 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-07726aa2-f9f6-42f3-b0cb-c59c4a1e741b tempest-QuotaClassesAdmin257Test-2070649055 tempest-QuotaClassesAdmin257Test-2070649055-project-admin] 10.222.0.96 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.023471 Aug 22 17:12:05.263056 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 118/221] 10.222.0.96 () {60 vars in 1226 bytes} [Mon Aug 22 17:12:05 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:12:05.268041 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-08d93e5b-e368-4d90-a288-7bfc18e13a74 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:05.269566 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:05.269566 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:05.362432 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-08d93e5b-e368-4d90-a288-7bfc18e13a74 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.096527 Aug 22 17:12:05.367202 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-63678e73-01a0-4c53-a788-8eebf11fd274 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:05.375655 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 119/222] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:12:05 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 22 17:12:05.383957 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2ac98c18-8238-4263-ad30-37c19aadb440 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Calling method '.version_select at 0x7f8009f28820>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:05.385237 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-63678e73-01a0-4c53-a788-8eebf11fd274 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1319 microversion: 2.1 time: 0.254960 Aug 22 17:12:05.386537 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 104/223] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:05 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:05.391249 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:05.391249 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:05.400154 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0c660463-6a07-4474-8939-3e8585f7df37 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:05.401009 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:05.401009 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:05.412921 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2ac98c18-8238-4263-ad30-37c19aadb440 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:05.417563 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2ac98c18-8238-4263-ad30-37c19aadb440 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:05.418024 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2ac98c18-8238-4263-ad30-37c19aadb440 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:05.432300 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:05.471663 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2ac98c18-8238-4263-ad30-37c19aadb440 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:05.472432 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2ac98c18-8238-4263-ad30-37c19aadb440 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:05.473035 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2ac98c18-8238-4263-ad30-37c19aadb440 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:05.497109 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2ac98c18-8238-4263-ad30-37c19aadb440 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:05.499679 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2ac98c18-8238-4263-ad30-37c19aadb440 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:05.500492 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2ac98c18-8238-4263-ad30-37c19aadb440 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:05.510277 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2ac98c18-8238-4263-ad30-37c19aadb440 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.133238 Aug 22 17:12:05.516787 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 120/224] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:05.516787 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-74f7e634-8a41-46f0-8e92-f85ce5f8e8fd tempest-QuotaClassesAdmin257Test-2070649055 tempest-QuotaClassesAdmin257Test-2070649055-project-admin] Action: 'update', calling method: .version_select at 0x7f800a0a41f0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:05.519105 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:05.519105 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:05.547510 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0c660463-6a07-4474-8939-3e8585f7df37 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.158849 Aug 22 17:12:05.548222 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 105/225] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:12:05 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 22 17:12:05.553848 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-168370f7-0234-49aa-8623-b804fa910893 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-888580467"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:05.565985 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:05.565985 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:05.569688 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.aggregate [None req-168370f7-0234-49aa-8623-b804fa910893 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Generated uuid acc4547d-df36-4308-9f24-3e84327ad27a for aggregate {{(pid=123016) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:12:05.683935 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-168370f7-0234-49aa-8623-b804fa910893 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.134117 Aug 22 17:12:05.691496 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 106/226] 10.222.0.96 () {60 vars in 1164 bytes} [Mon Aug 22 17:12:05 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:05.698712 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7cfdf500-a16b-4318-862f-36125d604453 tempest-HypervisorAdminNegativeUnderV252Test-1907474962 tempest-HypervisorAdminNegativeUnderV252Test-1907474962-project] Calling method '.version_select at 0x7f800a01b3a0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:05.702202 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:05.702202 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:05.703839 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-7cfdf500-a16b-4318-862f-36125d604453 tempest-HypervisorAdminNegativeUnderV252Test-1907474962 tempest-HypervisorAdminNegativeUnderV252Test-1907474962-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '8bb8f5c4fdc34194a6ba24ea6383fc5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99f9ea4073b4c3ba71411f4eaf1f8fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7cfdf500-a16b-4318-862f-36125d604453 tempest-HypervisorAdminNegativeUnderV252Test-1907474962 tempest-HypervisorAdminNegativeUnderV252Test-1907474962-project] Request method failure captured: Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7jgub1TiXdP0Ufu7JNPLWJg9UGP83D4Q2E0xDcRTeIxWKu-QB0RL9WfSFggcG-77rW-ky5T0NP9h_825iYTNpqz9RhjeDSNDeMpm2C6RAhuZjQxogs64SZz2oh-k7wqE0mMekT010H7PEWwokPsby5hI5E_9q5QbkKhJsBJnrngJKE Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: f99f9ea4073b4c3ba71411f4eaf1f8fb Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1907474962 Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:12:05.706047 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:12:05.707308 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/f99f9ea4073b4c3ba71411f4eaf1f8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_f99f9ea4073b4c3ba71411f4eaf1f8fb", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/f99f9ea4073b4c3ba71411f4eaf1f8fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/f99f9ea4073b4c3ba71411f4eaf1f8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:05.707308 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1907474962 Aug 22 17:12:05.707308 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: f99f9ea4073b4c3ba71411f4eaf1f8fb Aug 22 17:12:05.707308 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1907474962 Aug 22 17:12:05.707308 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1907474962-project Aug 22 17:12:05.707308 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:12:05.707308 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:12:05.707308 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 8bb8f5c4fdc34194a6ba24ea6383fc5c Aug 22 17:12:05.707308 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1907474962-project Aug 22 17:12:05.707308 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:12:05.707308 n-d-854030-1 devstack@n-api.service[123016]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 22 17:12:05.707308 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '1'} Aug 22 17:12:05.708011 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:05.708011 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:05.708011 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:05.708011 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:05.708011 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:05.708011 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:05.708011 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:12:05.708011 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:12:05.708011 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:05.708011 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:05.708011 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 22 17:12:05.708011 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 22 17:12:05.708011 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:12:05.708011 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:12:05.708011 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:12:05.708011 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:12:05.708011 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:12:05.708011 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:12:05.708011 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:12:05.708991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:12:05.708991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:12:05.708991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:12:05.708991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:12:05.708991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:12:05.708991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:12:05.708991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:12:05.708991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 22 17:12:05.708991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:05.708991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:05.708991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:05.708991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:05.708991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:05.708991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:05.708991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:12:05.708991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:12:05.708991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 22 17:12:05.708991 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:05.710576 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7cfdf500-a16b-4318-862f-36125d604453 tempest-HypervisorAdminNegativeUnderV252Test-1907474962 tempest-HypervisorAdminNegativeUnderV252Test-1907474962-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:05.710576 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7cfdf500-a16b-4318-862f-36125d604453 tempest-HypervisorAdminNegativeUnderV252Test-1907474962 tempest-HypervisorAdminNegativeUnderV252Test-1907474962-project] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.014623 Aug 22 17:12:05.713965 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 107/227] 10.222.0.96 () {58 vars in 1176 bytes} [Mon Aug 22 17:12:05 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:12:05.720017 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1419217c-9d39-422c-b9fe-8b7c9ea3ed23 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:05.721638 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:05.721638 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:05.729982 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-1419217c-9d39-422c-b9fe-8b7c9ea3ed23 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1419217c-9d39-422c-b9fe-8b7c9ea3ed23 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Request method failure captured: Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7ius5FRO2oMeoDcwn-CWhYp2Z0cgpv0eUKdsB7l72VvQuJvcC3MY6DNWH7GMXgSNv3qgLJzClezH1DNZGAxzkxzzsJYedK7kXo46ksJlCf9TdKyxVAIruSsdvis_pUyIKCr0XkTBWkl36DpCuMJG-BheHY58C1SsTvDDrMqd3U3jOk Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 157bdd8a62f74b5882e35941d155fcfe Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-AggregatesAdminTestJSON-874832260 Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:12:05.732865 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:12:05.734383 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/157bdd8a62f74b5882e35941d155fcfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_157bdd8a62f74b5882e35941d155fcfe", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/157bdd8a62f74b5882e35941d155fcfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/157bdd8a62f74b5882e35941d155fcfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:05.734383 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-AggregatesAdminTestJSON-874832260 Aug 22 17:12:05.734383 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 157bdd8a62f74b5882e35941d155fcfe Aug 22 17:12:05.734383 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-874832260 Aug 22 17:12:05.734383 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-AggregatesAdminTestJSON-874832260-project-admin Aug 22 17:12:05.734383 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:12:05.734383 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:12:05.734383 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 7951126845c5415a9c228f3b77f6c0f0 Aug 22 17:12:05.734383 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-AggregatesAdminTestJSON-874832260-project-admin Aug 22 17:12:05.734383 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:12:05.734383 n-d-854030-1 devstack@n-api.service[123016]: exception: Aggregate 8 could not be found. Aug 22 17:12:05.734383 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '8'} Aug 22 17:12:05.734383 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:05.735180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:05.735180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 22 17:12:05.735180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 22 17:12:05.735180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 22 17:12:05.735180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 22 17:12:05.735180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:12:05.735180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:12:05.735180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 22 17:12:05.735180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 22 17:12:05.735180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:12:05.735180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:12:05.735180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 22 17:12:05.735180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 22 17:12:05.735180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Aug 22 17:12:05.735180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:05.735180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:05.735180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:05.735180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:05.735180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:05.736204 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:05.736204 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:05.736204 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:05.736204 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:05.736204 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:05.736204 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 22 17:12:05.736204 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:12:05.736204 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Aug 22 17:12:05.736204 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:05.736204 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:05.736204 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:05.736204 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:05.736204 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:05.736204 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:05.736204 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:05.736204 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:05.736204 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Aug 22 17:12:05.736204 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:05.736204 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1419217c-9d39-422c-b9fe-8b7c9ea3ed23 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:05.737366 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1419217c-9d39-422c-b9fe-8b7c9ea3ed23 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.021004 Aug 22 17:12:05.737984 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 108/228] 10.222.0.96 () {58 vars in 1149 bytes} [Mon Aug 22 17:12:05 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:12:06.052527 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7f631cc4-8e60-4657-9196-1746bde9f00c tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854030-1"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:06.055627 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:06.055627 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:06.057586 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-7f631cc4-8e60-4657-9196-1746bde9f00c tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '308ee6c6db3c4d689d5907293bf045ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad4c5b924db48f39f47a5e184cce700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7f631cc4-8e60-4657-9196-1746bde9f00c tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Request method failure captured: Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 39 Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7ir1nOQ22WGoYnd3y6_dSSj4Yt_RbejTa6QhMujNneOmuyIebOh-1wl8iFJgz_vW7zgrTjiOF42OCssk0-EdgKFLud9rMeoGkklis_ni66jIOYHLCAjrHFSJ45tnsuGVECLPDEBZVM8aj682VH7IJtQgFyfs26RtA0y_nJfevA9bSI Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 9ad4c5b924db48f39f47a5e184cce700 Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1583174465 Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:12:06.059255 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:12:06.060756 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ad4c5b924db48f39f47a5e184cce700"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9ad4c5b924db48f39f47a5e184cce700", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ad4c5b924db48f39f47a5e184cce700"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9ad4c5b924db48f39f47a5e184cce700"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:06.060756 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1583174465 Aug 22 17:12:06.060756 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 9ad4c5b924db48f39f47a5e184cce700 Aug 22 17:12:06.060756 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1583174465 Aug 22 17:12:06.060756 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-AggregatesAdminNegativeTestJSON-1583174465-project Aug 22 17:12:06.060756 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:12:06.060756 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:12:06.060756 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 308ee6c6db3c4d689d5907293bf045ca Aug 22 17:12:06.060756 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1583174465-project Aug 22 17:12:06.060756 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:12:06.060756 n-d-854030-1 devstack@n-api.service[123016]: {"add_host": {"host": "n-h2-854030-1"}} Aug 22 17:12:06.060756 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:12:06.060756 n-d-854030-1 devstack@n-api.service[123016]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 22 17:12:06.061702 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h2-854030-1'}}} Aug 22 17:12:06.061702 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:06.061702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:06.061702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:06.061702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:06.061702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:06.061702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:06.061702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:06.061702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:06.061702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:06.061702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:06.061702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 22 17:12:06.061702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 22 17:12:06.061702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:12:06.061702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:12:06.061702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:12:06.061702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:12:06.061702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:12:06.061702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:12:06.062936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:12:06.062936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:12:06.062936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:12:06.062936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:12:06.062936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:12:06.062936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:12:06.062936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:12:06.062936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:12:06.062936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 22 17:12:06.062936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.062936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:06.062936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.062936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:06.062936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:06.062936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:06.062936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:12:06.062936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:12:06.062936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 22 17:12:06.062936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.065913 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7f631cc4-8e60-4657-9196-1746bde9f00c tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:06.073777 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7f631cc4-8e60-4657-9196-1746bde9f00c tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] 10.222.0.96 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.321190 Aug 22 17:12:06.073777 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 109/229] 10.222.0.96 () {60 vars in 1191 bytes} [Mon Aug 22 17:12:05 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 335 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:12:06.085672 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2b60a976-2f2a-4322-9c1d-ef36d06c7430 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Calling method '.version_select at 0x7f800a01baf0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:06.088853 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2b60a976-2f2a-4322-9c1d-ef36d06c7430 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:06.089934 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2b60a976-2f2a-4322-9c1d-ef36d06c7430 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:06.091561 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2b60a976-2f2a-4322-9c1d-ef36d06c7430 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:06.109576 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-2b60a976-2f2a-4322-9c1d-ef36d06c7430 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] HTTP exception thrown: No hypervisor matching '7b32aa68-0861-4904-adaf-042e89e4987e' could be found. Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2b60a976-2f2a-4322-9c1d-ef36d06c7430 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Request method failure captured: Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-hypervisors/7b32aa68-0861-4904-adaf-042e89e4987e/servers HTTP/1.1 Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7jjMj24ewsdVUoMEg-qvqwkgolzoJWgDT2zPz9e0hbnOLJ-Nlmo_xWsQr_hTNCvM22AXUZPo78cWtOmKduM-h5DMrkY3tRsLXsq2YdFnedzLz8566wUVS1AkgnfafKJgMgmF-fJaJYdYcr2xVgFSH6x6wgh32voryhVjldYH-Ktze4 Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 6691d4a0478d457abbacc52bcf82fa6a Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1816016409 Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:12:06.111761 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:12:06.112943 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/6691d4a0478d457abbacc52bcf82fa6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_6691d4a0478d457abbacc52bcf82fa6a", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/6691d4a0478d457abbacc52bcf82fa6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/6691d4a0478d457abbacc52bcf82fa6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:06.112943 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1816016409 Aug 22 17:12:06.112943 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 6691d4a0478d457abbacc52bcf82fa6a Aug 22 17:12:06.112943 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1816016409 Aug 22 17:12:06.112943 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin Aug 22 17:12:06.112943 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:12:06.112943 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:12:06.112943 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: e596fddd6d8c4925ac5a8f9277576783 Aug 22 17:12:06.112943 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin Aug 22 17:12:06.112943 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:12:06.112943 n-d-854030-1 devstack@n-api.service[123016]: exception: No hypervisor matching '7b32aa68-0861-4904-adaf-042e89e4987e' could be found. Aug 22 17:12:06.112943 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '7b32aa68-0861-4904-adaf-042e89e4987e'} Aug 22 17:12:06.113643 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:06.113643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:06.113643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:06.113643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:06.113643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:06.113643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:06.113643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:12:06.113643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:12:06.113643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:06.113643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:06.113643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 22 17:12:06.113643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 22 17:12:06.113643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 22 17:12:06.113643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 22 17:12:06.113643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '7b32aa68-0861-4904-adaf-042e89e4987e' could be found. Aug 22 17:12:06.113643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.113643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:06.113643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.113643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:06.115768 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:06.115768 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:06.115768 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:06.115768 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:06.115768 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '7b32aa68-0861-4904-adaf-042e89e4987e' could be found. Aug 22 17:12:06.115768 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.115768 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2b60a976-2f2a-4322-9c1d-ef36d06c7430 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] Returning 404 to user: No hypervisor matching '7b32aa68-0861-4904-adaf-042e89e4987e' could be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:06.115768 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2b60a976-2f2a-4322-9c1d-ef36d06c7430 tempest-HypervisorAdminNegativeUnderV252Test-1816016409 tempest-HypervisorAdminNegativeUnderV252Test-1816016409-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/7b32aa68-0861-4904-adaf-042e89e4987e/servers" status: 404 len: 123 microversion: 2.1 time: 0.038452 Aug 22 17:12:06.115768 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 110/230] 10.222.0.96 () {58 vars in 1281 bytes} [Mon Aug 22 17:12:06 2022] GET /compute/v2.1/os-hypervisors/7b32aa68-0861-4904-adaf-042e89e4987e/servers => generated 123 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:12:06.121992 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7e5746f0-dedc-48ad-8408-2134c463261b tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:06.122709 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:06.122709 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:06.146426 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-7e5746f0-dedc-48ad-8408-2134c463261b tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7e5746f0-dedc-48ad-8408-2134c463261b tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Request method failure captured: Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7ius5FRO2oMeoDcwn-CWhYp2Z0cgpv0eUKdsB7l72VvQuJvcC3MY6DNWH7GMXgSNv3qgLJzClezH1DNZGAxzkxzzsJYedK7kXo46ksJlCf9TdKyxVAIruSsdvis_pUyIKCr0XkTBWkl36DpCuMJG-BheHY58C1SsTvDDrMqd3U3jOk Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 157bdd8a62f74b5882e35941d155fcfe Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-AggregatesAdminTestJSON-874832260 Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:12:06.148406 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:12:06.150429 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/157bdd8a62f74b5882e35941d155fcfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_157bdd8a62f74b5882e35941d155fcfe", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/157bdd8a62f74b5882e35941d155fcfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/157bdd8a62f74b5882e35941d155fcfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:06.150429 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-AggregatesAdminTestJSON-874832260 Aug 22 17:12:06.150429 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 157bdd8a62f74b5882e35941d155fcfe Aug 22 17:12:06.150429 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-874832260 Aug 22 17:12:06.150429 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-AggregatesAdminTestJSON-874832260-project-admin Aug 22 17:12:06.150429 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:12:06.150429 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:12:06.150429 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 7951126845c5415a9c228f3b77f6c0f0 Aug 22 17:12:06.150429 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-AggregatesAdminTestJSON-874832260-project-admin Aug 22 17:12:06.150429 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:12:06.150429 n-d-854030-1 devstack@n-api.service[123016]: exception: Aggregate 8 could not be found. Aug 22 17:12:06.150429 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '8'} Aug 22 17:12:06.150429 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:06.151132 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:06.151132 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 22 17:12:06.151132 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 22 17:12:06.151132 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 22 17:12:06.151132 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 22 17:12:06.151132 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:12:06.151132 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:12:06.151132 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:12:06.151132 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:12:06.151132 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 22 17:12:06.151132 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 22 17:12:06.151132 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 22 17:12:06.151132 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 22 17:12:06.151132 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:12:06.151132 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:12:06.151132 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 22 17:12:06.151132 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 22 17:12:06.151132 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:12:06.151132 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:06.157589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:06.159042 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:06.159042 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:06.159042 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:06.159042 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Aug 22 17:12:06.159042 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.159042 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7e5746f0-dedc-48ad-8408-2134c463261b tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:06.159042 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7e5746f0-dedc-48ad-8408-2134c463261b tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.035886 Aug 22 17:12:06.159042 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 111/231] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:12:06 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:12:06.159042 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-bb31bca1-0973-447d-9033-6710010b4356 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:06.324673 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-bb31bca1-0973-447d-9033-6710010b4356 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.171503 Aug 22 17:12:06.326030 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 112/232] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:12:06 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 22 17:12:06.331417 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-18c21157-2501-49d6-a40a-24e497eee490 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1788845906"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:06.334512 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:06.334512 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:06.336748 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.aggregate [None req-18c21157-2501-49d6-a40a-24e497eee490 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Generated uuid cc7503e4-91e3-471d-931a-0be386814b41 for aggregate {{(pid=123016) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:12:06.440287 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-74f7e634-8a41-46f0-8e92-f85ce5f8e8fd tempest-QuotaClassesAdmin257Test-2070649055 tempest-QuotaClassesAdmin257Test-2070649055-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.927768 Aug 22 17:12:06.441559 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 121/233] 10.222.0.96 () {62 vars in 1247 bytes} [Mon Aug 22 17:12:05 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:12:06.455154 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9b6f98e3-a6df-4818-be1e-eaf2e1462b75 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2078851954"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:06.458809 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:06.458809 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:06.464393 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.aggregate [None req-9b6f98e3-a6df-4818-be1e-eaf2e1462b75 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Generated uuid 359481f3-f50e-45b5-86c6-6b16ee2a2400 for aggregate {{(pid=123015) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:12:06.499762 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-18c21157-2501-49d6-a40a-24e497eee490 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.172437 Aug 22 17:12:06.501016 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 113/234] 10.222.0.96 () {60 vars in 1164 bytes} [Mon Aug 22 17:12:06 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:06.509501 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e5b7444c-206d-4292-9186-f85f2d80bb5a tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:06.519318 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e5b7444c-206d-4292-9186-f85f2d80bb5a tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:06.546264 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5b7444c-206d-4292-9186-f85f2d80bb5a tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:06.546885 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5b7444c-206d-4292-9186-f85f2d80bb5a tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:06.547409 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5b7444c-206d-4292-9186-f85f2d80bb5a tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:06.548230 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5b7444c-206d-4292-9186-f85f2d80bb5a tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:06.550746 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5b7444c-206d-4292-9186-f85f2d80bb5a tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:06.551301 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5b7444c-206d-4292-9186-f85f2d80bb5a tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:06.576586 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9b6f98e3-a6df-4818-be1e-eaf2e1462b75 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.133444 Aug 22 17:12:06.577567 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 122/235] 10.222.0.96 () {60 vars in 1164 bytes} [Mon Aug 22 17:12:06 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:06.582262 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-67abd8e7-37ee-4f34-b1d1-3a4c71fd5540 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:06.583018 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:06.583018 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:06.600665 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-67abd8e7-37ee-4f34-b1d1-3a4c71fd5540 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 228 microversion: 2.1 time: 0.021871 Aug 22 17:12:06.601632 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 123/236] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:12:06 2022] GET /compute/v2.1/os-aggregates/10 => generated 228 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:06.613052 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d6118de0-a29a-44e0-b34e-d96cf386ae9c tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-982261170"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:06.613052 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:06.613052 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:06.625786 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d6118de0-a29a-44e0-b34e-d96cf386ae9c tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:06.626449 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d6118de0-a29a-44e0-b34e-d96cf386ae9c tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:06.627231 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d6118de0-a29a-44e0-b34e-d96cf386ae9c tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:06.641196 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d6118de0-a29a-44e0-b34e-d96cf386ae9c tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:06.641689 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d6118de0-a29a-44e0-b34e-d96cf386ae9c tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:06.642127 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d6118de0-a29a-44e0-b34e-d96cf386ae9c tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:06.650456 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-d6118de0-a29a-44e0-b34e-d96cf386ae9c tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-982261170 could not be found. Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d6118de0-a29a-44e0-b34e-d96cf386ae9c tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Request method failure captured: Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 57 Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7iu7mwCqVfEPXcvEFE_j7zjSxexRLsSV30DitjvjSs1f8gYXw3dHJKj595-9e2rpdJBmdl4yV7fmore24g90lZGLDaH1yHDkSQxpmXAzhxx4Sz34fwuch6eyjD83KohIRHHGzznpTYRbehq0s642dmgm-r6orhynCByFM2Zg_6KT6Y Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 92d0ec50c9764f48a41a30c944c857c0 Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:12:06.653056 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:12:06.654560 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_92d0ec50c9764f48a41a30c944c857c0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:06.654560 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:06.654560 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 92d0ec50c9764f48a41a30c944c857c0 Aug 22 17:12:06.654560 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:06.654560 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin Aug 22 17:12:06.654560 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:06.654560 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:06.654560 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 6bb1a856d20e4266a583cd270e888485 Aug 22 17:12:06.654560 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin Aug 22 17:12:06.654560 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:12:06.654560 n-d-854030-1 devstack@n-api.service[123015]: {"add_host": {"host": "tempest-nonexist_host-982261170"}} Aug 22 17:12:06.654560 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:06.654560 n-d-854030-1 devstack@n-api.service[123015]: exception: Compute host tempest-nonexist_host-982261170 could not be found. Aug 22 17:12:06.655442 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-982261170'}}} Aug 22 17:12:06.655442 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:06.655442 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:06.655442 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5994, in _get_service_in_cell_by_host Aug 22 17:12:06.655442 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 22 17:12:06.655442 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:12:06.655442 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:12:06.655442 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 22 17:12:06.655442 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 22 17:12:06.655442 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:12:06.655442 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:12:06.655442 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 22 17:12:06.655442 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 22 17:12:06.655442 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-982261170' is not mapped to any cell Aug 22 17:12:06.655442 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.655442 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:06.655442 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.655442 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:06.655442 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in _get_service_in_cell_by_host Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6616, in add_host_to_aggregate Aug 22 17:12:06.656665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-982261170 could not be found. Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-982261170 could not be found. Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:06.657945 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.670476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:06.670476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:06.670476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:06.670476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:06.670476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:06.670476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-982261170 could not be found. Aug 22 17:12:06.670476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:06.670476 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d6118de0-a29a-44e0-b34e-d96cf386ae9c tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-982261170 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:06.670476 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d6118de0-a29a-44e0-b34e-d96cf386ae9c tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 110 microversion: 2.1 time: 0.048856 Aug 22 17:12:06.670476 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 124/237] 10.222.0.96 () {60 vars in 1194 bytes} [Mon Aug 22 17:12:06 2022] POST /compute/v2.1/os-aggregates/11/action => generated 110 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:12:06.671181 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3ee3bc44-074b-4061-99bd-c71d921ea306 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:06.671181 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:06.671181 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:06.819813 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3ee3bc44-074b-4061-99bd-c71d921ea306 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 266 microversion: 2.1 time: 0.163033 Aug 22 17:12:06.828660 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 125/238] 10.222.0.96 () {60 vars in 1194 bytes} [Mon Aug 22 17:12:06 2022] POST /compute/v2.1/os-aggregates/10/action => generated 266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:06.847371 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c8dd3a5c-9896-4ded-95b1-c43a9819a7f2 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:06.849512 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:06.849512 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:06.881927 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e5b7444c-206d-4292-9186-f85f2d80bb5a tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:06.891688 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e5b7444c-206d-4292-9186-f85f2d80bb5a tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1319 microversion: 2.1 time: 0.389077 Aug 22 17:12:06.892848 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 114/239] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:06 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:06.900391 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-98706e56-71c5-4386-beef-e1d7e06870e1 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:06.907758 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:06.907758 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:06.920879 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-98706e56-71c5-4386-beef-e1d7e06870e1 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 242 microversion: 2.1 time: 0.025272 Aug 22 17:12:06.921684 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 115/240] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:12:06 2022] GET /compute/v2.1/os-aggregates/10 => generated 242 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:06.939857 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8444000b-3cee-4e4b-bcaa-3931f81d2e20 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:06.946677 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:06.946677 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:07.003911 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c8dd3a5c-9896-4ded-95b1-c43a9819a7f2 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.173416 Aug 22 17:12:07.010251 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 126/241] 10.222.0.96 () {58 vars in 1155 bytes} [Mon Aug 22 17:12:06 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 22 17:12:07.016492 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ce65c4d5-ed2d-44da-adbe-277f4e52f06d tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ce65c4d5-ed2d-44da-adbe-277f4e52f06d tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Request method failure captured: Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 283 Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7iu7mwCqVfEPXcvEFE_j7zjSxexRLsSV30DitjvjSs1f8gYXw3dHJKj595-9e2rpdJBmdl4yV7fmore24g90lZGLDaH1yHDkSQxpmXAzhxx4Sz34fwuch6eyjD83KohIRHHGzznpTYRbehq0s642dmgm-r6orhynCByFM2Zg_6KT6Y Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 92d0ec50c9764f48a41a30c944c857c0 Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:12:07.029507 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:12:07.033858 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_92d0ec50c9764f48a41a30c944c857c0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:07.033858 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:07.033858 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 92d0ec50c9764f48a41a30c944c857c0 Aug 22 17:12:07.033858 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:07.033858 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin Aug 22 17:12:07.033858 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:07.033858 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:07.033858 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 6bb1a856d20e4266a583cd270e888485 Aug 22 17:12:07.033858 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin Aug 22 17:12:07.033858 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:12:07.034767 n-d-854030-1 devstack@n-api.service[123015]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 22 17:12:07.034767 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:07.034767 n-d-854030-1 devstack@n-api.service[123015]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 22 17:12:07.034767 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 22 17:12:07.034767 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:07.034767 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:07.034767 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:12:07.034767 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:12:07.034767 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:12:07.034767 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:12:07.037206 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 22 17:12:07.037206 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.037206 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 22 17:12:07.037206 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 22 17:12:07.037206 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.037206 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 22 17:12:07.037206 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 22 17:12:07.037206 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.037206 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:07.037206 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.037206 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:07.037206 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:07.037206 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:07.037206 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:07.037206 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:07.037206 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:07.037206 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:07.038368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:07.038368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:07.038368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:12:07.038368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:12:07.038368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:12:07.038368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:12:07.038368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:12:07.038368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:12:07.038368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 22 17:12:07.038368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.038368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:07.038368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.038368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:07.038368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:07.038368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:07.039902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:12:07.039902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:12:07.039902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 22 17:12:07.039902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.039902 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ce65c4d5-ed2d-44da-adbe-277f4e52f06d tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:07.040517 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ce65c4d5-ed2d-44da-adbe-277f4e52f06d tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.020551 Aug 22 17:12:07.040517 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 127/242] 10.222.0.96 () {60 vars in 1165 bytes} [Mon Aug 22 17:12:07 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:12:07.048195 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9401aa76-03db-4acb-b701-51e26c235315 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9401aa76-03db-4acb-b701-51e26c235315 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Request method failure captured: Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 27 Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7iu7mwCqVfEPXcvEFE_j7zjSxexRLsSV30DitjvjSs1f8gYXw3dHJKj595-9e2rpdJBmdl4yV7fmore24g90lZGLDaH1yHDkSQxpmXAzhxx4Sz34fwuch6eyjD83KohIRHHGzznpTYRbehq0s642dmgm-r6orhynCByFM2Zg_6KT6Y Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 92d0ec50c9764f48a41a30c944c857c0 Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:12:07.053302 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:12:07.054795 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_92d0ec50c9764f48a41a30c944c857c0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:07.054795 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:07.054795 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 92d0ec50c9764f48a41a30c944c857c0 Aug 22 17:12:07.054795 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:07.054795 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin Aug 22 17:12:07.054795 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:07.054795 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:07.054795 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 6bb1a856d20e4266a583cd270e888485 Aug 22 17:12:07.054795 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin Aug 22 17:12:07.054795 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:12:07.054795 n-d-854030-1 devstack@n-api.service[123015]: {"aggregate": {"name": ""}} Aug 22 17:12:07.054795 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:07.054795 n-d-854030-1 devstack@n-api.service[123015]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi '' Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:07.056216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 22 17:12:07.058299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.059590 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9401aa76-03db-4acb-b701-51e26c235315 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:07.059590 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9401aa76-03db-4acb-b701-51e26c235315 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.013662 Aug 22 17:12:07.059590 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 128/243] 10.222.0.96 () {60 vars in 1164 bytes} [Mon Aug 22 17:12:07 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:12:07.069065 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-99e57060-17a4-4f62-81e0-be12ce749b58 tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1498549577"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:07.069065 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:07.069065 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:07.069547 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-99e57060-17a4-4f62-81e0-be12ce749b58 tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '308ee6c6db3c4d689d5907293bf045ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad4c5b924db48f39f47a5e184cce700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-99e57060-17a4-4f62-81e0-be12ce749b58 tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Request method failure captured: Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 60 Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7ir1nOQ22WGoYnd3y6_dSSj4Yt_RbejTa6QhMujNneOmuyIebOh-1wl8iFJgz_vW7zgrTjiOF42OCssk0-EdgKFLud9rMeoGkklis_ni66jIOYHLCAjrHFSJ45tnsuGVECLPDEBZVM8aj682VH7IJtQgFyfs26RtA0y_nJfevA9bSI Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 9ad4c5b924db48f39f47a5e184cce700 Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1583174465 Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:12:07.071248 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:12:07.072771 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ad4c5b924db48f39f47a5e184cce700"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9ad4c5b924db48f39f47a5e184cce700", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ad4c5b924db48f39f47a5e184cce700"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9ad4c5b924db48f39f47a5e184cce700"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:07.072771 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1583174465 Aug 22 17:12:07.072771 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 9ad4c5b924db48f39f47a5e184cce700 Aug 22 17:12:07.072771 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1583174465 Aug 22 17:12:07.072771 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-AggregatesAdminNegativeTestJSON-1583174465-project Aug 22 17:12:07.072771 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:07.072771 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:07.072771 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 308ee6c6db3c4d689d5907293bf045ca Aug 22 17:12:07.072771 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1583174465-project Aug 22 17:12:07.072771 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:12:07.072771 n-d-854030-1 devstack@n-api.service[123015]: {"aggregate": {"name": "tempest-test_aggregate-1498549577"}} Aug 22 17:12:07.072771 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:07.072771 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 22 17:12:07.077548 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1498549577'}}} Aug 22 17:12:07.077548 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:07.077548 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:07.077548 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:07.077548 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:07.077548 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:07.077548 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:07.077548 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:07.077548 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:07.077548 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:07.077548 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:07.077548 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:07.077548 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:07.077548 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 22 17:12:07.077548 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 22 17:12:07.077548 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:12:07.077548 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:12:07.077548 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:12:07.077548 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:12:07.078782 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 22 17:12:07.082784 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.082784 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-99e57060-17a4-4f62-81e0-be12ce749b58 tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:07.082784 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-99e57060-17a4-4f62-81e0-be12ce749b58 tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.011065 Aug 22 17:12:07.082784 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 129/244] 10.222.0.96 () {60 vars in 1164 bytes} [Mon Aug 22 17:12:07 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:12:07.083650 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e070425b-99eb-4409-adf6-f70a77ecaf17 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-513070885"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:07.087724 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.aggregate [None req-e070425b-99eb-4409-adf6-f70a77ecaf17 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Generated uuid f4025683-5c0f-46a1-a52c-7683eeb621a6 for aggregate {{(pid=123015) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:12:07.182322 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8444000b-3cee-4e4b-bcaa-3931f81d2e20 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.252115 Aug 22 17:12:07.183250 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 116/245] 10.222.0.96 () {58 vars in 1155 bytes} [Mon Aug 22 17:12:06 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 22 17:12:07.192476 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-77599684-5e2f-459b-8625-3776f47f9e96 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1696004689", "availability_zone": "tempest-test_az-1975574777"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:07.197997 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:07.197997 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:07.199927 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.aggregate [None req-77599684-5e2f-459b-8625-3776f47f9e96 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Generated uuid 3cc67673-625e-4bdd-8090-2c0d190fc60c for aggregate {{(pid=123016) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:12:07.208641 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e070425b-99eb-4409-adf6-f70a77ecaf17 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.129619 Aug 22 17:12:07.209662 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 130/246] 10.222.0.96 () {60 vars in 1164 bytes} [Mon Aug 22 17:12:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:12:07.227674 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c0609c16-7c38-4c83-9fde-99be9d801bbe tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-513070885"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:07.230451 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:07.230451 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:07.232576 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.aggregate [None req-c0609c16-7c38-4c83-9fde-99be9d801bbe tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Generated uuid ce5483f4-1174-49a4-bd37-6d60bd601e28 for aggregate {{(pid=123015) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:12:07.243518 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-c0609c16-7c38-4c83-9fde-99be9d801bbe tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-513070885 already exists. Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c0609c16-7c38-4c83-9fde-99be9d801bbe tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Request method failure captured: Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 59 Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7iu7mwCqVfEPXcvEFE_j7zjSxexRLsSV30DitjvjSs1f8gYXw3dHJKj595-9e2rpdJBmdl4yV7fmore24g90lZGLDaH1yHDkSQxpmXAzhxx4Sz34fwuch6eyjD83KohIRHHGzznpTYRbehq0s642dmgm-r6orhynCByFM2Zg_6KT6Y Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 92d0ec50c9764f48a41a30c944c857c0 Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:12:07.246684 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:12:07.247880 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_92d0ec50c9764f48a41a30c944c857c0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:07.247880 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:07.247880 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 92d0ec50c9764f48a41a30c944c857c0 Aug 22 17:12:07.247880 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:07.247880 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin Aug 22 17:12:07.247880 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:07.247880 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:07.247880 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 6bb1a856d20e4266a583cd270e888485 Aug 22 17:12:07.247880 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin Aug 22 17:12:07.247880 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:12:07.247880 n-d-854030-1 devstack@n-api.service[123015]: {"aggregate": {"name": "tempest-test_aggregate-513070885"}} Aug 22 17:12:07.247880 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:07.247880 n-d-854030-1 devstack@n-api.service[123015]: exception: Aggregate tempest-test_aggregate-513070885 already exists. Aug 22 17:12:07.248574 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-513070885'}}} Aug 22 17:12:07.248574 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:07.248574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:07.248574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 22 17:12:07.248574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 22 17:12:07.248574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 22 17:12:07.248574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 22 17:12:07.248574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:12:07.248574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:12:07.248574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:12:07.248574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:12:07.248574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 22 17:12:07.248574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 22 17:12:07.248574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6453, in create_aggregate Aug 22 17:12:07.248574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 22 17:12:07.248574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 22 17:12:07.248574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 22 17:12:07.248574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 22 17:12:07.248574 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-513070885 already exists. Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:07.249619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 22 17:12:07.250695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 22 17:12:07.250695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-513070885 already exists. Aug 22 17:12:07.250695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.250695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:07.250695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.250695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:07.250695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:07.250695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:07.250695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:07.250695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:07.250695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-513070885 already exists. Aug 22 17:12:07.250695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.250695 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c0609c16-7c38-4c83-9fde-99be9d801bbe tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-513070885 already exists. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:07.250695 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c0609c16-7c38-4c83-9fde-99be9d801bbe tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.023367 Aug 22 17:12:07.251459 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 131/247] 10.222.0.96 () {60 vars in 1164 bytes} [Mon Aug 22 17:12:07 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 24 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 22 17:12:07.254818 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-649e6dfe-9aec-4bd3-8ccd-505178c87512 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:07.255574 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:07.255574 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:07.266482 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:DELETE=6,nova_api:UPDATE=7 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:07.330810 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-77599684-5e2f-459b-8625-3776f47f9e96 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.142319 Aug 22 17:12:07.331640 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 117/248] 10.222.0.96 () {60 vars in 1165 bytes} [Mon Aug 22 17:12:07 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:12:07.343468 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1a64b28a-affd-4224-b87d-78da4f17a682 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1696004689_new", "availability_zone": "tempest-test_az-1975574777_new"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:07.388259 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-649e6dfe-9aec-4bd3-8ccd-505178c87512 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.136809 Aug 22 17:12:07.388884 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 132/249] 10.222.0.96 () {58 vars in 1155 bytes} [Mon Aug 22 17:12:07 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 22 17:12:07.402631 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6bf7507e-7f17-4f9d-9c49-0f13c2ca2dac tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-513950857"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:07.406721 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:07.406721 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:07.414882 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.aggregate [None req-6bf7507e-7f17-4f9d-9c49-0f13c2ca2dac tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Generated uuid 8b3477bd-0440-4cb7-ac73-f1c240801e8c for aggregate {{(pid=123015) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:12:07.470569 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:07.470569 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:07.520361 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6bf7507e-7f17-4f9d-9c49-0f13c2ca2dac tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.125480 Aug 22 17:12:07.529119 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 133/250] 10.222.0.96 () {60 vars in 1164 bytes} [Mon Aug 22 17:12:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:07.535321 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-41e60590-a623-4003-95c8-c77d007e445a tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:07.536340 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:07.536340 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:07.537869 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-41e60590-a623-4003-95c8-c77d007e445a tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '308ee6c6db3c4d689d5907293bf045ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad4c5b924db48f39f47a5e184cce700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-41e60590-a623-4003-95c8-c77d007e445a tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Request method failure captured: Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7ir1nOQ22WGoYnd3y6_dSSj4Yt_RbejTa6QhMujNneOmuyIebOh-1wl8iFJgz_vW7zgrTjiOF42OCssk0-EdgKFLud9rMeoGkklis_ni66jIOYHLCAjrHFSJ45tnsuGVECLPDEBZVM8aj682VH7IJtQgFyfs26RtA0y_nJfevA9bSI Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 9ad4c5b924db48f39f47a5e184cce700 Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1583174465 Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:12:07.540329 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:12:07.541723 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ad4c5b924db48f39f47a5e184cce700"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9ad4c5b924db48f39f47a5e184cce700", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ad4c5b924db48f39f47a5e184cce700"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9ad4c5b924db48f39f47a5e184cce700"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:07.541723 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1583174465 Aug 22 17:12:07.541723 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 9ad4c5b924db48f39f47a5e184cce700 Aug 22 17:12:07.541723 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1583174465 Aug 22 17:12:07.541723 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-AggregatesAdminNegativeTestJSON-1583174465-project Aug 22 17:12:07.541723 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:07.541723 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:07.541723 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 308ee6c6db3c4d689d5907293bf045ca Aug 22 17:12:07.541723 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1583174465-project Aug 22 17:12:07.541723 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:07.541723 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 22 17:12:07.541723 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '14'} Aug 22 17:12:07.542523 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:07.542523 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:07.542523 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:07.542523 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:07.542523 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:07.542523 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:07.542523 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:07.542523 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:07.542523 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 22 17:12:07.542523 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 22 17:12:07.542523 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:12:07.542523 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:12:07.542523 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:12:07.542523 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:12:07.542523 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:12:07.542523 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:12:07.542523 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:12:07.542523 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:12:07.542523 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:12:07.543705 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:12:07.543705 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:12:07.543705 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:12:07.543705 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:12:07.543705 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:12:07.543705 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 22 17:12:07.543705 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.543705 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:07.543705 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.543705 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:07.543705 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:07.543705 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:07.543705 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:12:07.543705 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:12:07.543705 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 22 17:12:07.543705 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.546528 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-41e60590-a623-4003-95c8-c77d007e445a tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:07.547660 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-41e60590-a623-4003-95c8-c77d007e445a tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/14" status: 403 len: 116 microversion: 2.1 time: 0.017265 Aug 22 17:12:07.551826 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 134/251] 10.222.0.96 () {58 vars in 1155 bytes} [Mon Aug 22 17:12:07 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 116 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:12:07.559253 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7c22f901-b961-40b4-88ea-64cb50801740 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:07.633523 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1a64b28a-affd-4224-b87d-78da4f17a682 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:07.634484 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1a64b28a-affd-4224-b87d-78da4f17a682 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:07.636012 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1a64b28a-affd-4224-b87d-78da4f17a682 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:07.663631 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7c22f901-b961-40b4-88ea-64cb50801740 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.110240 Aug 22 17:12:07.671563 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 135/252] 10.222.0.96 () {58 vars in 1155 bytes} [Mon Aug 22 17:12:07 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 22 17:12:07.681166 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5c033288-4305-4e1b-979b-dbcb2ecb72ec tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:07.682812 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:07.682812 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:07.710389 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-5c033288-4305-4e1b-979b-dbcb2ecb72ec tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5c033288-4305-4e1b-979b-dbcb2ecb72ec tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Request method failure captured: Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7iu7mwCqVfEPXcvEFE_j7zjSxexRLsSV30DitjvjSs1f8gYXw3dHJKj595-9e2rpdJBmdl4yV7fmore24g90lZGLDaH1yHDkSQxpmXAzhxx4Sz34fwuch6eyjD83KohIRHHGzznpTYRbehq0s642dmgm-r6orhynCByFM2Zg_6KT6Y Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 92d0ec50c9764f48a41a30c944c857c0 Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:12:07.715147 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:12:07.716501 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_92d0ec50c9764f48a41a30c944c857c0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:07.716501 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:07.716501 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 92d0ec50c9764f48a41a30c944c857c0 Aug 22 17:12:07.716501 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:07.716501 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin Aug 22 17:12:07.716501 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:07.716501 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:07.716501 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 6bb1a856d20e4266a583cd270e888485 Aug 22 17:12:07.716501 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin Aug 22 17:12:07.716501 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:07.716501 n-d-854030-1 devstack@n-api.service[123015]: exception: Aggregate -1 could not be found. Aug 22 17:12:07.716501 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '-1'} Aug 22 17:12:07.717863 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:07.717863 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:07.717863 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 22 17:12:07.717863 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 22 17:12:07.717863 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 22 17:12:07.717863 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 22 17:12:07.717863 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:12:07.717863 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:12:07.717863 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:12:07.717863 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:12:07.717863 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 22 17:12:07.717863 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 22 17:12:07.717863 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 22 17:12:07.717863 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 22 17:12:07.717863 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:12:07.717863 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:12:07.717863 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 22 17:12:07.717863 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 22 17:12:07.717863 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.719053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:07.721485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:07.721485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:07.721485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:07.721485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:07.721485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 22 17:12:07.721485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:07.723923 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5c033288-4305-4e1b-979b-dbcb2ecb72ec tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:07.726117 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5c033288-4305-4e1b-979b-dbcb2ecb72ec tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.053388 Aug 22 17:12:07.732357 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 136/253] 10.222.0.96 () {58 vars in 1155 bytes} [Mon Aug 22 17:12:07 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:12:07.745937 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a1374844-2243-42f9-bd4f-e21e6a030c32 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-210056968"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:07.749652 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:07.749652 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:07.750973 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.aggregate [None req-a1374844-2243-42f9-bd4f-e21e6a030c32 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Generated uuid d4476361-bab9-4d92-beeb-a902963bb83a for aggregate {{(pid=123015) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:12:08.299494 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:08.675075 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1a64b28a-affd-4224-b87d-78da4f17a682 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-aggregates/13" status: 200 len: 337 microversion: 2.1 time: 1.335836 Aug 22 17:12:08.684855 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 118/254] 10.222.0.96 () {60 vars in 1173 bytes} [Mon Aug 22 17:12:07 2022] PUT /compute/v2.1/os-aggregates/13 => generated 337 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:12:08.690334 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7e81345e-bc1f-4578-9808-b3caa76aa3dc tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:08.690962 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-7e81345e-bc1f-4578-9808-b3caa76aa3dc tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:08.699482 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e81345e-bc1f-4578-9808-b3caa76aa3dc tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:08.700103 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e81345e-bc1f-4578-9808-b3caa76aa3dc tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:08.700533 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e81345e-bc1f-4578-9808-b3caa76aa3dc tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:08.701311 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e81345e-bc1f-4578-9808-b3caa76aa3dc tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:08.701769 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e81345e-bc1f-4578-9808-b3caa76aa3dc tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:08.702198 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e81345e-bc1f-4578-9808-b3caa76aa3dc tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:08.861939 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-7e81345e-bc1f-4578-9808-b3caa76aa3dc tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:08.870515 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7e81345e-bc1f-4578-9808-b3caa76aa3dc tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1319 microversion: 2.1 time: 0.184330 Aug 22 17:12:08.871075 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 119/255] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:08 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:08.875315 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-42093b3d-21dc-40ce-a083-53eb72aa80c5 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:08.876172 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:08.876172 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:08.882913 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-42093b3d-21dc-40ce-a083-53eb72aa80c5 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.010864 Aug 22 17:12:08.883639 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 120/256] 10.222.0.96 () {58 vars in 1143 bytes} [Mon Aug 22 17:12:08 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:08.894063 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4196ee0c-ed13-47ea-80b5-c58b9b3e4ae6 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:08.894813 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:08.894813 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:09.271338 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a1374844-2243-42f9-bd4f-e21e6a030c32 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 1.537493 Aug 22 17:12:09.278880 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 137/257] 10.222.0.96 () {60 vars in 1164 bytes} [Mon Aug 22 17:12:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:09.284047 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-83e11675-754e-4721-ab74-39d675930c2d tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:09.284762 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:09.284762 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:09.285638 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-83e11675-754e-4721-ab74-39d675930c2d tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '308ee6c6db3c4d689d5907293bf045ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad4c5b924db48f39f47a5e184cce700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-83e11675-754e-4721-ab74-39d675930c2d tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Request method failure captured: Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7ir1nOQ22WGoYnd3y6_dSSj4Yt_RbejTa6QhMujNneOmuyIebOh-1wl8iFJgz_vW7zgrTjiOF42OCssk0-EdgKFLud9rMeoGkklis_ni66jIOYHLCAjrHFSJ45tnsuGVECLPDEBZVM8aj682VH7IJtQgFyfs26RtA0y_nJfevA9bSI Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 9ad4c5b924db48f39f47a5e184cce700 Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1583174465 Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:12:09.287307 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:12:09.288802 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ad4c5b924db48f39f47a5e184cce700"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9ad4c5b924db48f39f47a5e184cce700", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ad4c5b924db48f39f47a5e184cce700"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9ad4c5b924db48f39f47a5e184cce700"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:09.288802 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1583174465 Aug 22 17:12:09.288802 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 9ad4c5b924db48f39f47a5e184cce700 Aug 22 17:12:09.288802 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1583174465 Aug 22 17:12:09.288802 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-AggregatesAdminNegativeTestJSON-1583174465-project Aug 22 17:12:09.288802 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:09.288802 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:09.288802 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 308ee6c6db3c4d689d5907293bf045ca Aug 22 17:12:09.288802 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1583174465-project Aug 22 17:12:09.288802 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:09.288802 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 22 17:12:09.288802 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '15'} Aug 22 17:12:09.293205 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:09.293205 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:09.293205 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:09.293205 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:09.293205 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:09.293205 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:09.293205 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:09.293205 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:09.293205 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 22 17:12:09.293205 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 22 17:12:09.293205 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:12:09.293205 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:12:09.293205 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:12:09.293205 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:12:09.293205 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:12:09.293205 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:12:09.293205 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:12:09.293205 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:12:09.293205 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:12:09.294764 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:12:09.294764 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:12:09.294764 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:12:09.294764 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:12:09.294764 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:12:09.294764 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 22 17:12:09.294764 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:09.294764 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:09.294764 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:09.294764 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:09.294764 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:09.294764 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:09.294764 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:12:09.294764 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:12:09.294764 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 22 17:12:09.294764 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:09.294764 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-83e11675-754e-4721-ab74-39d675930c2d tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:09.295952 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-83e11675-754e-4721-ab74-39d675930c2d tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] 10.222.0.96 "GET /compute/v2.1/os-aggregates/15" status: 403 len: 114 microversion: 2.1 time: 0.009009 Aug 22 17:12:09.295952 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 138/258] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:12:09 2022] GET /compute/v2.1/os-aggregates/15 => generated 114 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:12:09.297496 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c4fa27a4-9681-45f6-be16-7ca1f55228eb tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:09.298265 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:09.298265 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:09.418802 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c4fa27a4-9681-45f6-be16-7ca1f55228eb tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.124537 Aug 22 17:12:09.423190 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 139/259] 10.222.0.96 () {58 vars in 1155 bytes} [Mon Aug 22 17:12:09 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 22 17:12:09.428140 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1a0abf77-5533-4e01-9cee-17c1663dc4be tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:09.428903 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:09.428903 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:09.457736 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-1a0abf77-5533-4e01-9cee-17c1663dc4be tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1a0abf77-5533-4e01-9cee-17c1663dc4be tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Request method failure captured: Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7iu7mwCqVfEPXcvEFE_j7zjSxexRLsSV30DitjvjSs1f8gYXw3dHJKj595-9e2rpdJBmdl4yV7fmore24g90lZGLDaH1yHDkSQxpmXAzhxx4Sz34fwuch6eyjD83KohIRHHGzznpTYRbehq0s642dmgm-r6orhynCByFM2Zg_6KT6Y Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 92d0ec50c9764f48a41a30c944c857c0 Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:12:09.462110 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:12:09.463528 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_92d0ec50c9764f48a41a30c944c857c0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:09.463528 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:09.463528 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 92d0ec50c9764f48a41a30c944c857c0 Aug 22 17:12:09.463528 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:09.463528 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin Aug 22 17:12:09.463528 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:09.463528 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:09.463528 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 6bb1a856d20e4266a583cd270e888485 Aug 22 17:12:09.463528 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin Aug 22 17:12:09.463528 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:09.463528 n-d-854030-1 devstack@n-api.service[123015]: exception: Aggregate -1 could not be found. Aug 22 17:12:09.463528 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '-1'} Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:09.464777 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:09.471389 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:09.471389 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:09.471389 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:09.471389 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:09.471389 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:09.471389 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 22 17:12:09.471389 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:12:09.471389 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 22 17:12:09.471389 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:09.471389 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:09.471389 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:09.471389 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:09.471389 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:09.471389 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:09.471389 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:09.471389 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:09.471389 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 22 17:12:09.471389 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:09.473693 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1a0abf77-5533-4e01-9cee-17c1663dc4be tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:09.473693 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1a0abf77-5533-4e01-9cee-17c1663dc4be tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.040517 Aug 22 17:12:09.473693 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 140/260] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:12:09 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 22 17:12:09.485247 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1037e38f-b84b-45ed-b6fb-3d18f866913e tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:09.486147 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:09.486147 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:09.495692 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1037e38f-b84b-45ed-b6fb-3d18f866913e tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '308ee6c6db3c4d689d5907293bf045ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad4c5b924db48f39f47a5e184cce700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1037e38f-b84b-45ed-b6fb-3d18f866913e tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Request method failure captured: Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7ir1nOQ22WGoYnd3y6_dSSj4Yt_RbejTa6QhMujNneOmuyIebOh-1wl8iFJgz_vW7zgrTjiOF42OCssk0-EdgKFLud9rMeoGkklis_ni66jIOYHLCAjrHFSJ45tnsuGVECLPDEBZVM8aj682VH7IJtQgFyfs26RtA0y_nJfevA9bSI Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 9ad4c5b924db48f39f47a5e184cce700 Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1583174465 Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:12:09.498037 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:12:09.499180 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ad4c5b924db48f39f47a5e184cce700"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9ad4c5b924db48f39f47a5e184cce700", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ad4c5b924db48f39f47a5e184cce700"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9ad4c5b924db48f39f47a5e184cce700"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:09.499180 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1583174465 Aug 22 17:12:09.499180 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 9ad4c5b924db48f39f47a5e184cce700 Aug 22 17:12:09.499180 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1583174465 Aug 22 17:12:09.499180 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-AggregatesAdminNegativeTestJSON-1583174465-project Aug 22 17:12:09.499180 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:09.499180 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:09.499180 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 308ee6c6db3c4d689d5907293bf045ca Aug 22 17:12:09.499180 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1583174465-project Aug 22 17:12:09.499180 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:09.499180 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 22 17:12:09.499180 n-d-854030-1 devstack@n-api.service[123015]: action_args: {} Aug 22 17:12:09.500116 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:09.500116 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:09.500116 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:09.500116 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:09.500116 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:09.500116 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:09.500116 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:09.500116 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:09.500116 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 22 17:12:09.500116 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 22 17:12:09.500116 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:12:09.500116 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:12:09.500116 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:12:09.500116 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:12:09.500116 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:12:09.500116 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:12:09.500116 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:12:09.500116 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:12:09.500116 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:12:09.502153 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:12:09.502153 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:12:09.502153 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:12:09.502153 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:12:09.502153 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:12:09.502153 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 22 17:12:09.502153 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:09.502153 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:09.502153 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:09.502153 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:09.502153 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:09.502153 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:09.502153 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:12:09.502153 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:12:09.502153 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 22 17:12:09.502153 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:09.502153 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1037e38f-b84b-45ed-b6fb-3d18f866913e tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:09.517590 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1037e38f-b84b-45ed-b6fb-3d18f866913e tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] 10.222.0.96 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.032094 Aug 22 17:12:09.517590 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 141/261] 10.222.0.96 () {58 vars in 1143 bytes} [Mon Aug 22 17:12:09 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:12:09.535017 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f01cf3ac-8369-4507-8f15-622173298355 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1253809862"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:09.541914 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:09.541914 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:09.543967 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.aggregate [None req-f01cf3ac-8369-4507-8f15-622173298355 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Generated uuid 7d593f14-9240-432c-b457-ad62f0e1c2bb for aggregate {{(pid=123015) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:12:09.553237 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4196ee0c-ed13-47ea-80b5-c58b9b3e4ae6 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.661543 Aug 22 17:12:09.558583 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 121/262] 10.222.0.96 () {58 vars in 1155 bytes} [Mon Aug 22 17:12:08 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 22 17:12:09.567148 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d0768577-ea49-46e2-8ebd-cbc445dedb23 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1911076186"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:09.573378 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:09.573378 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:09.574419 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.aggregate [None req-d0768577-ea49-46e2-8ebd-cbc445dedb23 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Generated uuid 4ada1d4a-96d2-48ef-8744-bb0789bc8d80 for aggregate {{(pid=123016) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:12:09.741906 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f01cf3ac-8369-4507-8f15-622173298355 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.221002 Aug 22 17:12:09.744216 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 142/263] 10.222.0.96 () {60 vars in 1164 bytes} [Mon Aug 22 17:12:09 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:12:09.748947 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d0768577-ea49-46e2-8ebd-cbc445dedb23 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.188682 Aug 22 17:12:09.750164 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 122/264] 10.222.0.96 () {60 vars in 1164 bytes} [Mon Aug 22 17:12:09 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:09.754059 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-36396f45-85f1-45f5-9fbf-8dfe8f979d6c tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854030-1"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:09.759763 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:09.759763 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:09.765575 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-36396f45-85f1-45f5-9fbf-8dfe8f979d6c tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:09.766068 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-36396f45-85f1-45f5-9fbf-8dfe8f979d6c tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:09.766507 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-36396f45-85f1-45f5-9fbf-8dfe8f979d6c tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:09.767519 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-42bfdcf7-d485-44f0-a27a-4ef41d3dba9c tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:09.789631 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:09.789631 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:09.820135 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-42bfdcf7-d485-44f0-a27a-4ef41d3dba9c tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "GET /compute/v2.1/os-aggregates" status: 200 len: 446 microversion: 2.1 time: 0.063542 Aug 22 17:12:09.821331 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 123/265] 10.222.0.96 () {58 vars in 1143 bytes} [Mon Aug 22 17:12:09 2022] GET /compute/v2.1/os-aggregates => generated 446 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:12:09.832056 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-80a7fe55-4155-4fad-89c2-e949b54fc557 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:09.833181 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:09.833181 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:09.990024 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-80a7fe55-4155-4fad-89c2-e949b54fc557 tempest-AggregatesAdminTestJSON-874832260 tempest-AggregatesAdminTestJSON-874832260-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.153570 Aug 22 17:12:09.990024 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 124/266] 10.222.0.96 () {58 vars in 1155 bytes} [Mon Aug 22 17:12:09 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 22 17:12:09.996452 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-af045392-8a1b-4e40-95ee-46182035af50 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:09.997282 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-af045392-8a1b-4e40-95ee-46182035af50 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:10.030000 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af045392-8a1b-4e40-95ee-46182035af50 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:10.030622 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af045392-8a1b-4e40-95ee-46182035af50 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:10.032617 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af045392-8a1b-4e40-95ee-46182035af50 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:10.035289 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af045392-8a1b-4e40-95ee-46182035af50 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:10.035966 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af045392-8a1b-4e40-95ee-46182035af50 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:10.036540 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af045392-8a1b-4e40-95ee-46182035af50 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:10.209556 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-af045392-8a1b-4e40-95ee-46182035af50 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:10.218558 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-af045392-8a1b-4e40-95ee-46182035af50 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1319 microversion: 2.1 time: 0.234613 Aug 22 17:12:10.219237 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 125/267] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:09 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:10.243163 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-36396f45-85f1-45f5-9fbf-8dfe8f979d6c tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 243 microversion: 2.1 time: 0.489975 Aug 22 17:12:10.243163 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 143/268] 10.222.0.96 () {60 vars in 1194 bytes} [Mon Aug 22 17:12:09 2022] POST /compute/v2.1/os-aggregates/16/action => generated 243 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:12:10.244969 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-44da8e4a-6c6e-4607-a993-659185b3cd37 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:10.245508 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-44da8e4a-6c6e-4607-a993-659185b3cd37 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:10.251674 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-44da8e4a-6c6e-4607-a993-659185b3cd37 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:10.252388 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-44da8e4a-6c6e-4607-a993-659185b3cd37 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:10.252993 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-44da8e4a-6c6e-4607-a993-659185b3cd37 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:10.253995 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-44da8e4a-6c6e-4607-a993-659185b3cd37 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:10.254663 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-44da8e4a-6c6e-4607-a993-659185b3cd37 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:10.255246 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-44da8e4a-6c6e-4607-a993-659185b3cd37 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:10.264024 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-60ec0dc1-8a15-4d26-939e-27c118acc280 tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854030-1"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:10.266707 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:10.266707 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:10.267568 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-60ec0dc1-8a15-4d26-939e-27c118acc280 tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '308ee6c6db3c4d689d5907293bf045ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad4c5b924db48f39f47a5e184cce700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-60ec0dc1-8a15-4d26-939e-27c118acc280 tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Request method failure captured: Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 42 Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7ir1nOQ22WGoYnd3y6_dSSj4Yt_RbejTa6QhMujNneOmuyIebOh-1wl8iFJgz_vW7zgrTjiOF42OCssk0-EdgKFLud9rMeoGkklis_ni66jIOYHLCAjrHFSJ45tnsuGVECLPDEBZVM8aj682VH7IJtQgFyfs26RtA0y_nJfevA9bSI Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 9ad4c5b924db48f39f47a5e184cce700 Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1583174465 Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:12:10.269569 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:12:10.271043 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ad4c5b924db48f39f47a5e184cce700"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9ad4c5b924db48f39f47a5e184cce700", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ad4c5b924db48f39f47a5e184cce700"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9ad4c5b924db48f39f47a5e184cce700"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:10.271043 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1583174465 Aug 22 17:12:10.271043 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 9ad4c5b924db48f39f47a5e184cce700 Aug 22 17:12:10.271043 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1583174465 Aug 22 17:12:10.271043 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-AggregatesAdminNegativeTestJSON-1583174465-project Aug 22 17:12:10.271043 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:10.271043 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:10.271043 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 308ee6c6db3c4d689d5907293bf045ca Aug 22 17:12:10.271043 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1583174465-project Aug 22 17:12:10.271043 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:12:10.271043 n-d-854030-1 devstack@n-api.service[123015]: {"remove_host": {"host": "n-h2-854030-1"}} Aug 22 17:12:10.271043 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:10.271043 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 22 17:12:10.272586 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'n-h2-854030-1'}}} Aug 22 17:12:10.272586 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:10.272586 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:10.272586 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:10.272586 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:10.272586 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:10.272586 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:10.272586 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:10.272586 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:10.272586 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:10.272586 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:10.272586 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 22 17:12:10.272586 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 22 17:12:10.272586 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:12:10.272586 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:12:10.272586 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:12:10.272586 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:12:10.272586 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:12:10.272586 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:12:10.274399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:12:10.274399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:12:10.274399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:12:10.274399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:12:10.274399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:12:10.274399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:12:10.274399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:12:10.274399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:12:10.274399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 22 17:12:10.274399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.274399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:10.274399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.274399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:10.274399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:10.274399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:10.274399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:12:10.274399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:12:10.274399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 22 17:12:10.274399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.275816 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-60ec0dc1-8a15-4d26-939e-27c118acc280 tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:10.275816 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-60ec0dc1-8a15-4d26-939e-27c118acc280 tempest-AggregatesAdminNegativeTestJSON-1583174465 tempest-AggregatesAdminNegativeTestJSON-1583174465-project] 10.222.0.96 "POST /compute/v2.1/os-aggregates/16/action" status: 403 len: 121 microversion: 2.1 time: 0.012254 Aug 22 17:12:10.275816 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 144/269] 10.222.0.96 () {60 vars in 1194 bytes} [Mon Aug 22 17:12:10 2022] POST /compute/v2.1/os-aggregates/16/action => generated 121 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:12:10.281336 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-dc5a3058-c41e-4f34-91e2-92323f3f0bbc tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854030-1"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:10.283359 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-44da8e4a-6c6e-4607-a993-659185b3cd37 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] HTTP exception thrown: Instance 7f52f344-5753-4cab-9879-b33d702cf01a could not be found. Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-44da8e4a-6c6e-4607-a993-659185b3cd37 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Request method failure captured: Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: request: DELETE /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a HTTP/1.1 Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7irGxtsuZxycKZ6cf92UATzDhEuHQoeRVqLof1iEbSL3xE-ASKIXeQab0UwmrFK0HllZ9da6dEzfOIa2S6jJsJMeOqyKmwuLLJFCmdg88PtMJajCZ9_rn936MVYJNxFp6WOSsURLmvLbwywbmkpXfybUTDksIUQIpj08csKUln-BFk Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 1897a03823894ee8a981bd1e47cb5050 Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-AggregatesAdminTestJSON-1924046837 Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:12:10.285230 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:12:10.286796 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1897a03823894ee8a981bd1e47cb5050"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_1897a03823894ee8a981bd1e47cb5050", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1897a03823894ee8a981bd1e47cb5050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/1897a03823894ee8a981bd1e47cb5050"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:10.286796 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-AggregatesAdminTestJSON-1924046837 Aug 22 17:12:10.286796 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 1897a03823894ee8a981bd1e47cb5050 Aug 22 17:12:10.286796 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1924046837 Aug 22 17:12:10.286796 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-AggregatesAdminTestJSON-1924046837-project Aug 22 17:12:10.286796 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:12:10.286796 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:12:10.286796 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 64571f795f2748fcb657ca3f9031f35e Aug 22 17:12:10.286796 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-AggregatesAdminTestJSON-1924046837-project Aug 22 17:12:10.286796 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:12:10.286796 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance 7f52f344-5753-4cab-9879-b33d702cf01a could not be found. Aug 22 17:12:10.286796 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '7f52f344-5753-4cab-9879-b33d702cf01a'} Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f52f344-5753-4cab-9879-b33d702cf01a could not be found. Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:10.287607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f52f344-5753-4cab-9879-b33d702cf01a could not be found. Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f52f344-5753-4cab-9879-b33d702cf01a could not be found. Aug 22 17:12:10.290035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.293624 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-44da8e4a-6c6e-4607-a993-659185b3cd37 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Returning 404 to user: Instance 7f52f344-5753-4cab-9879-b33d702cf01a could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:10.300390 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dc5a3058-c41e-4f34-91e2-92323f3f0bbc tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:10.300390 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dc5a3058-c41e-4f34-91e2-92323f3f0bbc tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:10.301166 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-44da8e4a-6c6e-4607-a993-659185b3cd37 tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "DELETE /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 404 len: 111 microversion: 2.1 time: 0.056220 Aug 22 17:12:10.301636 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dc5a3058-c41e-4f34-91e2-92323f3f0bbc tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:10.301742 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 126/270] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:12:10 2022] DELETE /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:12:10.307587 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9253d91f-b931-4bcd-825e-76dd3643861e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:10.308199 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-9253d91f-b931-4bcd-825e-76dd3643861e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] [instance: 7f52f344-5753-4cab-9879-b33d702cf01a] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:10.316533 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9253d91f-b931-4bcd-825e-76dd3643861e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:10.317042 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9253d91f-b931-4bcd-825e-76dd3643861e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:10.317577 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9253d91f-b931-4bcd-825e-76dd3643861e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:10.318358 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9253d91f-b931-4bcd-825e-76dd3643861e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:10.318819 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9253d91f-b931-4bcd-825e-76dd3643861e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:10.319248 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9253d91f-b931-4bcd-825e-76dd3643861e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:10.336791 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-9253d91f-b931-4bcd-825e-76dd3643861e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] HTTP exception thrown: Instance 7f52f344-5753-4cab-9879-b33d702cf01a could not be found. Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9253d91f-b931-4bcd-825e-76dd3643861e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Request method failure captured: Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a HTTP/1.1 Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7irGxtsuZxycKZ6cf92UATzDhEuHQoeRVqLof1iEbSL3xE-ASKIXeQab0UwmrFK0HllZ9da6dEzfOIa2S6jJsJMeOqyKmwuLLJFCmdg88PtMJajCZ9_rn936MVYJNxFp6WOSsURLmvLbwywbmkpXfybUTDksIUQIpj08csKUln-BFk Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 1897a03823894ee8a981bd1e47cb5050 Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-AggregatesAdminTestJSON-1924046837 Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:12:10.338336 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:12:10.339639 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1897a03823894ee8a981bd1e47cb5050"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_1897a03823894ee8a981bd1e47cb5050", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1897a03823894ee8a981bd1e47cb5050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/1897a03823894ee8a981bd1e47cb5050"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:10.339639 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-AggregatesAdminTestJSON-1924046837 Aug 22 17:12:10.339639 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 1897a03823894ee8a981bd1e47cb5050 Aug 22 17:12:10.339639 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1924046837 Aug 22 17:12:10.339639 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-AggregatesAdminTestJSON-1924046837-project Aug 22 17:12:10.339639 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:12:10.339639 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:12:10.339639 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 64571f795f2748fcb657ca3f9031f35e Aug 22 17:12:10.339639 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-AggregatesAdminTestJSON-1924046837-project Aug 22 17:12:10.339639 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:12:10.339639 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance 7f52f344-5753-4cab-9879-b33d702cf01a could not be found. Aug 22 17:12:10.339639 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '7f52f344-5753-4cab-9879-b33d702cf01a'} Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f52f344-5753-4cab-9879-b33d702cf01a could not be found. Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:10.340416 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:10.341687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:10.341687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:12:10.341687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:12:10.341687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:12:10.341687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:12:10.341687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:12:10.341687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:12:10.341687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f52f344-5753-4cab-9879-b33d702cf01a could not be found. Aug 22 17:12:10.341687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.341687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:10.341687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.341687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:10.341687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:10.341687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:10.341687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:10.341687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:10.341687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f52f344-5753-4cab-9879-b33d702cf01a could not be found. Aug 22 17:12:10.341687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.342955 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9253d91f-b931-4bcd-825e-76dd3643861e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] Returning 404 to user: Instance 7f52f344-5753-4cab-9879-b33d702cf01a could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:10.342955 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9253d91f-b931-4bcd-825e-76dd3643861e tempest-AggregatesAdminTestJSON-1924046837 tempest-AggregatesAdminTestJSON-1924046837-project] 10.222.0.96 "GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a" status: 404 len: 111 microversion: 2.1 time: 0.037939 Aug 22 17:12:10.344065 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 127/271] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:10 2022] GET /compute/v2.1/servers/7f52f344-5753-4cab-9879-b33d702cf01a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:12:10.593919 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-89e22b1a-71e2-45fd-8fc7-ab1b8c2f6d11 tempest-ServersWithSpecificFlavorTestJSON-1098471236 tempest-ServersWithSpecificFlavorTestJSON-1098471236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-923411815", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "1890595475", "adminPass": "***", "networks": [{"uuid": "986fd4ac-c262-4d00-bb5d-7b5f62d81b5e"}], "security_groups": [{"name": "tempest-securitygroup--1173243760"}], "key_name": "tempest-keypair-222436087", "user_data": "}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:10.606772 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9,nova_api:UPDATE=3,nova_api:DELETE=10 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:10.626038 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-dc5a3058-c41e-4f34-91e2-92323f3f0bbc tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 228 microversion: 2.1 time: 0.349549 Aug 22 17:12:10.631162 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 145/272] 10.222.0.96 () {60 vars in 1194 bytes} [Mon Aug 22 17:12:10 2022] POST /compute/v2.1/os-aggregates/16/action => generated 228 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:10.640630 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fce21318-ff99-4585-aee0-e0a498fc0017 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:10.641689 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:10.641689 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:10.776640 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fce21318-ff99-4585-aee0-e0a498fc0017 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.139434 Aug 22 17:12:10.777829 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 146/273] 10.222.0.96 () {58 vars in 1155 bytes} [Mon Aug 22 17:12:10 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 22 17:12:10.788752 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1de73ff9-3d67-4c45-8d5d-ae7f9ab94e11 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-321284393"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:10.792225 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:10.792225 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:10.793420 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.aggregate [None req-1de73ff9-3d67-4c45-8d5d-ae7f9ab94e11 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Generated uuid 5738802d-3008-4798-9278-fee8ac32e72e for aggregate {{(pid=123015) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:12:10.816234 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-89e22b1a-71e2-45fd-8fc7-ab1b8c2f6d11 tempest-ServersWithSpecificFlavorTestJSON-1098471236 tempest-ServersWithSpecificFlavorTestJSON-1098471236-project] validate_networks() for [('986fd4ac-c262-4d00-bb5d-7b5f62d81b5e', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:12:10.896159 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1de73ff9-3d67-4c45-8d5d-ae7f9ab94e11 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.112045 Aug 22 17:12:10.897498 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 147/274] 10.222.0.96 () {60 vars in 1164 bytes} [Mon Aug 22 17:12:10 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:10.910063 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-afb51a85-74f2-4cf1-91cd-6691ab5aeabd tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:10.913648 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:10.913648 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:10.944017 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-afb51a85-74f2-4cf1-91cd-6691ab5aeabd tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:10.944571 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-afb51a85-74f2-4cf1-91cd-6691ab5aeabd tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:10.945052 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-afb51a85-74f2-4cf1-91cd-6691ab5aeabd tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:10.955746 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-afb51a85-74f2-4cf1-91cd-6691ab5aeabd tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:10.956287 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-afb51a85-74f2-4cf1-91cd-6691ab5aeabd tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:10.956736 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-afb51a85-74f2-4cf1-91cd-6691ab5aeabd tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:10.977917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.compute.aggregates [None req-afb51a85-74f2-4cf1-91cd-6691ab5aeabd tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 22 17:12:10.978638 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-afb51a85-74f2-4cf1-91cd-6691ab5aeabd tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-afb51a85-74f2-4cf1-91cd-6691ab5aeabd tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Request method failure captured: Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 42 Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7iu7mwCqVfEPXcvEFE_j7zjSxexRLsSV30DitjvjSs1f8gYXw3dHJKj595-9e2rpdJBmdl4yV7fmore24g90lZGLDaH1yHDkSQxpmXAzhxx4Sz34fwuch6eyjD83KohIRHHGzznpTYRbehq0s642dmgm-r6orhynCByFM2Zg_6KT6Y Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 92d0ec50c9764f48a41a30c944c857c0 Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:12:10.982399 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:12:10.983709 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_92d0ec50c9764f48a41a30c944c857c0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/92d0ec50c9764f48a41a30c944c857c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:10.983709 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:10.983709 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 92d0ec50c9764f48a41a30c944c857c0 Aug 22 17:12:10.983709 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-505860074 Aug 22 17:12:10.983709 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin Aug 22 17:12:10.983709 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:10.983709 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:10.983709 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 6bb1a856d20e4266a583cd270e888485 Aug 22 17:12:10.983709 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin Aug 22 17:12:10.983709 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:12:10.983709 n-d-854030-1 devstack@n-api.service[123015]: {"remove_host": {"host": "nonexist_host"}} Aug 22 17:12:10.983709 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:10.983709 n-d-854030-1 devstack@n-api.service[123015]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5994, in _get_service_in_cell_by_host Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in _get_service_in_cell_by_host Aug 22 17:12:10.984423 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6678, in remove_host_from_aggregate Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 22 17:12:10.985674 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.986997 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:10.988338 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:10.988338 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:10.988338 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:10.988338 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:10.988338 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 22 17:12:10.988338 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:10.991113 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-afb51a85-74f2-4cf1-91cd-6691ab5aeabd tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:10.992433 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-afb51a85-74f2-4cf1-91cd-6691ab5aeabd tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.087360 Aug 22 17:12:10.994645 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 148/275] 10.222.0.96 () {60 vars in 1194 bytes} [Mon Aug 22 17:12:10 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 22 17:12:11.003408 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ef4088bb-a89e-446d-a839-0e03a599b476 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:11.004669 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:11.004669 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:11.123619 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ef4088bb-a89e-446d-a839-0e03a599b476 tempest-AggregatesAdminNegativeTestJSON-505860074 tempest-AggregatesAdminNegativeTestJSON-505860074-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.124784 Aug 22 17:12:11.125564 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 149/276] 10.222.0.96 () {58 vars in 1155 bytes} [Mon Aug 22 17:12:10 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 22 17:12:11.240834 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-961659fa-05ec-4d25-8da0-1451b6f290f6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:11.241480 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-961659fa-05ec-4d25-8da0-1451b6f290f6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:11.250519 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-961659fa-05ec-4d25-8da0-1451b6f290f6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:11.251275 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-961659fa-05ec-4d25-8da0-1451b6f290f6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:11.251966 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-961659fa-05ec-4d25-8da0-1451b6f290f6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:11.253041 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-961659fa-05ec-4d25-8da0-1451b6f290f6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:11.253701 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-961659fa-05ec-4d25-8da0-1451b6f290f6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:11.254447 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-961659fa-05ec-4d25-8da0-1451b6f290f6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:11.524303 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-961659fa-05ec-4d25-8da0-1451b6f290f6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:11.535627 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-961659fa-05ec-4d25-8da0-1451b6f290f6 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1319 microversion: 2.1 time: 0.299481 Aug 22 17:12:11.553184 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 150/277] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:11 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:11.584610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-89e22b1a-71e2-45fd-8fc7-ab1b8c2f6d11 tempest-ServersWithSpecificFlavorTestJSON-1098471236 tempest-ServersWithSpecificFlavorTestJSON-1098471236-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1e61aad9-4c79-475d-8338-16c4ba8dd7ba) Aug 22 17:12:11.584610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:11.584610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:11.584610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:11.584610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:11.584610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:11.584610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:11.584610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:11.584610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:11.584610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:11.584610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:12:11.584610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:12:11.584610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:12:11.584610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:12:11.584610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:12:11.584610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:12:11.585738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:12:11.585738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:12:11.585738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:12:11.585738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:12:11.585738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:12:11.585738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:12:11.585738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:12:11.585738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:12:11.585738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:12:11.585738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:12:11.585738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:12:11.585738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:11.585738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:11.585738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:12:11.585738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:12:11.585738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:11.585738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:11.585738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:12:11.587193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:12:11.587193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:11.587193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:11.587193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:12:11.587193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:12:11.587193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:11.587193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:11.587193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:12:11.587193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:12:11.587193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:12:11.587193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:12:11.587193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:12:11.587193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:12:11.587193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:12:11.587193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:12:11.587193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:12:11.587193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:12:11.587193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:12:11.588176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:12:11.588176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:12:11.588176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:12:11.588176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:12:11.588176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:12:11.588176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:12:11.588176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:12:11.588176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:12:11.588176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:12:11.588176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:12:11.588176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:12:11.588176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:12:11.588176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:12:11.588176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:12:11.588176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:12:11.589606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1e61aad9-4c79-475d-8338-16c4ba8dd7ba) Aug 22 17:12:11.589606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:11.592015 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-89e22b1a-71e2-45fd-8fc7-ab1b8c2f6d11 tempest-ServersWithSpecificFlavorTestJSON-1098471236 tempest-ServersWithSpecificFlavorTestJSON-1098471236-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:11.592015 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-89e22b1a-71e2-45fd-8fc7-ab1b8c2f6d11 tempest-ServersWithSpecificFlavorTestJSON-1098471236 tempest-ServersWithSpecificFlavorTestJSON-1098471236-project] Request method failure captured: Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 504 Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7jTz_IH6a8yLEf-2oJLjhg0mGmq8-uyml4GSZyrpus0jZN39qSUnSwwZIaHgpT8zLjt_tkwB0zHw5IO5sa_wgC92ESm2kbucGWadMdUf4W72aMGUw1RNvvSdPfhwQKfJJegJXP9V9dw6Gh8MVaoOdu1n5DtjJEaY0zzJp7EwWnz7v0 Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: afb8266443ae4fa8b123155010efe483 Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1098471236 Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:12:11.596255 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:12:11.601324 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/afb8266443ae4fa8b123155010efe483"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_afb8266443ae4fa8b123155010efe483", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/afb8266443ae4fa8b123155010efe483"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/afb8266443ae4fa8b123155010efe483"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:11.601324 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1098471236 Aug 22 17:12:11.601324 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: afb8266443ae4fa8b123155010efe483 Aug 22 17:12:11.601324 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1098471236 Aug 22 17:12:11.601324 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1098471236-project Aug 22 17:12:11.601324 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:12:11.601324 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:12:11.601324 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 285aa300c7e54ef1a7479206c1e595db Aug 22 17:12:11.601324 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1098471236-project Aug 22 17:12:11.601324 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:12:11.602296 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-923411815", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "1890595475", "adminPass": "password", "networks": [{"uuid": "986fd4ac-c262-4d00-bb5d-7b5f62d81b5e"}], "security_groups": [{"name": "tempest-securitygroup--1173243760"}], "key_name": "tempest-keypair-222436087", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 22 17:12:11.602296 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:12:11.602296 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:11.602296 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:12:11.602296 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-ServersWithSpecificFlavorTestJSON-server-923411815', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '1890595475', 'adminPass': 'password', 'networks': [{'uuid': '986fd4ac-c262-4d00-bb5d-7b5f62d81b5e'}], 'security_groups': [{'name': 'tempest-securitygroup--1173243760'}], 'key_name': 'tempest-keypair-222436087', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 22 17:12:11.602296 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:11.602296 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:11.602296 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:11.602296 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:11.602296 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:11.602296 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:11.602296 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:11.603052 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:11.603052 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:11.603052 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:11.603052 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:12:11.603052 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:12:11.603052 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:12:11.603052 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:12:11.603052 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:12:11.603052 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:12:11.603052 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:12:11.603052 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:12:11.603052 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:12:11.603052 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:12:11.603052 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:12:11.603052 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:12:11.603052 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:12:11.603052 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:12:11.603052 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:12:11.603052 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:12:11.604136 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:12:11.604136 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:11.604136 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:11.604136 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:12:11.604136 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:12:11.604136 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:11.604136 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:11.604136 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:12:11.604136 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:12:11.604136 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:11.604136 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:11.604136 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:12:11.604136 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:12:11.604136 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:11.604136 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:11.604136 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:12:11.604136 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:12:11.604136 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:12:11.605048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:12:11.605048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:12:11.605048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:12:11.605048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:12:11.605048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:12:11.605048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:12:11.605048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:12:11.605048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:12:11.605048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:12:11.605048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:12:11.605048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:12:11.605048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:12:11.605048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:12:11.605048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:12:11.605048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:12:11.605048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:12:11.605048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:12:11.606757 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:12:11.606757 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:12:11.606757 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:12:11.606757 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:12:11.606757 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:12:11.606757 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:12:11.606757 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1e61aad9-4c79-475d-8338-16c4ba8dd7ba) Aug 22 17:12:11.606757 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:11.606757 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:11.606757 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:11.606757 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:11.606757 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:11.606757 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:11.606757 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:11.606757 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:11.606757 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:12:11.606757 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:12:11.608092 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:11.608092 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:11.608092 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:11.608092 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:11.608092 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:11.608092 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:11.608092 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:11.608092 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:11.608092 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:11.608092 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:11.608092 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:11.608092 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:11.608092 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:11.608092 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-89e22b1a-71e2-45fd-8fc7-ab1b8c2f6d11 tempest-ServersWithSpecificFlavorTestJSON-1098471236 tempest-ServersWithSpecificFlavorTestJSON-1098471236-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:11.608092 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:11.609777 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-89e22b1a-71e2-45fd-8fc7-ab1b8c2f6d11 tempest-ServersWithSpecificFlavorTestJSON-1098471236 tempest-ServersWithSpecificFlavorTestJSON-1098471236-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.011224 Aug 22 17:12:11.611045 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 128/278] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:10 2022] POST /compute/v2.1/servers => generated 214 bytes in 1023 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:12:11.612836 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1548e5bb-5fbc-4670-acb8-ce7344c1119b tempest-ServersWithSpecificFlavorTestJSON-1098471236 tempest-ServersWithSpecificFlavorTestJSON-1098471236-project] Calling method '.version_select at 0x7f8009f38f70>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:11.708852 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1548e5bb-5fbc-4670-acb8-ce7344c1119b tempest-ServersWithSpecificFlavorTestJSON-1098471236 tempest-ServersWithSpecificFlavorTestJSON-1098471236-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-222436087" status: 202 len: 0 microversion: 2.1 time: 0.101851 Aug 22 17:12:11.709610 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 151/279] 10.222.0.96 () {58 vars in 1218 bytes} [Mon Aug 22 17:12:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-222436087 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:12:11.731677 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-014dba78-2f74-4370-8ec9-0fd87fad6c3c req-78374b94-0fef-4c05-8c97-062cbc5b1b56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08", "tag": "d00ea38b-c795-4f8e-91a9-b1a331e1b26b"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:11.748189 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-014dba78-2f74-4370-8ec9-0fd87fad6c3c req-78374b94-0fef-4c05-8c97-062cbc5b1b56 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:11.748729 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-014dba78-2f74-4370-8ec9-0fd87fad6c3c req-78374b94-0fef-4c05-8c97-062cbc5b1b56 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:11.749219 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-014dba78-2f74-4370-8ec9-0fd87fad6c3c req-78374b94-0fef-4c05-8c97-062cbc5b1b56 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:11.766042 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-014dba78-2f74-4370-8ec9-0fd87fad6c3c req-78374b94-0fef-4c05-8c97-062cbc5b1b56 service nova] Creating event network-changed:d00ea38b-c795-4f8e-91a9-b1a331e1b26b for instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 on n-h1-854030-1 Aug 22 17:12:11.791711 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-014dba78-2f74-4370-8ec9-0fd87fad6c3c req-78374b94-0fef-4c05-8c97-062cbc5b1b56 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065369 Aug 22 17:12:11.792363 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 129/280] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:12.571609 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e1dd87bc-5c38-4199-94ef-4bd9e7cce044 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:12.572217 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-e1dd87bc-5c38-4199-94ef-4bd9e7cce044 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:12.594674 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e1dd87bc-5c38-4199-94ef-4bd9e7cce044 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:12.594674 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e1dd87bc-5c38-4199-94ef-4bd9e7cce044 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:12.594674 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e1dd87bc-5c38-4199-94ef-4bd9e7cce044 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:12.594674 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e1dd87bc-5c38-4199-94ef-4bd9e7cce044 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:12.595437 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e1dd87bc-5c38-4199-94ef-4bd9e7cce044 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:12.595437 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e1dd87bc-5c38-4199-94ef-4bd9e7cce044 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:12.790430 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e1dd87bc-5c38-4199-94ef-4bd9e7cce044 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:12.798165 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e1dd87bc-5c38-4199-94ef-4bd9e7cce044 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1319 microversion: 2.1 time: 0.237025 Aug 22 17:12:12.813397 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 152/281] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:12 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:12.986380 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8ba00b2b-a50f-43b2-813f-b599045adc20 tempest-ServersWithSpecificFlavorTestJSON-794947646 tempest-ServersWithSpecificFlavorTestJSON-794947646-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:12.988037 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:12.988037 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:13.062520 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8ba00b2b-a50f-43b2-813f-b599045adc20 tempest-ServersWithSpecificFlavorTestJSON-794947646 tempest-ServersWithSpecificFlavorTestJSON-794947646-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/1890595475" status: 202 len: 0 microversion: 2.1 time: 0.081298 Aug 22 17:12:13.063285 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 130/282] 10.222.0.96 () {58 vars in 1161 bytes} [Mon Aug 22 17:12:12 2022] DELETE /compute/v2.1/flavors/1890595475 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:12:13.079503 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0ce0e215-06b1-4cbe-9ad0-1ac0490708fd tempest-ServersWithSpecificFlavorTestJSON-794947646 tempest-ServersWithSpecificFlavorTestJSON-794947646-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:13.124448 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0ce0e215-06b1-4cbe-9ad0-1ac0490708fd tempest-ServersWithSpecificFlavorTestJSON-794947646 tempest-ServersWithSpecificFlavorTestJSON-794947646-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.044334 Aug 22 17:12:13.124448 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 153/283] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:13 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:13.137477 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1efc0e92-9808-479b-b2f8-dffe10f7ebc6 tempest-ServersWithSpecificFlavorTestJSON-794947646 tempest-ServersWithSpecificFlavorTestJSON-794947646-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:13.307978 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1efc0e92-9808-479b-b2f8-dffe10f7ebc6 tempest-ServersWithSpecificFlavorTestJSON-794947646 tempest-ServersWithSpecificFlavorTestJSON-794947646-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/1443085873" status: 202 len: 0 microversion: 2.1 time: 0.174177 Aug 22 17:12:13.313129 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 131/284] 10.222.0.96 () {58 vars in 1161 bytes} [Mon Aug 22 17:12:13 2022] DELETE /compute/v2.1/flavors/1443085873 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:12:13.318117 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-47f1e67b-adb1-428a-8496-d5bd9bfc32ed tempest-ServersWithSpecificFlavorTestJSON-794947646 tempest-ServersWithSpecificFlavorTestJSON-794947646-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:13.342128 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-47f1e67b-adb1-428a-8496-d5bd9bfc32ed tempest-ServersWithSpecificFlavorTestJSON-794947646 tempest-ServersWithSpecificFlavorTestJSON-794947646-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028961 Aug 22 17:12:13.342969 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 154/285] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:13.819808 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b4246fb2-c815-46eb-978c-26ae521b6870 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:13.820730 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b4246fb2-c815-46eb-978c-26ae521b6870 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:13.837761 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b4246fb2-c815-46eb-978c-26ae521b6870 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:13.838264 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b4246fb2-c815-46eb-978c-26ae521b6870 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:13.838710 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b4246fb2-c815-46eb-978c-26ae521b6870 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:13.839429 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b4246fb2-c815-46eb-978c-26ae521b6870 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:13.839995 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b4246fb2-c815-46eb-978c-26ae521b6870 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:13.840438 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b4246fb2-c815-46eb-978c-26ae521b6870 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:14.225027 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b4246fb2-c815-46eb-978c-26ae521b6870 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:14.240199 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b4246fb2-c815-46eb-978c-26ae521b6870 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1319 microversion: 2.1 time: 0.420169 Aug 22 17:12:14.242211 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 132/286] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:13 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:15.262633 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0f2dfd4f-7d93-47ee-92da-fca5027a1aa4 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:15.263082 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0f2dfd4f-7d93-47ee-92da-fca5027a1aa4 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:15.270762 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0f2dfd4f-7d93-47ee-92da-fca5027a1aa4 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:15.278749 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0f2dfd4f-7d93-47ee-92da-fca5027a1aa4 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:15.280147 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0f2dfd4f-7d93-47ee-92da-fca5027a1aa4 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:15.280899 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0f2dfd4f-7d93-47ee-92da-fca5027a1aa4 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:15.281458 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0f2dfd4f-7d93-47ee-92da-fca5027a1aa4 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:15.281893 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0f2dfd4f-7d93-47ee-92da-fca5027a1aa4 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:15.613289 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0f2dfd4f-7d93-47ee-92da-fca5027a1aa4 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:15.622723 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0f2dfd4f-7d93-47ee-92da-fca5027a1aa4 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1319 microversion: 2.1 time: 0.364940 Aug 22 17:12:15.625111 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 155/287] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:15 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:16.649977 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1a186ee4-6f2b-44cc-9ab6-c43049c4a27f tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:16.651217 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-1a186ee4-6f2b-44cc-9ab6-c43049c4a27f tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:16.669176 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=41,nova_cell0:UPDATE=7 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:16.682032 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1a186ee4-6f2b-44cc-9ab6-c43049c4a27f tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:16.682779 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1a186ee4-6f2b-44cc-9ab6-c43049c4a27f tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:16.683391 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1a186ee4-6f2b-44cc-9ab6-c43049c4a27f tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:16.685971 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1a186ee4-6f2b-44cc-9ab6-c43049c4a27f tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:16.686631 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1a186ee4-6f2b-44cc-9ab6-c43049c4a27f tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:16.687316 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1a186ee4-6f2b-44cc-9ab6-c43049c4a27f tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:17.150228 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-1a186ee4-6f2b-44cc-9ab6-c43049c4a27f tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:17.168096 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1a186ee4-6f2b-44cc-9ab6-c43049c4a27f tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1319 microversion: 2.1 time: 0.522817 Aug 22 17:12:17.173998 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 133/288] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:16 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1319 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:17.721514 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=22 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:18.171230 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3408d7f7-25ee-4af0-80da-853af5038500 tempest-InstanceUsageAuditLogNegativeTestJSON-1411392571 tempest-InstanceUsageAuditLogNegativeTestJSON-1411392571-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:18.172160 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:18.172160 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:18.174958 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-3408d7f7-25ee-4af0-80da-853af5038500 tempest-InstanceUsageAuditLogNegativeTestJSON-1411392571 tempest-InstanceUsageAuditLogNegativeTestJSON-1411392571-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3408d7f7-25ee-4af0-80da-853af5038500 tempest-InstanceUsageAuditLogNegativeTestJSON-1411392571 tempest-InstanceUsageAuditLogNegativeTestJSON-1411392571-project-admin] Request method failure captured: Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7jxIJ9AGXXh5H50pcXUOU5lyRO1m_-fszqjoOgjPNZYWsZNfe8oQjxc7VuFLtLwCu6u5hsajpc92LtgAOgGwUrz8DdF-se8YsSE0M1JAqQdYXzQbg9HYF_SpUUbgFTaegJHOGjO73tKh_YaHFf2RU8tkk3y5mcmeE_j86q6wpsZmns Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: b48c7566ef44476d88e709692c8c8a70 Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1411392571 Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:12:18.185414 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:12:18.186965 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/b48c7566ef44476d88e709692c8c8a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_b48c7566ef44476d88e709692c8c8a70", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/b48c7566ef44476d88e709692c8c8a70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/b48c7566ef44476d88e709692c8c8a70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:18.186965 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1411392571 Aug 22 17:12:18.186965 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: b48c7566ef44476d88e709692c8c8a70 Aug 22 17:12:18.186965 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1411392571 Aug 22 17:12:18.186965 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1411392571-project-admin Aug 22 17:12:18.186965 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:18.186965 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:18.186965 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 8c471b3354e3430f936688b343fda738 Aug 22 17:12:18.186965 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1411392571-project-admin Aug 22 17:12:18.186965 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:18.186965 n-d-854030-1 devstack@n-api.service[123015]: exception: Invalid timestamp for date invalid_time Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'invalid_time'} Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:18.187712 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:18.189204 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 22 17:12:18.189204 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 22 17:12:18.189204 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 22 17:12:18.189204 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:18.189204 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:18.189204 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:18.189204 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:18.189204 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:18.189204 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:18.189204 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:18.189204 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:18.189204 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 22 17:12:18.189204 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:18.189204 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3408d7f7-25ee-4af0-80da-853af5038500 tempest-InstanceUsageAuditLogNegativeTestJSON-1411392571 tempest-InstanceUsageAuditLogNegativeTestJSON-1411392571-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:18.189204 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3408d7f7-25ee-4af0-80da-853af5038500 tempest-InstanceUsageAuditLogNegativeTestJSON-1411392571 tempest-InstanceUsageAuditLogNegativeTestJSON-1411392571-project-admin] 10.222.0.96 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.478722 Aug 22 17:12:18.198434 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 156/289] 10.222.0.96 () {58 vars in 1224 bytes} [Mon Aug 22 17:12:17 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 490 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 22 17:12:18.218665 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-023edfab-61b1-417b-804a-728d9821e67d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:18.219706 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-023edfab-61b1-417b-804a-728d9821e67d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:18.241306 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-023edfab-61b1-417b-804a-728d9821e67d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:18.241816 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-023edfab-61b1-417b-804a-728d9821e67d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:18.242418 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-023edfab-61b1-417b-804a-728d9821e67d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:18.243171 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-023edfab-61b1-417b-804a-728d9821e67d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:18.243627 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-023edfab-61b1-417b-804a-728d9821e67d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:18.244057 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-023edfab-61b1-417b-804a-728d9821e67d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:18.563039 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-023edfab-61b1-417b-804a-728d9821e67d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:18.579085 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-023edfab-61b1-417b-804a-728d9821e67d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1319 microversion: 2.1 time: 0.377695 Aug 22 17:12:18.580272 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 157/290] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:18 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:18.920176 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b22d5ef7-e790-4418-8f6e-df283c8bbcf8 tempest-SecurityGroupsTestAdminJSON-1913178016 tempest-SecurityGroupsTestAdminJSON-1913178016-project] Action: 'create', calling method: .version_select at 0x7f800a15b700>, body: {"security_group": {"name": "tempest-securitygroup-280056325", "description": "tempest-description-1951777509"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:19.141534 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1a60c1f2-c400-45f3-8494-9721bc63644d tempest-InstanceUsageAuditLogNegativeTestJSON-260957399 tempest-InstanceUsageAuditLogNegativeTestJSON-260957399-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:19.142979 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:19.142979 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:19.144586 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1a60c1f2-c400-45f3-8494-9721bc63644d tempest-InstanceUsageAuditLogNegativeTestJSON-260957399 tempest-InstanceUsageAuditLogNegativeTestJSON-260957399-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '89d692befcec48f89489131546a2042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3042fc04d4024be08134386bcabed246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1a60c1f2-c400-45f3-8494-9721bc63644d tempest-InstanceUsageAuditLogNegativeTestJSON-260957399 tempest-InstanceUsageAuditLogNegativeTestJSON-260957399-project] Request method failure captured: Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7jvVQ_yyxoej5P0J4W6AVpieslTS6_Zdu0iTCgVHpHxQIF_f0sQ_OLOpIaxLhJ4l48GT1UC3kdL__5CZ7RgUvcYZK--mCd3oFnpI61hv4HAhruKiOoWZPoQgLoYjwLqdH0c5qSAPTTpWpmjyhj-Tb8nvSICS9h7adr8SQc_shMRxks Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 3042fc04d4024be08134386bcabed246 Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-260957399 Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:12:19.147287 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:12:19.148887 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3042fc04d4024be08134386bcabed246"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_3042fc04d4024be08134386bcabed246", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3042fc04d4024be08134386bcabed246"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/3042fc04d4024be08134386bcabed246"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:19.148887 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-260957399 Aug 22 17:12:19.148887 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 3042fc04d4024be08134386bcabed246 Aug 22 17:12:19.148887 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-260957399 Aug 22 17:12:19.148887 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-260957399-project Aug 22 17:12:19.148887 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:19.148887 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:19.148887 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 89d692befcec48f89489131546a2042f Aug 22 17:12:19.148887 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-260957399-project Aug 22 17:12:19.148887 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: action_args: {} Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:12:19.149753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:12:19.151091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:12:19.151091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:12:19.151091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:12:19.151091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:12:19.151091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:12:19.151091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:12:19.151091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 22 17:12:19.151091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:19.151091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:19.151091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:19.151091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:19.151091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:19.151091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:19.151091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:12:19.151091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:12:19.151091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 22 17:12:19.151091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:19.153233 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1a60c1f2-c400-45f3-8494-9721bc63644d tempest-InstanceUsageAuditLogNegativeTestJSON-260957399 tempest-InstanceUsageAuditLogNegativeTestJSON-260957399-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:19.154243 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1a60c1f2-c400-45f3-8494-9721bc63644d tempest-InstanceUsageAuditLogNegativeTestJSON-260957399 tempest-InstanceUsageAuditLogNegativeTestJSON-260957399-project] 10.222.0.96 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.572798 Aug 22 17:12:19.155363 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 158/291] 10.222.0.96 () {58 vars in 1185 bytes} [Mon Aug 22 17:12:18 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 574 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:12:19.164964 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-522aac5d-4248-4c7b-8f96-5ef927a58ae6 tempest-InstanceUsageAuditLogNegativeTestJSON-260957399 tempest-InstanceUsageAuditLogNegativeTestJSON-260957399-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:19.166460 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:19.166460 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:19.167685 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-522aac5d-4248-4c7b-8f96-5ef927a58ae6 tempest-InstanceUsageAuditLogNegativeTestJSON-260957399 tempest-InstanceUsageAuditLogNegativeTestJSON-260957399-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '89d692befcec48f89489131546a2042f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3042fc04d4024be08134386bcabed246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-522aac5d-4248-4c7b-8f96-5ef927a58ae6 tempest-InstanceUsageAuditLogNegativeTestJSON-260957399 tempest-InstanceUsageAuditLogNegativeTestJSON-260957399-project] Request method failure captured: Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-22%2017:12:19 HTTP/1.1 Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7jvVQ_yyxoej5P0J4W6AVpieslTS6_Zdu0iTCgVHpHxQIF_f0sQ_OLOpIaxLhJ4l48GT1UC3kdL__5CZ7RgUvcYZK--mCd3oFnpI61hv4HAhruKiOoWZPoQgLoYjwLqdH0c5qSAPTTpWpmjyhj-Tb8nvSICS9h7adr8SQc_shMRxks Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 3042fc04d4024be08134386bcabed246 Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-260957399 Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:12:19.169336 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:12:19.170499 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3042fc04d4024be08134386bcabed246"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_3042fc04d4024be08134386bcabed246", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3042fc04d4024be08134386bcabed246"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/3042fc04d4024be08134386bcabed246"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:19.170499 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-260957399 Aug 22 17:12:19.170499 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 3042fc04d4024be08134386bcabed246 Aug 22 17:12:19.170499 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-260957399 Aug 22 17:12:19.170499 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-260957399-project Aug 22 17:12:19.170499 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:19.170499 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:19.170499 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 89d692befcec48f89489131546a2042f Aug 22 17:12:19.170499 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-260957399-project Aug 22 17:12:19.170499 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '2022-08-22 17:12:19'} Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:12:19.171064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:12:19.176296 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:12:19.176296 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:12:19.176296 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:12:19.176296 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:12:19.176296 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:12:19.176296 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:12:19.176296 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 22 17:12:19.176296 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:19.176296 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:19.176296 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:19.176296 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:19.176296 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:19.176296 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:19.176296 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:12:19.176296 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:12:19.176296 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 22 17:12:19.176296 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:19.177278 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-522aac5d-4248-4c7b-8f96-5ef927a58ae6 tempest-InstanceUsageAuditLogNegativeTestJSON-260957399 tempest-InstanceUsageAuditLogNegativeTestJSON-260957399-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:19.177278 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-522aac5d-4248-4c7b-8f96-5ef927a58ae6 tempest-InstanceUsageAuditLogNegativeTestJSON-260957399 tempest-InstanceUsageAuditLogNegativeTestJSON-260957399-project] 10.222.0.96 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-22 17:12:19" status: 403 len: 128 microversion: 2.1 time: 0.010956 Aug 22 17:12:19.177278 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 159/292] 10.222.0.96 () {58 vars in 1251 bytes} [Mon Aug 22 17:12:19 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-22%2017%3A12%3A19 => generated 128 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:12:19.614123 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ee383147-44ea-442e-89d8-dbfeb81f4dbb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:19.615071 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ee383147-44ea-442e-89d8-dbfeb81f4dbb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:19.630076 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ee383147-44ea-442e-89d8-dbfeb81f4dbb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:19.639048 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ee383147-44ea-442e-89d8-dbfeb81f4dbb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:19.639048 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ee383147-44ea-442e-89d8-dbfeb81f4dbb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:19.639048 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ee383147-44ea-442e-89d8-dbfeb81f4dbb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:19.639048 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ee383147-44ea-442e-89d8-dbfeb81f4dbb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:19.639513 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ee383147-44ea-442e-89d8-dbfeb81f4dbb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:19.905929 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ee383147-44ea-442e-89d8-dbfeb81f4dbb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:19.914455 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ee383147-44ea-442e-89d8-dbfeb81f4dbb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1319 microversion: 2.1 time: 0.307107 Aug 22 17:12:19.920011 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 160/293] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:19 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:20.435753 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b22d5ef7-e790-4418-8f6e-df283c8bbcf8 tempest-SecurityGroupsTestAdminJSON-1913178016 tempest-SecurityGroupsTestAdminJSON-1913178016-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.158015 Aug 22 17:12:20.435753 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 134/294] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:12:18 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:20.438185 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-aa8a9465-eec9-4d90-b331-6159ae52a256 tempest-SecurityGroupsTestAdminJSON-1913178016 tempest-SecurityGroupsTestAdminJSON-1913178016-project] Action: 'create', calling method: .version_select at 0x7f800a6c6d30>, body: {"security_group": {"name": "tempest-securitygroup-773046508", "description": "tempest-description-1603768126"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:20.943515 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0a0eaf6b-cb8f-4685-8026-017fcad8ef62 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:20.943515 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-0a0eaf6b-cb8f-4685-8026-017fcad8ef62 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:20.947129 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0a0eaf6b-cb8f-4685-8026-017fcad8ef62 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:20.947593 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0a0eaf6b-cb8f-4685-8026-017fcad8ef62 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:20.948210 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0a0eaf6b-cb8f-4685-8026-017fcad8ef62 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:20.948923 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0a0eaf6b-cb8f-4685-8026-017fcad8ef62 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:20.949479 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0a0eaf6b-cb8f-4685-8026-017fcad8ef62 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:20.950163 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0a0eaf6b-cb8f-4685-8026-017fcad8ef62 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:20.956823 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:21.422595 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-0a0eaf6b-cb8f-4685-8026-017fcad8ef62 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:21.428623 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0a0eaf6b-cb8f-4685-8026-017fcad8ef62 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1319 microversion: 2.1 time: 0.490944 Aug 22 17:12:21.429570 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 135/295] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:20 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:21.683441 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-53413f77-dcc9-4e98-b2fa-3baed6974f1f tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Action: 'update', calling method: .version_select at 0x7f8009fb0160>, body: {"quota_set": {"ram": "5120"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:21.726894 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-aa8a9465-eec9-4d90-b331-6159ae52a256 tempest-SecurityGroupsTestAdminJSON-1913178016 tempest-SecurityGroupsTestAdminJSON-1913178016-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.439234 Aug 22 17:12:21.728424 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 161/296] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:12:20 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:21.839504 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53413f77-dcc9-4e98-b2fa-3baed6974f1f tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:21.840000 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53413f77-dcc9-4e98-b2fa-3baed6974f1f tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:21.840445 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53413f77-dcc9-4e98-b2fa-3baed6974f1f tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:21.844361 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53413f77-dcc9-4e98-b2fa-3baed6974f1f tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:21.844848 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53413f77-dcc9-4e98-b2fa-3baed6974f1f tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:21.845347 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53413f77-dcc9-4e98-b2fa-3baed6974f1f tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:22.104699 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-53413f77-dcc9-4e98-b2fa-3baed6974f1f tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-quota-sets/54613a16e4d34d3d80d9158b96a7d561" status: 200 len: 240 microversion: 2.36 time: 0.661133 Aug 22 17:12:22.117504 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 136/297] 10.222.0.96 () {62 vars in 1303 bytes} [Mon Aug 22 17:12:21 2022] PUT /compute/v2.1/os-quota-sets/54613a16e4d34d3d80d9158b96a7d561 => generated 240 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:12:22.122966 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-bd98fb62-0cda-4bd7-b49a-54ff2815ca40 tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Calling method '.version_select at 0x7f800a04ed30>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:22.188069 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-027ec252-308a-459d-951d-30fd5fbd0ff2 tempest-SecurityGroupsTestAdminJSON-818512926 tempest-SecurityGroupsTestAdminJSON-818512926-project-admin] Action: 'create', calling method: .version_select at 0x7f8009ea7820>, body: {"security_group": {"name": "tempest-securitygroup-1475270706", "description": "tempest-description-135542915"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:22.345160 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bd98fb62-0cda-4bd7-b49a-54ff2815ca40 tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:22.345831 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bd98fb62-0cda-4bd7-b49a-54ff2815ca40 tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:22.346324 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bd98fb62-0cda-4bd7-b49a-54ff2815ca40 tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:22.347140 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bd98fb62-0cda-4bd7-b49a-54ff2815ca40 tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:22.347603 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bd98fb62-0cda-4bd7-b49a-54ff2815ca40 tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:22.348078 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bd98fb62-0cda-4bd7-b49a-54ff2815ca40 tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:22.384251 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-bd98fb62-0cda-4bd7-b49a-54ff2815ca40 tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/54613a16e4d34d3d80d9158b96a7d561/detail" status: 200 len: 672 microversion: 2.36 time: 0.265283 Aug 22 17:12:22.394641 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 137/298] 10.222.0.96 () {60 vars in 1304 bytes} [Mon Aug 22 17:12:22 2022] GET /compute/v2.1/os-quota-sets/54613a16e4d34d3d80d9158b96a7d561/detail => generated 672 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:12:22.452053 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9621ddbc-a08d-49c5-9a4b-82baeea2baf9 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:22.452839 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-9621ddbc-a08d-49c5-9a4b-82baeea2baf9 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:22.462613 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9621ddbc-a08d-49c5-9a4b-82baeea2baf9 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:22.466093 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9621ddbc-a08d-49c5-9a4b-82baeea2baf9 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:22.466093 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9621ddbc-a08d-49c5-9a4b-82baeea2baf9 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:22.466093 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9621ddbc-a08d-49c5-9a4b-82baeea2baf9 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:22.466093 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9621ddbc-a08d-49c5-9a4b-82baeea2baf9 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:22.466368 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9621ddbc-a08d-49c5-9a4b-82baeea2baf9 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:22.837985 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9621ddbc-a08d-49c5-9a4b-82baeea2baf9 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:22.857109 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9621ddbc-a08d-49c5-9a4b-82baeea2baf9 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1319 microversion: 2.1 time: 0.401522 Aug 22 17:12:22.869511 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 138/299] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:22 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:22.879289 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-318c1520-d024-4514-a3c0-bb8281a522a7 req-ab399bdc-146b-4b67-bd45-11433f883201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08", "name": "network-vif-plugged", "status": "completed", "tag": "d00ea38b-c795-4f8e-91a9-b1a331e1b26b"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:22.905603 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-318c1520-d024-4514-a3c0-bb8281a522a7 req-ab399bdc-146b-4b67-bd45-11433f883201 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:22.906106 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-318c1520-d024-4514-a3c0-bb8281a522a7 req-ab399bdc-146b-4b67-bd45-11433f883201 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:22.907684 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-318c1520-d024-4514-a3c0-bb8281a522a7 req-ab399bdc-146b-4b67-bd45-11433f883201 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:22.955478 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-318c1520-d024-4514-a3c0-bb8281a522a7 req-ab399bdc-146b-4b67-bd45-11433f883201 service nova] Creating event network-vif-plugged:d00ea38b-c795-4f8e-91a9-b1a331e1b26b for instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 on n-h1-854030-1 Aug 22 17:12:22.975739 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-318c1520-d024-4514-a3c0-bb8281a522a7 req-ab399bdc-146b-4b67-bd45-11433f883201 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100805 Aug 22 17:12:22.975739 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 139/300] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:23.017176 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d8388205-6d4e-4921-96d2-b4637e7e6c0b tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Action: 'update', calling method: .version_select at 0x7f800a0e4af0>, body: {"quota_set": {"ram": "2048"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:23.283851 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d8388205-6d4e-4921-96d2-b4637e7e6c0b tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:23.284259 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d8388205-6d4e-4921-96d2-b4637e7e6c0b tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:23.284699 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d8388205-6d4e-4921-96d2-b4637e7e6c0b tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:23.290180 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d8388205-6d4e-4921-96d2-b4637e7e6c0b tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:23.290938 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d8388205-6d4e-4921-96d2-b4637e7e6c0b tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:23.291554 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d8388205-6d4e-4921-96d2-b4637e7e6c0b tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:23.375198 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d8388205-6d4e-4921-96d2-b4637e7e6c0b tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:23.376063 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d8388205-6d4e-4921-96d2-b4637e7e6c0b tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:23.376743 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d8388205-6d4e-4921-96d2-b4637e7e6c0b tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:23.377794 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d8388205-6d4e-4921-96d2-b4637e7e6c0b tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:23.379284 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d8388205-6d4e-4921-96d2-b4637e7e6c0b tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:23.379975 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d8388205-6d4e-4921-96d2-b4637e7e6c0b tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:23.389177 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=100 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:23.642169 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d8388205-6d4e-4921-96d2-b4637e7e6c0b tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-quota-sets/54613a16e4d34d3d80d9158b96a7d561?user_id=3ce1bfdd4b4e4c37972c31136897919d" status: 200 len: 240 microversion: 2.36 time: 0.622036 Aug 22 17:12:23.643769 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 140/301] 10.222.0.96 () {62 vars in 1384 bytes} [Mon Aug 22 17:12:23 2022] PUT /compute/v2.1/os-quota-sets/54613a16e4d34d3d80d9158b96a7d561?user_id=3ce1bfdd4b4e4c37972c31136897919d => generated 240 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:12:23.668165 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-653ff660-9ab3-4a91-87fa-659e251174d1 tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] Calling method '.version_select at 0x7f8009fbd8b0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:23.750339 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-027ec252-308a-459d-951d-30fd5fbd0ff2 tempest-SecurityGroupsTestAdminJSON-818512926 tempest-SecurityGroupsTestAdminJSON-818512926-project-admin] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.011525 Aug 22 17:12:23.750339 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 162/302] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:12:21 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2013 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:12:23.762547 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ca1ec845-5f32-4a61-b647-ba5d1ebb6f2e tempest-SecurityGroupsTestAdminJSON-818512926 tempest-SecurityGroupsTestAdminJSON-818512926-project-admin] Action: 'create', calling method: .version_select at 0x7f8009e9ff70>, body: {"security_group": {"name": "tempest-securitygroup-963314739", "description": "tempest-description-1742899681"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:24.096201 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-653ff660-9ab3-4a91-87fa-659e251174d1 tempest-QuotasAdminTestV236-62093273 tempest-QuotasAdminTestV236-62093273-project-admin] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/54613a16e4d34d3d80d9158b96a7d561?user_id=3ce1bfdd4b4e4c37972c31136897919d" status: 200 len: 282 microversion: 2.36 time: 0.435908 Aug 22 17:12:24.109674 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 141/303] 10.222.0.96 () {60 vars in 1364 bytes} [Mon Aug 22 17:12:23 2022] GET /compute/v2.1/os-quota-sets/54613a16e4d34d3d80d9158b96a7d561?user_id=3ce1bfdd4b4e4c37972c31136897919d => generated 282 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:12:24.112936 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-bb78aa0b-95f9-4498-85e0-19f840a50024 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:24.113963 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-bb78aa0b-95f9-4498-85e0-19f840a50024 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:24.129531 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb78aa0b-95f9-4498-85e0-19f840a50024 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:24.130576 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb78aa0b-95f9-4498-85e0-19f840a50024 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:24.131739 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb78aa0b-95f9-4498-85e0-19f840a50024 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:24.132906 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb78aa0b-95f9-4498-85e0-19f840a50024 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:24.134092 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb78aa0b-95f9-4498-85e0-19f840a50024 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:24.135472 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb78aa0b-95f9-4498-85e0-19f840a50024 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:24.406444 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-bb78aa0b-95f9-4498-85e0-19f840a50024 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:24.407584 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ca1ec845-5f32-4a61-b647-ba5d1ebb6f2e tempest-SecurityGroupsTestAdminJSON-818512926 tempest-SecurityGroupsTestAdminJSON-818512926-project-admin] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.649681 Aug 22 17:12:24.408504 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 163/304] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:12:23 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:12:24.426705 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b6d775d1-2ff0-4953-ac55-193666189b35 tempest-SecurityGroupsTestAdminJSON-818512926 tempest-SecurityGroupsTestAdminJSON-818512926-project-admin] Calling method '.version_select at 0x7f8009e9f550>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:24.440648 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-bb78aa0b-95f9-4498-85e0-19f840a50024 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1319 microversion: 2.1 time: 0.318715 Aug 22 17:12:24.440648 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 142/305] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:24 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:25.448300 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-51396851-fca0-4222-86ec-2497e44751de tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:25.448806 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-51396851-fca0-4222-86ec-2497e44751de tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:25.464378 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-51396851-fca0-4222-86ec-2497e44751de tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:25.464940 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-51396851-fca0-4222-86ec-2497e44751de tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:25.471413 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-51396851-fca0-4222-86ec-2497e44751de tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:25.472243 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-51396851-fca0-4222-86ec-2497e44751de tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:25.472731 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-51396851-fca0-4222-86ec-2497e44751de tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:25.473202 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-51396851-fca0-4222-86ec-2497e44751de tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:25.685801 n-d-854030-1 devstack@n-api.service[123015]: DEBUG neutronclient.v2_0.client [None req-b6d775d1-2ff0-4953-ac55-193666189b35 tempest-SecurityGroupsTestAdminJSON-818512926 tempest-SecurityGroupsTestAdminJSON-818512926-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 31542010-43bb-41d7-b871-aa13fab509d4 does not exist", "detail": ""}} {{(pid=123015) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:12:25.686657 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.security_group_api [None req-b6d775d1-2ff0-4953-ac55-193666189b35 tempest-SecurityGroupsTestAdminJSON-818512926 tempest-SecurityGroupsTestAdminJSON-818512926-project-admin] Neutron security group 31542010-43bb-41d7-b871-aa13fab509d4 not found {{(pid=123015) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 22 17:12:25.687116 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.compute.security_groups [None req-b6d775d1-2ff0-4953-ac55-193666189b35 tempest-SecurityGroupsTestAdminJSON-818512926 tempest-SecurityGroupsTestAdminJSON-818512926-project-admin] Security Group ID 31542010-43bb-41d7-b871-aa13fab509d4 does not exist {{(pid=123015) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Aug 22 17:12:25.723016 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-51396851-fca0-4222-86ec-2497e44751de tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:25.734853 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-51396851-fca0-4222-86ec-2497e44751de tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1319 microversion: 2.1 time: 0.291116 Aug 22 17:12:25.735445 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 143/306] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:25 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:25.740116 n-d-854030-1 devstack@n-api.service[123015]: DEBUG neutronclient.v2_0.client [None req-b6d775d1-2ff0-4953-ac55-193666189b35 tempest-SecurityGroupsTestAdminJSON-818512926 tempest-SecurityGroupsTestAdminJSON-818512926-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 31542010-43bb-41d7-b871-aa13fab509d4 does not exist", "detail": ""}} {{(pid=123015) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:12:25.742330 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.security_group_api [None req-b6d775d1-2ff0-4953-ac55-193666189b35 tempest-SecurityGroupsTestAdminJSON-818512926 tempest-SecurityGroupsTestAdminJSON-818512926-project-admin] Neutron security group 31542010-43bb-41d7-b871-aa13fab509d4 not found {{(pid=123015) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 22 17:12:25.743245 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.compute.security_groups [None req-b6d775d1-2ff0-4953-ac55-193666189b35 tempest-SecurityGroupsTestAdminJSON-818512926 tempest-SecurityGroupsTestAdminJSON-818512926-project-admin] Security Group ID 31542010-43bb-41d7-b871-aa13fab509d4 does not exist {{(pid=123015) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Aug 22 17:12:26.757408 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5a697532-5652-4f85-be15-f321cd5fa528 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:26.758016 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5a697532-5652-4f85-be15-f321cd5fa528 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:26.779608 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5a697532-5652-4f85-be15-f321cd5fa528 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:26.781689 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5a697532-5652-4f85-be15-f321cd5fa528 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:26.783686 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5a697532-5652-4f85-be15-f321cd5fa528 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:26.788212 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5a697532-5652-4f85-be15-f321cd5fa528 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:26.788212 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5a697532-5652-4f85-be15-f321cd5fa528 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:26.788212 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5a697532-5652-4f85-be15-f321cd5fa528 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:27.069016 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-5a697532-5652-4f85-be15-f321cd5fa528 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:27.075747 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5a697532-5652-4f85-be15-f321cd5fa528 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1469 microversion: 2.1 time: 0.321784 Aug 22 17:12:27.077021 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 144/307] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:26 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1469 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:27.099254 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-191310e2-4aea-419b-ab86-35b1ea269e71 tempest-DeleteServersAdminTestJSON-128876406 tempest-DeleteServersAdminTestJSON-128876406-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:27.104017 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-191310e2-4aea-419b-ab86-35b1ea269e71 tempest-DeleteServersAdminTestJSON-128876406 tempest-DeleteServersAdminTestJSON-128876406-project-admin] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:27.111538 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-191310e2-4aea-419b-ab86-35b1ea269e71 tempest-DeleteServersAdminTestJSON-128876406 tempest-DeleteServersAdminTestJSON-128876406-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:27.113423 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-191310e2-4aea-419b-ab86-35b1ea269e71 tempest-DeleteServersAdminTestJSON-128876406 tempest-DeleteServersAdminTestJSON-128876406-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:27.114059 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-191310e2-4aea-419b-ab86-35b1ea269e71 tempest-DeleteServersAdminTestJSON-128876406 tempest-DeleteServersAdminTestJSON-128876406-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:27.115001 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-191310e2-4aea-419b-ab86-35b1ea269e71 tempest-DeleteServersAdminTestJSON-128876406 tempest-DeleteServersAdminTestJSON-128876406-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:27.116195 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-191310e2-4aea-419b-ab86-35b1ea269e71 tempest-DeleteServersAdminTestJSON-128876406 tempest-DeleteServersAdminTestJSON-128876406-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:27.117012 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-191310e2-4aea-419b-ab86-35b1ea269e71 tempest-DeleteServersAdminTestJSON-128876406 tempest-DeleteServersAdminTestJSON-128876406-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:27.307851 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b6d775d1-2ff0-4953-ac55-193666189b35 tempest-SecurityGroupsTestAdminJSON-818512926 tempest-SecurityGroupsTestAdminJSON-818512926-project-admin] 10.222.0.96 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9166 microversion: 2.1 time: 2.889330 Aug 22 17:12:27.308878 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 164/308] 10.222.0.96 () {58 vars in 1191 bytes} [Mon Aug 22 17:12:24 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9166 bytes in 2892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:27.331047 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-eea45381-d7de-4044-bdd9-a9f88a782d28 tempest-SecurityGroupsTestAdminJSON-1913178016 tempest-SecurityGroupsTestAdminJSON-1913178016-project] Calling method '.version_select at 0x7f8009ea79d0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:27.829697 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-eea45381-d7de-4044-bdd9-a9f88a782d28 tempest-SecurityGroupsTestAdminJSON-1913178016 tempest-SecurityGroupsTestAdminJSON-1913178016-project] 10.222.0.96 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.502672 Aug 22 17:12:27.830287 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 165/309] 10.222.0.96 () {58 vars in 1191 bytes} [Mon Aug 22 17:12:27 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:27.844309 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fba7e8ba-8c78-46fe-891b-af959b58830c tempest-SecurityGroupsTestAdminJSON-818512926 tempest-SecurityGroupsTestAdminJSON-818512926-project-admin] Calling method '.version_select at 0x7f8009e4c040>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:27.996969 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-191310e2-4aea-419b-ab86-35b1ea269e71 tempest-DeleteServersAdminTestJSON-128876406 tempest-DeleteServersAdminTestJSON-128876406-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08/action" status: 202 len: 0 microversion: 2.1 time: 0.901653 Aug 22 17:12:27.999054 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 145/310] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:12:27 2022] POST /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08/action => generated 0 bytes in 905 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:12:28.010205 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-916406ec-fb02-4538-807e-2b45bcbca872 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:28.012787 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-916406ec-fb02-4538-807e-2b45bcbca872 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:28.044119 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-916406ec-fb02-4538-807e-2b45bcbca872 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:28.044876 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-916406ec-fb02-4538-807e-2b45bcbca872 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:28.049467 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-916406ec-fb02-4538-807e-2b45bcbca872 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:28.053474 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-916406ec-fb02-4538-807e-2b45bcbca872 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:28.055021 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-916406ec-fb02-4538-807e-2b45bcbca872 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:28.057642 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-916406ec-fb02-4538-807e-2b45bcbca872 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:28.112209 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-916406ec-fb02-4538-807e-2b45bcbca872 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:28.112705 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-916406ec-fb02-4538-807e-2b45bcbca872 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:28.113167 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-916406ec-fb02-4538-807e-2b45bcbca872 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:28.113640 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-916406ec-fb02-4538-807e-2b45bcbca872 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lazy-loading 'fault' on Instance uuid 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:12:28.282290 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fba7e8ba-8c78-46fe-891b-af959b58830c tempest-SecurityGroupsTestAdminJSON-818512926 tempest-SecurityGroupsTestAdminJSON-818512926-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/43d316a1-a677-49b5-b599-6459ff8e031a" status: 202 len: 0 microversion: 2.1 time: 0.441889 Aug 22 17:12:28.282887 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 166/311] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:12:27 2022] DELETE /compute/v2.1/os-security-groups/43d316a1-a677-49b5-b599-6459ff8e031a => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:12:28.290737 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-916406ec-fb02-4538-807e-2b45bcbca872 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:28.292630 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e6570def-bc6d-409f-88b7-72848a7b3144 tempest-SecurityGroupsTestAdminJSON-818512926 tempest-SecurityGroupsTestAdminJSON-818512926-project-admin] Calling method '.version_select at 0x7f8009e4c670>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:28.316687 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-916406ec-fb02-4538-807e-2b45bcbca872 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1452 microversion: 2.1 time: 0.311771 Aug 22 17:12:28.330669 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 146/312] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:28 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1452 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:28.367378 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b8b0bcbe-a066-450a-ad17-800c3556a5f5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:28.367378 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b8b0bcbe-a066-450a-ad17-800c3556a5f5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:28.386992 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b8b0bcbe-a066-450a-ad17-800c3556a5f5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:28.387632 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b8b0bcbe-a066-450a-ad17-800c3556a5f5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:28.388159 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b8b0bcbe-a066-450a-ad17-800c3556a5f5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:28.388976 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b8b0bcbe-a066-450a-ad17-800c3556a5f5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:28.400560 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b8b0bcbe-a066-450a-ad17-800c3556a5f5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:28.403069 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b8b0bcbe-a066-450a-ad17-800c3556a5f5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:28.473167 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b8b0bcbe-a066-450a-ad17-800c3556a5f5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Going to try to terminate instance {{(pid=123016) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:12:28.802840 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e6570def-bc6d-409f-88b7-72848a7b3144 tempest-SecurityGroupsTestAdminJSON-818512926 tempest-SecurityGroupsTestAdminJSON-818512926-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/17f86f36-ba29-44d0-9f14-d947fe09e253" status: 202 len: 0 microversion: 2.1 time: 0.514977 Aug 22 17:12:28.804305 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 167/313] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:12:28 2022] DELETE /compute/v2.1/os-security-groups/17f86f36-ba29-44d0-9f14-d947fe09e253 => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:12:28.816482 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-bf20bc4d-59f9-4430-8e18-f43a1512b17d tempest-SecurityGroupsTestAdminJSON-1913178016 tempest-SecurityGroupsTestAdminJSON-1913178016-project] Calling method '.version_select at 0x7f8009e4c700>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:29.215210 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b8b0bcbe-a066-450a-ad17-800c3556a5f5 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "DELETE /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 204 len: 0 microversion: 2.1 time: 0.864294 Aug 22 17:12:29.216683 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 147/314] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:12:28 2022] DELETE /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 0 bytes in 868 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:12:29.227649 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-53fc2811-571c-40b8-a24b-9dd31d117f3e tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:29.236609 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-bf20bc4d-59f9-4430-8e18-f43a1512b17d tempest-SecurityGroupsTestAdminJSON-1913178016 tempest-SecurityGroupsTestAdminJSON-1913178016-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/1dea3c9e-6b4f-4384-867f-8d87c60ed23d" status: 202 len: 0 microversion: 2.1 time: 0.425013 Aug 22 17:12:29.237654 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 168/315] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:12:28 2022] DELETE /compute/v2.1/os-security-groups/1dea3c9e-6b4f-4384-867f-8d87c60ed23d => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:12:29.241173 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-53fc2811-571c-40b8-a24b-9dd31d117f3e tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:29.245409 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:29.246947 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1b78fa38-fed3-40cd-8938-38a1b2d713dc tempest-SecurityGroupsTestAdminJSON-1913178016 tempest-SecurityGroupsTestAdminJSON-1913178016-project] Calling method '.version_select at 0x7f8009ea7940>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:29.249321 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53fc2811-571c-40b8-a24b-9dd31d117f3e tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:29.250062 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53fc2811-571c-40b8-a24b-9dd31d117f3e tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:29.250698 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53fc2811-571c-40b8-a24b-9dd31d117f3e tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:29.252091 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53fc2811-571c-40b8-a24b-9dd31d117f3e tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:29.253180 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53fc2811-571c-40b8-a24b-9dd31d117f3e tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:29.254059 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53fc2811-571c-40b8-a24b-9dd31d117f3e tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:29.299259 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53fc2811-571c-40b8-a24b-9dd31d117f3e tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:29.299797 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53fc2811-571c-40b8-a24b-9dd31d117f3e tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:29.300737 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-53fc2811-571c-40b8-a24b-9dd31d117f3e tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:29.301762 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-53fc2811-571c-40b8-a24b-9dd31d117f3e tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lazy-loading 'fault' on Instance uuid 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:12:29.479323 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-53fc2811-571c-40b8-a24b-9dd31d117f3e tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:29.489677 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-53fc2811-571c-40b8-a24b-9dd31d117f3e tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1458 microversion: 2.1 time: 0.267720 Aug 22 17:12:29.505636 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 148/316] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:29 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1458 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:29.621567 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:DELETE=11,nova_api:SELECT=63,nova_api:INSERT=5 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:29.913312 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=46 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:30.095293 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1b78fa38-fed3-40cd-8938-38a1b2d713dc tempest-SecurityGroupsTestAdminJSON-1913178016 tempest-SecurityGroupsTestAdminJSON-1913178016-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/39254ee1-0042-43e9-9cf7-d68222ccf427" status: 202 len: 0 microversion: 2.1 time: 0.852650 Aug 22 17:12:30.096063 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 169/317] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:12:29 2022] DELETE /compute/v2.1/os-security-groups/39254ee1-0042-43e9-9cf7-d68222ccf427 => generated 0 bytes in 854 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:12:30.513543 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f1a39b84-4552-41cf-9c15-e0d134291951 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:30.514835 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-f1a39b84-4552-41cf-9c15-e0d134291951 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:30.529022 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f1a39b84-4552-41cf-9c15-e0d134291951 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:30.533227 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f1a39b84-4552-41cf-9c15-e0d134291951 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:30.534972 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f1a39b84-4552-41cf-9c15-e0d134291951 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:30.535890 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f1a39b84-4552-41cf-9c15-e0d134291951 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:30.544144 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f1a39b84-4552-41cf-9c15-e0d134291951 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:30.544833 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f1a39b84-4552-41cf-9c15-e0d134291951 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:30.641741 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f1a39b84-4552-41cf-9c15-e0d134291951 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:30.642646 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f1a39b84-4552-41cf-9c15-e0d134291951 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:30.643417 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f1a39b84-4552-41cf-9c15-e0d134291951 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:30.644248 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-f1a39b84-4552-41cf-9c15-e0d134291951 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lazy-loading 'fault' on Instance uuid 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:12:30.972977 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-f1a39b84-4552-41cf-9c15-e0d134291951 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:30.985269 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f1a39b84-4552-41cf-9c15-e0d134291951 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1458 microversion: 2.1 time: 0.476748 Aug 22 17:12:30.999228 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 149/318] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:30 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1458 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:31.706615 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-06ae8038-2af7-4a08-8770-b5200aee1eda req-1061e7a8-fc20-4d2a-98fc-805ec49d1184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08", "name": "network-vif-deleted", "tag": "d00ea38b-c795-4f8e-91a9-b1a331e1b26b"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:31.716827 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-06ae8038-2af7-4a08-8770-b5200aee1eda req-1061e7a8-fc20-4d2a-98fc-805ec49d1184 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:31.717781 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-06ae8038-2af7-4a08-8770-b5200aee1eda req-1061e7a8-fc20-4d2a-98fc-805ec49d1184 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:31.718632 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-06ae8038-2af7-4a08-8770-b5200aee1eda req-1061e7a8-fc20-4d2a-98fc-805ec49d1184 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:31.731089 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-06ae8038-2af7-4a08-8770-b5200aee1eda req-1061e7a8-fc20-4d2a-98fc-805ec49d1184 service nova] Creating event network-vif-deleted:d00ea38b-c795-4f8e-91a9-b1a331e1b26b for instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 on n-h1-854030-1 Aug 22 17:12:31.738669 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-06ae8038-2af7-4a08-8770-b5200aee1eda req-1061e7a8-fc20-4d2a-98fc-805ec49d1184 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037719 Aug 22 17:12:31.743988 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 170/319] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:12:32.010367 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-197ad172-956c-4be4-8612-dce04cee984b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:32.012887 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-197ad172-956c-4be4-8612-dce04cee984b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:32.021239 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-197ad172-956c-4be4-8612-dce04cee984b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:32.021980 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-197ad172-956c-4be4-8612-dce04cee984b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:32.026074 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-197ad172-956c-4be4-8612-dce04cee984b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:32.026074 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-197ad172-956c-4be4-8612-dce04cee984b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:32.026074 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-197ad172-956c-4be4-8612-dce04cee984b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:32.026074 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-197ad172-956c-4be4-8612-dce04cee984b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:32.071681 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-197ad172-956c-4be4-8612-dce04cee984b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:32.072455 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-197ad172-956c-4be4-8612-dce04cee984b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:32.073072 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-197ad172-956c-4be4-8612-dce04cee984b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:32.073734 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-197ad172-956c-4be4-8612-dce04cee984b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lazy-loading 'fault' on Instance uuid 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:12:32.151449 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-197ad172-956c-4be4-8612-dce04cee984b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:32.157936 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-197ad172-956c-4be4-8612-dce04cee984b tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1287 microversion: 2.1 time: 0.155083 Aug 22 17:12:32.173765 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 150/320] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:32 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1287 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:32.752032 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-34a7ce42-1e59-46e6-a395-bef3ba0413b4 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-291157747", "id": 946609740, "os-flavor-access:is_public": "True"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:32.755600 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:32.755600 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:32.885070 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-34a7ce42-1e59-46e6-a395-bef3ba0413b4 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.426571 Aug 22 17:12:32.885695 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 171/321] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:32 2022] POST /compute/v2.1/flavors => generated 426 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:12:32.904755 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-30f02369-9e32-4749-8203-3cfc4e227419 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:32.906173 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:32.906173 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:33.043703 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-30f02369-9e32-4749-8203-3cfc4e227419 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/946609740" status: 202 len: 0 microversion: 2.1 time: 0.142500 Aug 22 17:12:33.047664 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 151/322] 10.222.0.96 () {58 vars in 1158 bytes} [Mon Aug 22 17:12:32 2022] DELETE /compute/v2.1/flavors/946609740 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:12:33.054981 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-33fa9ee4-4ef8-4a14-b8ac-f9865577be6e tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:33.108063 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-33fa9ee4-4ef8-4a14-b8ac-f9865577be6e tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056963 Aug 22 17:12:33.122462 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 172/323] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:33.135989 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-cc79db75-c6ea-4dcc-ace0-9ea85bf8d685 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2127492434", "id": 1189116374, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:33.148806 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:33.148806 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:33.181821 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4b028e58-af5a-4a05-9bd6-09d006405172 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:33.183393 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-4b028e58-af5a-4a05-9bd6-09d006405172 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:33.200800 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b028e58-af5a-4a05-9bd6-09d006405172 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:33.201411 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b028e58-af5a-4a05-9bd6-09d006405172 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:33.201865 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b028e58-af5a-4a05-9bd6-09d006405172 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:33.202932 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b028e58-af5a-4a05-9bd6-09d006405172 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:33.209052 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b028e58-af5a-4a05-9bd6-09d006405172 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:33.209052 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b028e58-af5a-4a05-9bd6-09d006405172 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:33.259870 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b028e58-af5a-4a05-9bd6-09d006405172 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:33.260359 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b028e58-af5a-4a05-9bd6-09d006405172 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:33.260792 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b028e58-af5a-4a05-9bd6-09d006405172 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:33.261282 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-4b028e58-af5a-4a05-9bd6-09d006405172 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lazy-loading 'fault' on Instance uuid 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:12:33.269580 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-cc79db75-c6ea-4dcc-ace0-9ea85bf8d685 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.138516 Aug 22 17:12:33.276921 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 152/324] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:33 2022] POST /compute/v2.1/flavors => generated 417 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:33.280277 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-95c8135a-e3dd-4168-9feb-5ae785aa52f6 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-778830584", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "fdc9ccda-2ee0-4687-8e99-c6ce209572f9"}], "block_device_mapping_v2": [{"uuid": "ecbe826d-d936-4713-88a7-ee56240661b1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:33.348505 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-4b028e58-af5a-4a05-9bd6-09d006405172 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b8f088a9d54406b1d670d7f8feecd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39044d6ce2411fbecee39e30eb5b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:33.359297 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-4b028e58-af5a-4a05-9bd6-09d006405172 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 200 len: 1309 microversion: 2.1 time: 0.182923 Aug 22 17:12:33.364076 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 173/325] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:33 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 1309 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:33.376090 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ae90bd85-f57f-43b9-ace1-a11fc58d1be7 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:33.399537 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=9 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:33.417505 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-95c8135a-e3dd-4168-9feb-5ae785aa52f6 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] validate_networks() for [('fdc9ccda-2ee0-4687-8e99-c6ce209572f9', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:12:33.446041 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ae90bd85-f57f-43b9-ace1-a11fc58d1be7 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.074587 Aug 22 17:12:33.446697 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 174/326] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:33 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:33.470062 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a521ee50-7358-4b09-9a69-7c19d8018fd7 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:33.474270 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:33.474270 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:33.619641 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a521ee50-7358-4b09-9a69-7c19d8018fd7 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/1189116374" status: 202 len: 0 microversion: 2.1 time: 0.157236 Aug 22 17:12:33.620473 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 175/327] 10.222.0.96 () {58 vars in 1161 bytes} [Mon Aug 22 17:12:33 2022] DELETE /compute/v2.1/flavors/1189116374 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:12:33.629207 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-139b7f34-7955-482c-b966-c66db63477a8 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:33.656293 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-139b7f34-7955-482c-b966-c66db63477a8 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031206 Aug 22 17:12:33.658868 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 176/328] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:33.676550 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-311412ce-b243-4e91-bb5e-c183c697496f tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-822892010", "id": 1100288312, "os-flavor-access:is_public": "True"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:33.680403 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:33.680403 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:33.820868 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-311412ce-b243-4e91-bb5e-c183c697496f tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.148458 Aug 22 17:12:33.834532 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 177/329] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:33 2022] POST /compute/v2.1/flavors => generated 428 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:12:33.845838 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-661ae799-fafc-4888-b0e2-6646128c6f20 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:33.906072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-95c8135a-e3dd-4168-9feb-5ae785aa52f6 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-671fd425-0234-4aca-9ab0-82d1fc4aff70) Aug 22 17:12:33.906072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:33.906072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:33.906072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:33.906072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:33.906072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:33.906072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:33.906072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:33.906072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:33.906072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:33.906072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:12:33.906072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:12:33.906072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:12:33.906072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:12:33.906072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:12:33.906072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:12:33.907260 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:12:33.907260 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:12:33.907260 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:12:33.907260 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:12:33.907260 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:12:33.907260 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:12:33.907260 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:12:33.907260 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:12:33.907260 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:12:33.907260 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:12:33.907260 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:12:33.907260 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:33.907260 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:33.907260 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:12:33.907260 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:12:33.907260 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:33.907260 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:33.907260 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:12:33.908391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:12:33.908391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:33.908391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:33.908391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:12:33.908391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:12:33.908391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:33.908391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:33.908391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:12:33.908391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:12:33.908391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:12:33.908391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:12:33.908391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:12:33.908391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:12:33.908391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:12:33.908391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:12:33.908391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:12:33.908391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:12:33.908391 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:12:33.910934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:12:33.910934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:12:33.910934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:12:33.910934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:12:33.910934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:12:33.910934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:12:33.910934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:12:33.910934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:12:33.910934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:12:33.910934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:12:33.910934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:12:33.910934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:12:33.910934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:12:33.910934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:12:33.910934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:12:33.912618 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-671fd425-0234-4aca-9ab0-82d1fc4aff70) Aug 22 17:12:33.912618 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:33.914547 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-95c8135a-e3dd-4168-9feb-5ae785aa52f6 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:33.914547 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-95c8135a-e3dd-4168-9feb-5ae785aa52f6 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Request method failure captured: Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 348 Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7i00XIted51SRgiyV5pAhir8FTEq23YkCIJUz0ya_ROxErxKEnH_Lg59kvaS9UiroD-f6GQRmzIgeDn2uLeWFMJYJ__6lnPnVkQ2uGAAXUl9FSd5SHblMfVv907QYMDRNu-Fy91G6CqDgyc6PinbWYoGdS41dDpH8-Dssg6vayPSNA Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 8322e3f6eb26483d8dcad0662e1ec3ff Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-LiveMigrationTest-1154936269 Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:12:33.917903 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:12:33.919316 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8322e3f6eb26483d8dcad0662e1ec3ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_8322e3f6eb26483d8dcad0662e1ec3ff", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8322e3f6eb26483d8dcad0662e1ec3ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/8322e3f6eb26483d8dcad0662e1ec3ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:33.919316 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-LiveMigrationTest-1154936269 Aug 22 17:12:33.919316 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 8322e3f6eb26483d8dcad0662e1ec3ff Aug 22 17:12:33.919316 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-LiveMigrationTest-1154936269 Aug 22 17:12:33.919316 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-LiveMigrationTest-1154936269-project Aug 22 17:12:33.919316 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:12:33.919316 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:12:33.919316 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 53ebbab2867a4b4c9dd3744fedd1c779 Aug 22 17:12:33.919316 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-LiveMigrationTest-1154936269-project Aug 22 17:12:33.919316 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:12:33.919928 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-LiveMigrationTest-server-778830584", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "fdc9ccda-2ee0-4687-8e99-c6ce209572f9"}], "block_device_mapping_v2": [{"uuid": "ecbe826d-d936-4713-88a7-ee56240661b1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} Aug 22 17:12:33.919928 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:12:33.919928 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:33.919928 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:12:33.919928 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-778830584', 'imageRef': '', 'flavorRef': '452', 'networks': [{'uuid': 'fdc9ccda-2ee0-4687-8e99-c6ce209572f9'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': 'ecbe826d-d936-4713-88a7-ee56240661b1'}]}}} Aug 22 17:12:33.919928 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:33.919928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:33.919928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:33.919928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:33.919928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:33.919928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:33.919928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:33.919928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:33.919928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:33.919928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:33.921016 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:12:33.921016 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:12:33.921016 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:12:33.921016 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:12:33.921016 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:12:33.921016 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:12:33.921016 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:12:33.921016 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:12:33.921016 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:12:33.921016 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:12:33.921016 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:12:33.921016 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:12:33.921016 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:12:33.921016 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:12:33.921016 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:12:33.921016 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:12:33.921016 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:12:33.921016 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:33.921016 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:33.922286 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:12:33.922286 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:12:33.922286 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:33.922286 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:33.922286 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:12:33.922286 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:12:33.922286 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:33.922286 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:33.922286 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:12:33.922286 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:12:33.922286 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:33.922286 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:33.922286 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:12:33.922286 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:12:33.922286 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:12:33.922286 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:12:33.922286 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:12:33.922286 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:12:33.923547 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:12:33.923547 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:12:33.923547 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:12:33.923547 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:12:33.923547 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:12:33.923547 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:12:33.923547 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:12:33.923547 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:12:33.923547 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:12:33.923547 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:12:33.923547 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:12:33.923547 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:12:33.923547 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:12:33.923547 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:12:33.923547 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:12:33.923547 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:12:33.924439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:12:33.924439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:12:33.924439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:12:33.924439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:12:33.924439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-671fd425-0234-4aca-9ab0-82d1fc4aff70) Aug 22 17:12:33.924439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:33.924439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:33.924439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:33.924439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:33.924439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:33.924439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:33.924439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:33.924439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:33.924439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:12:33.924439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:12:33.924439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:33.924439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:33.924439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:33.931470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:33.931470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:33.931470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:33.931470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:33.931470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:33.931470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:33.931470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:33.931470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:33.931470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:33.931470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:33.931470 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-95c8135a-e3dd-4168-9feb-5ae785aa52f6 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:33.931470 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:33.931470 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-95c8135a-e3dd-4168-9feb-5ae785aa52f6 tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.650935 Aug 22 17:12:33.931470 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 153/330] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:33 2022] POST /compute/v2.1/servers => generated 214 bytes in 653 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:12:33.944976 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e3b5a0fb-f74b-4bf6-9fdb-5243b324f07f tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] Calling method '.version_select at 0x7f800a0ffca0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:33.985737 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-661ae799-fafc-4888-b0e2-6646128c6f20 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/1100288312" status: 202 len: 0 microversion: 2.1 time: 0.144334 Aug 22 17:12:33.987570 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 178/331] 10.222.0.96 () {58 vars in 1161 bytes} [Mon Aug 22 17:12:33 2022] DELETE /compute/v2.1/flavors/1100288312 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:12:33.995005 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-613ec780-7079-4afd-93ae-aeb02dad76a8 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:34.028351 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-613ec780-7079-4afd-93ae-aeb02dad76a8 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035588 Aug 22 17:12:34.028351 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 179/332] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:34.068250 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-433fc502-4638-488e-a4af-381f71f6fece tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1505456423", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:34.092044 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=26 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:34.097064 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e3b5a0fb-f74b-4bf6-9fdb-5243b324f07f tempest-LiveMigrationTest-1154936269 tempest-LiveMigrationTest-1154936269-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-609065396" status: 202 len: 0 microversion: 2.1 time: 0.156841 Aug 22 17:12:34.097670 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 154/333] 10.222.0.96 () {58 vars in 1218 bytes} [Mon Aug 22 17:12:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-609065396 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:12:34.215923 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-433fc502-4638-488e-a4af-381f71f6fece tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.163699 Aug 22 17:12:34.216807 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 180/334] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:34 2022] POST /compute/v2.1/flavors => generated 507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:34.237023 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1eb31b99-2532-4823-8c09-5c8399c818ea tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:34.351976 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1eb31b99-2532-4823-8c09-5c8399c818ea tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/f2a5d092-481c-480b-8026-849af5fad7b0" status: 202 len: 0 microversion: 2.1 time: 0.124451 Aug 22 17:12:34.353469 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 155/335] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:12:34 2022] DELETE /compute/v2.1/flavors/f2a5d092-481c-480b-8026-849af5fad7b0 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:12:34.364116 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-355503ea-d949-4b20-bf02-43967c8d24e5 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:34.386119 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e0b1e515-b571-4a47-915b-4be04372f9fe tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:34.386878 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e0b1e515-b571-4a47-915b-4be04372f9fe tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:34.410861 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e0b1e515-b571-4a47-915b-4be04372f9fe tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:34.413592 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e0b1e515-b571-4a47-915b-4be04372f9fe tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:34.415801 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e0b1e515-b571-4a47-915b-4be04372f9fe tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:34.415801 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e0b1e515-b571-4a47-915b-4be04372f9fe tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:34.415801 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e0b1e515-b571-4a47-915b-4be04372f9fe tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:34.417422 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e0b1e515-b571-4a47-915b-4be04372f9fe tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:34.443655 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-e0b1e515-b571-4a47-915b-4be04372f9fe tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] HTTP exception thrown: Instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 could not be found. Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e0b1e515-b571-4a47-915b-4be04372f9fe tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Request method failure captured: Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 HTTP/1.1 Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7irNrrRU2r6Naw6eycAJSqnAryJKahZl1ebo5v7zfl7mihEuf4-GwljgQje3Wd5x5oSdyYfISxabKBFi5xYcp5dipCCWoLDNek0LCzib4l5jekbxlrtk8SdlH5-9Znt_2Hv4j1QibLvuQiGvGYB63HjMVq2sx9sHKfSnp83LYS1o3k Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 7d39044d6ce2411fbecee39e30eb5b6e Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1793908082 Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:12:34.446076 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:12:34.447273 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7d39044d6ce2411fbecee39e30eb5b6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7d39044d6ce2411fbecee39e30eb5b6e", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7d39044d6ce2411fbecee39e30eb5b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7d39044d6ce2411fbecee39e30eb5b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:34.447273 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-DeleteServersAdminTestJSON-1793908082 Aug 22 17:12:34.447273 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 7d39044d6ce2411fbecee39e30eb5b6e Aug 22 17:12:34.447273 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1793908082 Aug 22 17:12:34.447273 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-DeleteServersAdminTestJSON-1793908082-project Aug 22 17:12:34.447273 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:12:34.447273 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:12:34.447273 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 25b8f088a9d54406b1d670d7f8feecd9 Aug 22 17:12:34.447273 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-DeleteServersAdminTestJSON-1793908082-project Aug 22 17:12:34.447273 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:12:34.447273 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 could not be found. Aug 22 17:12:34.447273 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08'} Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 could not be found. Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:34.447947 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:34.449032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:34.449032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:12:34.449032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:12:34.449032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:12:34.449032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:12:34.449032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:12:34.449032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:12:34.449032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 could not be found. Aug 22 17:12:34.449032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.449032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:34.449032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.449032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:34.449032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:34.449032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:34.449032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:34.449032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:34.449032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 could not be found. Aug 22 17:12:34.449032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.450111 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e0b1e515-b571-4a47-915b-4be04372f9fe tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Returning 404 to user: Instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:34.450111 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e0b1e515-b571-4a47-915b-4be04372f9fe tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 404 len: 111 microversion: 2.1 time: 0.065960 Aug 22 17:12:34.450111 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 156/336] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:34 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:12:34.457351 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-355503ea-d949-4b20-bf02-43967c8d24e5 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.091555 Aug 22 17:12:34.461366 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fbea846a-09f2-4353-ae02-63a7a69850ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:34.462816 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-fbea846a-09f2-4353-ae02-63a7a69850ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:34.469070 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 181/337] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:34.471269 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fbea846a-09f2-4353-ae02-63a7a69850ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:34.471932 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fbea846a-09f2-4353-ae02-63a7a69850ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:34.472725 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fbea846a-09f2-4353-ae02-63a7a69850ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:34.476186 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fbea846a-09f2-4353-ae02-63a7a69850ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:34.476882 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fbea846a-09f2-4353-ae02-63a7a69850ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:34.477485 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fbea846a-09f2-4353-ae02-63a7a69850ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:34.479121 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c15e909c-4619-444e-8208-c29e2f437d70 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1908604493", "id": "d1b79124-be85-480d-aed5-2af9a198f95f", "os-flavor-access:is_public": "True"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:34.496385 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-fbea846a-09f2-4353-ae02-63a7a69850ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] HTTP exception thrown: Instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 could not be found. Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fbea846a-09f2-4353-ae02-63a7a69850ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Request method failure captured: Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: request: DELETE /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 HTTP/1.1 Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7irNrrRU2r6Naw6eycAJSqnAryJKahZl1ebo5v7zfl7mihEuf4-GwljgQje3Wd5x5oSdyYfISxabKBFi5xYcp5dipCCWoLDNek0LCzib4l5jekbxlrtk8SdlH5-9Znt_2Hv4j1QibLvuQiGvGYB63HjMVq2sx9sHKfSnp83LYS1o3k Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 7d39044d6ce2411fbecee39e30eb5b6e Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1793908082 Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:12:34.505307 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:12:34.507236 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7d39044d6ce2411fbecee39e30eb5b6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7d39044d6ce2411fbecee39e30eb5b6e", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7d39044d6ce2411fbecee39e30eb5b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7d39044d6ce2411fbecee39e30eb5b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:34.507236 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-DeleteServersAdminTestJSON-1793908082 Aug 22 17:12:34.507236 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 7d39044d6ce2411fbecee39e30eb5b6e Aug 22 17:12:34.507236 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1793908082 Aug 22 17:12:34.507236 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-DeleteServersAdminTestJSON-1793908082-project Aug 22 17:12:34.507236 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:12:34.507236 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:12:34.507236 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 25b8f088a9d54406b1d670d7f8feecd9 Aug 22 17:12:34.507236 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-DeleteServersAdminTestJSON-1793908082-project Aug 22 17:12:34.507236 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:12:34.507236 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 could not be found. Aug 22 17:12:34.507236 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08'} Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 could not be found. Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:34.508043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 could not be found. Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 could not be found. Aug 22 17:12:34.509341 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.510717 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fbea846a-09f2-4353-ae02-63a7a69850ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Returning 404 to user: Instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:34.510717 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-fbea846a-09f2-4353-ae02-63a7a69850ea tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "DELETE /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 404 len: 111 microversion: 2.1 time: 0.045875 Aug 22 17:12:34.511403 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 157/338] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:12:34 2022] DELETE /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:12:34.528530 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7cdcf586-9bb4-43ec-902d-e53f8f7e21c8 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:34.529997 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-7cdcf586-9bb4-43ec-902d-e53f8f7e21c8 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:34.539976 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7cdcf586-9bb4-43ec-902d-e53f8f7e21c8 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:34.540540 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7cdcf586-9bb4-43ec-902d-e53f8f7e21c8 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:34.542584 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7cdcf586-9bb4-43ec-902d-e53f8f7e21c8 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:34.543316 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7cdcf586-9bb4-43ec-902d-e53f8f7e21c8 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:34.543771 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7cdcf586-9bb4-43ec-902d-e53f8f7e21c8 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:34.547705 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7cdcf586-9bb4-43ec-902d-e53f8f7e21c8 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:34.582326 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-7cdcf586-9bb4-43ec-902d-e53f8f7e21c8 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] HTTP exception thrown: Instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 could not be found. Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7cdcf586-9bb4-43ec-902d-e53f8f7e21c8 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Request method failure captured: Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 HTTP/1.1 Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7irNrrRU2r6Naw6eycAJSqnAryJKahZl1ebo5v7zfl7mihEuf4-GwljgQje3Wd5x5oSdyYfISxabKBFi5xYcp5dipCCWoLDNek0LCzib4l5jekbxlrtk8SdlH5-9Znt_2Hv4j1QibLvuQiGvGYB63HjMVq2sx9sHKfSnp83LYS1o3k Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 7d39044d6ce2411fbecee39e30eb5b6e Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1793908082 Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:12:34.591931 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:12:34.593497 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7d39044d6ce2411fbecee39e30eb5b6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7d39044d6ce2411fbecee39e30eb5b6e", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7d39044d6ce2411fbecee39e30eb5b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7d39044d6ce2411fbecee39e30eb5b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:34.593497 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-DeleteServersAdminTestJSON-1793908082 Aug 22 17:12:34.593497 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 7d39044d6ce2411fbecee39e30eb5b6e Aug 22 17:12:34.593497 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1793908082 Aug 22 17:12:34.593497 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-DeleteServersAdminTestJSON-1793908082-project Aug 22 17:12:34.593497 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:12:34.593497 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:12:34.593497 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 25b8f088a9d54406b1d670d7f8feecd9 Aug 22 17:12:34.593497 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-DeleteServersAdminTestJSON-1793908082-project Aug 22 17:12:34.593497 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:12:34.593497 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 could not be found. Aug 22 17:12:34.593497 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08'} Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 could not be found. Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:34.594181 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:34.595237 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:34.595237 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:12:34.595237 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:12:34.595237 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:12:34.595237 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:12:34.595237 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:12:34.595237 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:12:34.595237 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 could not be found. Aug 22 17:12:34.595237 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.595237 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:34.595237 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.595237 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:34.595237 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:34.595237 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:34.595237 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:34.595237 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:34.595237 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 could not be found. Aug 22 17:12:34.595237 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.602673 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7cdcf586-9bb4-43ec-902d-e53f8f7e21c8 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Returning 404 to user: Instance 2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:34.606521 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7cdcf586-9bb4-43ec-902d-e53f8f7e21c8 tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08" status: 404 len: 111 microversion: 2.1 time: 0.093751 Aug 22 17:12:34.616275 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 158/339] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:34 2022] GET /compute/v2.1/servers/2fdbf256-6a8c-496d-b6aa-0cd1e7e79b08 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:12:34.674651 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c15e909c-4619-444e-8208-c29e2f437d70 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.199108 Aug 22 17:12:34.675265 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 182/340] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:34 2022] POST /compute/v2.1/flavors => generated 507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:12:34.701373 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0b003145-847f-4101-810f-fa0b81be395d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:34.701373 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0b003145-847f-4101-810f-fa0b81be395d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:34.708364 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b003145-847f-4101-810f-fa0b81be395d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:34.708752 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b003145-847f-4101-810f-fa0b81be395d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:34.709428 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b003145-847f-4101-810f-fa0b81be395d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:34.709938 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b003145-847f-4101-810f-fa0b81be395d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:34.710592 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b003145-847f-4101-810f-fa0b81be395d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:34.710808 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b003145-847f-4101-810f-fa0b81be395d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:34.731308 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-0b003145-847f-4101-810f-fa0b81be395d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] HTTP exception thrown: Instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 could not be found. Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0b003145-847f-4101-810f-fa0b81be395d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Request method failure captured: Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 HTTP/1.1 Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7irNrrRU2r6Naw6eycAJSqnAryJKahZl1ebo5v7zfl7mihEuf4-GwljgQje3Wd5x5oSdyYfISxabKBFi5xYcp5dipCCWoLDNek0LCzib4l5jekbxlrtk8SdlH5-9Znt_2Hv4j1QibLvuQiGvGYB63HjMVq2sx9sHKfSnp83LYS1o3k Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 7d39044d6ce2411fbecee39e30eb5b6e Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1793908082 Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:12:34.734933 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:12:34.736433 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7d39044d6ce2411fbecee39e30eb5b6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7d39044d6ce2411fbecee39e30eb5b6e", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7d39044d6ce2411fbecee39e30eb5b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7d39044d6ce2411fbecee39e30eb5b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:34.736433 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-DeleteServersAdminTestJSON-1793908082 Aug 22 17:12:34.736433 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 7d39044d6ce2411fbecee39e30eb5b6e Aug 22 17:12:34.736433 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1793908082 Aug 22 17:12:34.736433 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-DeleteServersAdminTestJSON-1793908082-project Aug 22 17:12:34.736433 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:34.736433 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:34.736433 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 25b8f088a9d54406b1d670d7f8feecd9 Aug 22 17:12:34.736433 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-DeleteServersAdminTestJSON-1793908082-project Aug 22 17:12:34.736433 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:34.736433 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 could not be found. Aug 22 17:12:34.736433 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '337beedf-68a6-4cf9-b6f3-7f451f1cd496'} Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 could not be found. Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:34.737392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 could not be found. Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 could not be found. Aug 22 17:12:34.738985 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.743226 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0b003145-847f-4101-810f-fa0b81be395d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Returning 404 to user: Instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:34.744305 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0b003145-847f-4101-810f-fa0b81be395d tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "DELETE /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 404 len: 111 microversion: 2.1 time: 0.049830 Aug 22 17:12:34.745721 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 183/341] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:12:34 2022] DELETE /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:12:34.754634 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-257d3e61-4a16-4747-8c30-581ae6102bf6 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:34.756140 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:34.756140 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:34.843024 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-257d3e61-4a16-4747-8c30-581ae6102bf6 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/d1b79124-be85-480d-aed5-2af9a198f95f" status: 202 len: 0 microversion: 2.1 time: 0.095140 Aug 22 17:12:34.843944 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 184/342] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:12:34 2022] DELETE /compute/v2.1/flavors/d1b79124-be85-480d-aed5-2af9a198f95f => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:12:34.852392 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-281c1fdc-93a2-4741-b3bf-f6f8c13576fb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:34.854427 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-281c1fdc-93a2-4741-b3bf-f6f8c13576fb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] [instance: 337beedf-68a6-4cf9-b6f3-7f451f1cd496] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:34.877807 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-281c1fdc-93a2-4741-b3bf-f6f8c13576fb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:34.879169 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-281c1fdc-93a2-4741-b3bf-f6f8c13576fb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:34.881187 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-281c1fdc-93a2-4741-b3bf-f6f8c13576fb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:34.885364 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-281c1fdc-93a2-4741-b3bf-f6f8c13576fb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:34.890689 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-281c1fdc-93a2-4741-b3bf-f6f8c13576fb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:34.890689 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-281c1fdc-93a2-4741-b3bf-f6f8c13576fb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:34.916708 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-281c1fdc-93a2-4741-b3bf-f6f8c13576fb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] HTTP exception thrown: Instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 could not be found. Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-281c1fdc-93a2-4741-b3bf-f6f8c13576fb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Request method failure captured: Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 HTTP/1.1 Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7irNrrRU2r6Naw6eycAJSqnAryJKahZl1ebo5v7zfl7mihEuf4-GwljgQje3Wd5x5oSdyYfISxabKBFi5xYcp5dipCCWoLDNek0LCzib4l5jekbxlrtk8SdlH5-9Znt_2Hv4j1QibLvuQiGvGYB63HjMVq2sx9sHKfSnp83LYS1o3k Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 7d39044d6ce2411fbecee39e30eb5b6e Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1793908082 Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:12:34.921520 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:12:34.925960 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7d39044d6ce2411fbecee39e30eb5b6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7d39044d6ce2411fbecee39e30eb5b6e", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7d39044d6ce2411fbecee39e30eb5b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7d39044d6ce2411fbecee39e30eb5b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:34.925960 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-DeleteServersAdminTestJSON-1793908082 Aug 22 17:12:34.925960 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 7d39044d6ce2411fbecee39e30eb5b6e Aug 22 17:12:34.925960 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1793908082 Aug 22 17:12:34.925960 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-DeleteServersAdminTestJSON-1793908082-project Aug 22 17:12:34.925960 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:34.925960 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:34.925960 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 25b8f088a9d54406b1d670d7f8feecd9 Aug 22 17:12:34.925960 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-DeleteServersAdminTestJSON-1793908082-project Aug 22 17:12:34.925960 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:34.925960 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 could not be found. Aug 22 17:12:34.925960 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '337beedf-68a6-4cf9-b6f3-7f451f1cd496'} Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 could not be found. Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:34.927141 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:34.928641 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:34.928641 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:12:34.928641 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:12:34.928641 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:12:34.928641 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:12:34.928641 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:12:34.928641 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:12:34.928641 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 could not be found. Aug 22 17:12:34.928641 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.928641 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:34.928641 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.928641 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:34.928641 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:34.928641 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:34.928641 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:34.928641 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:34.928641 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 could not be found. Aug 22 17:12:34.928641 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:34.932656 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-281c1fdc-93a2-4741-b3bf-f6f8c13576fb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] Returning 404 to user: Instance 337beedf-68a6-4cf9-b6f3-7f451f1cd496 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:34.933906 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-281c1fdc-93a2-4741-b3bf-f6f8c13576fb tempest-DeleteServersAdminTestJSON-1793908082 tempest-DeleteServersAdminTestJSON-1793908082-project] 10.222.0.96 "GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496" status: 404 len: 111 microversion: 2.1 time: 0.088363 Aug 22 17:12:34.934563 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 185/343] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:34 2022] GET /compute/v2.1/servers/337beedf-68a6-4cf9-b6f3-7f451f1cd496 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:12:34.947679 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d81a500e-53c4-4fd3-9385-b2fe75b6c402 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:34.986028 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d81a500e-53c4-4fd3-9385-b2fe75b6c402 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050349 Aug 22 17:12:34.987000 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 186/344] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:35.016738 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ebac6dd1-ee46-4943-afb3-feaa19608d69 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1682564284", "id": 932854356, "os-flavor-access:is_public": "True"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:35.021495 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:35.021495 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:35.154203 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ebac6dd1-ee46-4943-afb3-feaa19608d69 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.145309 Aug 22 17:12:35.155085 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 187/345] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:35 2022] POST /compute/v2.1/flavors => generated 411 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:35.170858 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-70682c6e-503f-4c72-957a-cddfdf233c30 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:35.197346 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-70682c6e-503f-4c72-957a-cddfdf233c30 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/932854356" status: 200 len: 411 microversion: 2.1 time: 0.029140 Aug 22 17:12:35.198661 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 188/346] 10.222.0.96 () {58 vars in 1155 bytes} [Mon Aug 22 17:12:35 2022] GET /compute/v2.1/flavors/932854356 => generated 411 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:12:35.221936 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1b133dd8-1067-455f-b09a-4664b5abafb5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-31676626", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:35.306438 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-1b133dd8-1067-455f-b09a-4664b5abafb5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] validate_networks() for None {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:12:35.602603 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-1b133dd8-1067-455f-b09a-4664b5abafb5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:12:35.603178 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-1b133dd8-1067-455f-b09a-4664b5abafb5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:12:35.603831 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-1b133dd8-1067-455f-b09a-4664b5abafb5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:12:35.604252 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-1b133dd8-1067-455f-b09a-4664b5abafb5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:12:35.604667 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-1b133dd8-1067-455f-b09a-4664b5abafb5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:12:35.616066 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1b133dd8-1067-455f-b09a-4664b5abafb5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:35.616535 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1b133dd8-1067-455f-b09a-4664b5abafb5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:35.617211 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1b133dd8-1067-455f-b09a-4664b5abafb5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:35.618212 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1b133dd8-1067-455f-b09a-4664b5abafb5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:35.618856 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1b133dd8-1067-455f-b09a-4664b5abafb5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:35.619481 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1b133dd8-1067-455f-b09a-4664b5abafb5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:35.655088 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-1b133dd8-1067-455f-b09a-4664b5abafb5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Getting quotas for project 10f3e01147404b6a86ef50f3d441841a. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:12:35.661756 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-1b133dd8-1067-455f-b09a-4664b5abafb5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Getting quotas for user 35652618557443a4a1dbfb3e0028f0c7 and project 10f3e01147404b6a86ef50f3d441841a. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:12:35.680805 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-1b133dd8-1067-455f-b09a-4664b5abafb5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Going to run 1 instances... {{(pid=123016) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:12:35.683541 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-1b133dd8-1067-455f-b09a-4664b5abafb5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:12:35.846780 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1b133dd8-1067-455f-b09a-4664b5abafb5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.225722 Aug 22 17:12:35.847920 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 159/347] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:12:35.861701 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-93b31d3b-ced2-4686-919d-5723007fec8e tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:35.862687 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-93b31d3b-ced2-4686-919d-5723007fec8e tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:36.136580 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-59288d78-3dd0-40e8-a942-db746ecabe48 tempest-FlavorsAdminTestJSON-1488913304 tempest-FlavorsAdminTestJSON-1488913304-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:36.188592 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-93b31d3b-ced2-4686-919d-5723007fec8e tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:36.201588 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-93b31d3b-ced2-4686-919d-5723007fec8e tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1217 microversion: 2.1 time: 0.346313 Aug 22 17:12:36.209763 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-59288d78-3dd0-40e8-a942-db746ecabe48 tempest-FlavorsAdminTestJSON-1488913304 tempest-FlavorsAdminTestJSON-1488913304-project] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.998085 Aug 22 17:12:36.209763 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 189/349] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:35 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:36.209915 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 160/349] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:35 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1217 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:36.233025 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-978a4976-52ea-4618-8b92-b9eeea1c0968 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:36.235334 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:36.235334 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:36.357806 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-978a4976-52ea-4618-8b92-b9eeea1c0968 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/932854356" status: 202 len: 0 microversion: 2.1 time: 0.134008 Aug 22 17:12:36.358844 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 190/350] 10.222.0.96 () {58 vars in 1158 bytes} [Mon Aug 22 17:12:36 2022] DELETE /compute/v2.1/flavors/932854356 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:12:36.369118 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-110e1733-f61b-48f6-8e74-7ff81c6bc07c tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:36.407917 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-110e1733-f61b-48f6-8e74-7ff81c6bc07c tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044523 Aug 22 17:12:36.409043 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 161/351] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:36.430786 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2f910c9b-0efd-4495-8e89-f1d8f3e19263 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1611089844", "id": 1711450027, "os-flavor-access:is_public": "False"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:36.610183 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2f910c9b-0efd-4495-8e89-f1d8f3e19263 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.184124 Aug 22 17:12:36.618574 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 191/352] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:36 2022] POST /compute/v2.1/flavors => generated 430 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:36.624303 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-935d550a-be4c-4bfa-8f39-2c8d33fe8cce tempest-FlavorsAdminTestJSON-1488913304 tempest-FlavorsAdminTestJSON-1488913304-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "1711450027"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:36.643614 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-935d550a-be4c-4bfa-8f39-2c8d33fe8cce tempest-FlavorsAdminTestJSON-1488913304 tempest-FlavorsAdminTestJSON-1488913304-project] HTTP exception thrown: Flavor 1711450027 could not be found. Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-935d550a-be4c-4bfa-8f39-2c8d33fe8cce tempest-FlavorsAdminTestJSON-1488913304 tempest-FlavorsAdminTestJSON-1488913304-project] Request method failure captured: Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 107 Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7j7nOCIGzF6My0ggVnC8SFshjxnUUFbyMzETxA_O9HBp4tNQGOeb882IOSf-ubKctBXekiQfrHczA4tOvNT1Ztx95LM565G0A_D_7Fpo4imaCnNMjeUZtSQKn8Ri4kVhEOuvA28h5Jwh5wZ9ggu4B1QLqL6OhFRZzRIEwwRbKHnFSY Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: f050d581b25d477ebf961ded4463e8a3 Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-FlavorsAdminTestJSON-1488913304 Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:12:36.653972 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:12:36.655197 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/f050d581b25d477ebf961ded4463e8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_f050d581b25d477ebf961ded4463e8a3", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/f050d581b25d477ebf961ded4463e8a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/f050d581b25d477ebf961ded4463e8a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:36.655197 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-FlavorsAdminTestJSON-1488913304 Aug 22 17:12:36.655197 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: f050d581b25d477ebf961ded4463e8a3 Aug 22 17:12:36.655197 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1488913304 Aug 22 17:12:36.655197 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-FlavorsAdminTestJSON-1488913304-project Aug 22 17:12:36.655197 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:12:36.655197 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:12:36.655197 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 48a0a4276e4942e3bf1e21c23620481c Aug 22 17:12:36.655197 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-FlavorsAdminTestJSON-1488913304-project Aug 22 17:12:36.655197 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:12:36.655197 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "test", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "1711450027"}} Aug 22 17:12:36.655197 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:12:36.655197 n-d-854030-1 devstack@n-api.service[123016]: exception: Flavor 1711450027 could not be found. Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '1711450027'}}} Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1711450027 could not be found. Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:36.655907 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1711450027 could not be found. Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:36.657224 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:36.658402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:36.658402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:36.658402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:36.658402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1711450027 could not be found. Aug 22 17:12:36.658402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:36.660777 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-935d550a-be4c-4bfa-8f39-2c8d33fe8cce tempest-FlavorsAdminTestJSON-1488913304 tempest-FlavorsAdminTestJSON-1488913304-project] Returning 400 to user: Flavor 1711450027 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:36.662545 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-935d550a-be4c-4bfa-8f39-2c8d33fe8cce tempest-FlavorsAdminTestJSON-1488913304 tempest-FlavorsAdminTestJSON-1488913304-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.042382 Aug 22 17:12:36.665164 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 162/353] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:36 2022] POST /compute/v2.1/servers => generated 81 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 22 17:12:36.673707 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8ea12b79-e9f8-4cca-9e83-0065966338cb tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:36.792108 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8ea12b79-e9f8-4cca-9e83-0065966338cb tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/1711450027" status: 202 len: 0 microversion: 2.1 time: 0.122345 Aug 22 17:12:36.793432 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 192/354] 10.222.0.96 () {58 vars in 1161 bytes} [Mon Aug 22 17:12:36 2022] DELETE /compute/v2.1/flavors/1711450027 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:12:36.803131 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-24092606-87a9-4128-8086-f46504c95e4d tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:36.829703 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-24092606-87a9-4128-8086-f46504c95e4d tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031234 Aug 22 17:12:36.830795 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 193/355] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:36.856558 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-54c36f44-db88-4919-87fa-2ad881b258f6 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1773474210", "id": 1841494838, "os-flavor-access:is_public": "False"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:36.988495 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-54c36f44-db88-4919-87fa-2ad881b258f6 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.136809 Aug 22 17:12:36.989216 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 194/356] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:36 2022] POST /compute/v2.1/flavors => generated 415 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:12:37.003133 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-465df1f1-76c6-4fc8-937c-6f95670a0563 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-749487830", "id": 541950898, "os-flavor-access:is_public": "True"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:37.123561 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-465df1f1-76c6-4fc8-937c-6f95670a0563 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.126005 Aug 22 17:12:37.124576 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 195/357] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:36 2022] POST /compute/v2.1/flavors => generated 410 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:37.136299 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2f39bb50-117c-4424-aa87-7e29b5ee0ba8 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:37.179895 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2f39bb50-117c-4424-aa87-7e29b5ee0ba8 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.043482 Aug 22 17:12:37.181925 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 196/358] 10.222.0.96 () {58 vars in 1169 bytes} [Mon Aug 22 17:12:37 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:12:37.199198 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e68720db-f6c7-4a21-b2ca-d9aec9b8e116 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:37.213934 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e68720db-f6c7-4a21-b2ca-d9aec9b8e116 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.018767 Aug 22 17:12:37.221788 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 197/359] 10.222.0.96 () {58 vars in 1177 bytes} [Mon Aug 22 17:12:37 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:37.233070 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8e58ece9-087a-49eb-9ade-3f683b68d44c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:37.233070 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8e58ece9-087a-49eb-9ade-3f683b68d44c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:37.240649 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=8,nova_api:DELETE=15 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:37.301303 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0f7924b5-bb09-44e6-bac0-aa9e54416525 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-554126133", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "4961ed3b-1757-4867-b3c5-234aece94f27"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:37.314222 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8e58ece9-087a-49eb-9ade-3f683b68d44c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:37.324244 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8e58ece9-087a-49eb-9ade-3f683b68d44c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1217 microversion: 2.1 time: 0.101331 Aug 22 17:12:37.354734 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 198/360] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:37 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:37.365769 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b8df8b79-1873-442f-bead-0056c30e5494 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:37.403755 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b8df8b79-1873-442f-bead-0056c30e5494 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.047654 Aug 22 17:12:37.407243 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 199/361] 10.222.0.96 () {58 vars in 1171 bytes} [Mon Aug 22 17:12:37 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:37.407963 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-0f7924b5-bb09-44e6-bac0-aa9e54416525 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] validate_networks() for [('4961ed3b-1757-4867-b3c5-234aece94f27', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:12:37.433523 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7e9cadc3-f15d-4fb6-9051-cc790749b47f tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:37.470843 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7e9cadc3-f15d-4fb6-9051-cc790749b47f tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.044846 Aug 22 17:12:37.491914 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 200/362] 10.222.0.96 () {58 vars in 1169 bytes} [Mon Aug 22 17:12:37 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:37.506463 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b8ed04ab-2462-4097-a85d-c7d6a8395490 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:37.548366 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b8ed04ab-2462-4097-a85d-c7d6a8395490 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.048747 Aug 22 17:12:37.549567 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 201/363] 10.222.0.96 () {58 vars in 1169 bytes} [Mon Aug 22 17:12:37 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:37.584165 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-16aec066-181f-4246-840a-ad564de04b2f tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:37.620910 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-16aec066-181f-4246-840a-ad564de04b2f tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.057086 Aug 22 17:12:37.623143 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 202/364] 10.222.0.96 () {58 vars in 1175 bytes} [Mon Aug 22 17:12:37 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:37.641105 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2c3c0fae-185a-4f60-87f2-f869fc79cebf tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:37.684517 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2c3c0fae-185a-4f60-87f2-f869fc79cebf tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.047346 Aug 22 17:12:37.687241 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 203/365] 10.222.0.96 () {58 vars in 1173 bytes} [Mon Aug 22 17:12:37 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:37.704566 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e9ae2643-0887-4dbc-91c5-6bf4c31193e1 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:37.735346 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e9ae2643-0887-4dbc-91c5-6bf4c31193e1 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.035422 Aug 22 17:12:37.736042 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 204/366] 10.222.0.96 () {58 vars in 1169 bytes} [Mon Aug 22 17:12:37 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:37.755421 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2c7f38c8-7d4d-4cec-a2ed-a16d4d335cc7 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:37.756725 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:37.756725 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:37.883137 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2c7f38c8-7d4d-4cec-a2ed-a16d4d335cc7 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/541950898" status: 202 len: 0 microversion: 2.1 time: 0.131961 Aug 22 17:12:37.891129 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 205/367] 10.222.0.96 () {58 vars in 1158 bytes} [Mon Aug 22 17:12:37 2022] DELETE /compute/v2.1/flavors/541950898 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:12:37.908999 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7926d6eb-b63e-4dc8-8ad6-e00e1de860dc tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:37.939973 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7926d6eb-b63e-4dc8-8ad6-e00e1de860dc tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045968 Aug 22 17:12:37.941160 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 206/368] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:37.959716 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1caabaed-ee32-4804-805e-074a26e7a6e5 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:38.042948 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1caabaed-ee32-4804-805e-074a26e7a6e5 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/1841494838" status: 202 len: 0 microversion: 2.1 time: 0.088203 Aug 22 17:12:38.043688 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 207/369] 10.222.0.96 () {58 vars in 1161 bytes} [Mon Aug 22 17:12:37 2022] DELETE /compute/v2.1/flavors/1841494838 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:12:38.052486 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cba610f6-c2da-4dc5-9d16-b9da20427ed0 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:38.088723 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-cba610f6-c2da-4dc5-9d16-b9da20427ed0 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040657 Aug 22 17:12:38.093120 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 208/370] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:38.138759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-0f7924b5-bb09-44e6-bac0-aa9e54416525 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-74ca36c7-c49c-471c-9508-315d51fee80f) Aug 22 17:12:38.138759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:38.138759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:38.138759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:38.138759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:38.138759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:38.138759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:38.138759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:38.138759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:38.138759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:38.138759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:12:38.138759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:12:38.138759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:12:38.138759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:12:38.138759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:12:38.138759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:12:38.139993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:12:38.139993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:12:38.139993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:12:38.139993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:12:38.139993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:12:38.139993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:12:38.139993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:12:38.139993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:12:38.139993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:12:38.139993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:12:38.139993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:12:38.139993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:38.139993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:38.139993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:12:38.139993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:12:38.139993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:38.139993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:38.139993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:12:38.141157 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:12:38.141157 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:38.141157 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:38.141157 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:12:38.141157 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:12:38.141157 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:38.141157 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:38.141157 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:12:38.141157 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:12:38.141157 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:12:38.141157 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:12:38.141157 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:12:38.141157 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:12:38.141157 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:12:38.141157 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:12:38.141157 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:12:38.141157 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:12:38.141157 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:12:38.142291 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:12:38.142291 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:12:38.142291 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:12:38.142291 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:12:38.142291 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:12:38.142291 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:12:38.142291 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:12:38.142291 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:12:38.142291 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:12:38.142291 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:12:38.142291 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:12:38.142291 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:12:38.142291 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:12:38.142291 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:12:38.142291 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:12:38.143267 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-74ca36c7-c49c-471c-9508-315d51fee80f) Aug 22 17:12:38.143267 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:38.143267 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-0f7924b5-bb09-44e6-bac0-aa9e54416525 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:38.143267 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0f7924b5-bb09-44e6-bac0-aa9e54416525 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Request method failure captured: Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 215 Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7j32YTw0hL_DuXnelgZHHX7C1Gmcw3vNcMfLG9RPRrF5VrBlcszKIkOXSraO-H71og8rmMDf7E7s2KJSPfbGwF0eGTzPlA7_SG_d_wJ73JQ3tD3bRiNgJUrN6P0arD1nYmVZXVS9qY9aHRTG3-l3Dr6eQBqvqcebviIUQkfdWgx-Ug Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: X-Openstack-Nova-Api-Version: 2.25 Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 4fbd6f26451e49e581f5dcb7689a1a3d Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1622325097 Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:12:38.143817 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:12:38.145533 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4fbd6f26451e49e581f5dcb7689a1a3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_4fbd6f26451e49e581f5dcb7689a1a3d", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4fbd6f26451e49e581f5dcb7689a1a3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/4fbd6f26451e49e581f5dcb7689a1a3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:38.145533 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1622325097 Aug 22 17:12:38.145533 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 4fbd6f26451e49e581f5dcb7689a1a3d Aug 22 17:12:38.145533 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1622325097 Aug 22 17:12:38.145533 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-LiveAutoBlockMigrationV225Test-1622325097-project Aug 22 17:12:38.145533 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:12:38.145533 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:12:38.145533 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: c5ad39ac5ea841d68b94dca20d12d00c Aug 22 17:12:38.145533 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1622325097-project Aug 22 17:12:38.145533 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:12:38.145533 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-554126133", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "4961ed3b-1757-4867-b3c5-234aece94f27"}]}} Aug 22 17:12:38.146293 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:12:38.146293 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:38.146293 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:12:38.146293 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-554126133', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '4961ed3b-1757-4867-b3c5-234aece94f27'}]}}} Aug 22 17:12:38.146293 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:38.146293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:38.146293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:38.146293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:38.146293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:38.146293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:38.146293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:38.146293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:38.146293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:38.146293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:38.146293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:12:38.146293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:12:38.146293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:12:38.146293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:12:38.146293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:12:38.147525 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:12:38.147525 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:12:38.147525 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:12:38.147525 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:12:38.147525 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:12:38.147525 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:12:38.147525 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:12:38.147525 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:12:38.147525 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:12:38.147525 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:12:38.147525 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:12:38.147525 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:12:38.147525 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:38.147525 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:38.147525 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:12:38.147525 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:12:38.147525 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:38.147525 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:38.150273 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:12:38.150273 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:12:38.150273 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:38.150273 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:38.150273 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:12:38.150273 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:12:38.150273 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:38.150273 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:38.150273 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:12:38.150273 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:12:38.150273 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:12:38.150273 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:12:38.150273 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:12:38.150273 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:12:38.150273 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:12:38.150273 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:12:38.150273 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:12:38.150273 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:12:38.151942 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:12:38.151942 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:12:38.151942 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:12:38.151942 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:12:38.151942 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:12:38.151942 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:12:38.151942 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:12:38.151942 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:12:38.151942 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:12:38.151942 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:12:38.151942 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:12:38.151942 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:12:38.151942 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:12:38.151942 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:12:38.151942 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:12:38.151942 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:12:38.155163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-74ca36c7-c49c-471c-9508-315d51fee80f) Aug 22 17:12:38.155163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:38.155163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:38.155163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:38.155163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:38.155163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:38.155163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:38.155163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:38.155163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:38.155163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:12:38.155163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:12:38.155163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:38.155163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:38.155163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:38.155163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:38.155163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:38.155163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:38.155163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:38.155163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:38.156316 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:38.156316 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:38.156316 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:38.156316 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:38.156316 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:38.156316 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0f7924b5-bb09-44e6-bac0-aa9e54416525 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:38.156316 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:38.156316 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0f7924b5-bb09-44e6-bac0-aa9e54416525 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 1.386928 Aug 22 17:12:38.159222 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 163/371] 10.222.0.96 () {62 vars in 1188 bytes} [Mon Aug 22 17:12:36 2022] POST /compute/v2.1/servers => generated 214 bytes in 1391 msecs (HTTP/1.1 500) 9 headers in 393 bytes (2 switches on core 0) Aug 22 17:12:38.181277 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f0e8ae1b-a0f8-4e07-867a-6968268ea526 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1897433275", "id": 1014477171, "os-flavor-access:is_public": "False"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:38.195146 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:38.195146 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:38.338968 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f0e8ae1b-a0f8-4e07-867a-6968268ea526 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.178458 Aug 22 17:12:38.339685 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 164/372] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:38 2022] POST /compute/v2.1/flavors => generated 415 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:38.352776 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-bb6ecfae-5560-45bd-a2f0-033cf1f2eaa8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:38.354172 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-bb6ecfae-5560-45bd-a2f0-033cf1f2eaa8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:38.390322 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb6ecfae-5560-45bd-a2f0-033cf1f2eaa8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:38.392791 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb6ecfae-5560-45bd-a2f0-033cf1f2eaa8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:38.393317 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb6ecfae-5560-45bd-a2f0-033cf1f2eaa8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:38.397548 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb6ecfae-5560-45bd-a2f0-033cf1f2eaa8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:38.398048 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb6ecfae-5560-45bd-a2f0-033cf1f2eaa8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:38.404589 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb6ecfae-5560-45bd-a2f0-033cf1f2eaa8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:38.555966 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-bb6ecfae-5560-45bd-a2f0-033cf1f2eaa8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:38.571584 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-bb6ecfae-5560-45bd-a2f0-033cf1f2eaa8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1213 microversion: 2.1 time: 0.223245 Aug 22 17:12:38.572892 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 165/373] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:38 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1213 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:38.584392 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-da01ba32-da25-47c1-96e5-0c304967a688 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:38.633899 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-da01ba32-da25-47c1-96e5-0c304967a688 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059388 Aug 22 17:12:38.635035 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 166/374] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:38.652782 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-025fcf18-16a7-4f84-9253-f28833ae5eee tempest-FlavorsAdminTestJSON-1488913304 tempest-FlavorsAdminTestJSON-1488913304-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:38.683952 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-025fcf18-16a7-4f84-9253-f28833ae5eee tempest-FlavorsAdminTestJSON-1488913304 tempest-FlavorsAdminTestJSON-1488913304-project] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033771 Aug 22 17:12:38.700937 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 167/375] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:38.707521 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c57338bb-1d78-49a6-9bb7-53f337798057 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:38.709655 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:38.709655 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:38.790758 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-51290f39-83ed-4ac7-b7b7-df84e1467c68 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:38.793497 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:38.793497 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:38.794997 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-51290f39-83ed-4ac7-b7b7-df84e1467c68 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:38.795483 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-51290f39-83ed-4ac7-b7b7-df84e1467c68 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:38.795915 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-51290f39-83ed-4ac7-b7b7-df84e1467c68 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:38.796644 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-51290f39-83ed-4ac7-b7b7-df84e1467c68 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:38.803724 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-51290f39-83ed-4ac7-b7b7-df84e1467c68 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:38.805359 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-51290f39-83ed-4ac7-b7b7-df84e1467c68 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:38.883864 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-51290f39-83ed-4ac7-b7b7-df84e1467c68 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.770280 Aug 22 17:12:38.884541 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 209/376] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:12:38 2022] GET /compute/v2.1/os-services => generated 944 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:38.900622 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0bf398c0-13a0-49a1-9bc8-409b17312d87 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:38.914297 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:38.914297 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:38.915607 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0bf398c0-13a0-49a1-9bc8-409b17312d87 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:38.916095 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0bf398c0-13a0-49a1-9bc8-409b17312d87 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:38.916529 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0bf398c0-13a0-49a1-9bc8-409b17312d87 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:38.917286 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0bf398c0-13a0-49a1-9bc8-409b17312d87 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:38.917734 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0bf398c0-13a0-49a1-9bc8-409b17312d87 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:38.918380 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0bf398c0-13a0-49a1-9bc8-409b17312d87 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:38.928232 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c57338bb-1d78-49a6-9bb7-53f337798057 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/1014477171" status: 202 len: 0 microversion: 2.1 time: 0.225189 Aug 22 17:12:38.928670 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 168/377] 10.222.0.96 () {58 vars in 1161 bytes} [Mon Aug 22 17:12:38 2022] DELETE /compute/v2.1/flavors/1014477171 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:12:38.946312 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f9897be8-a7d3-4690-a6cc-a1a1a4cba12c tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:39.011138 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0bf398c0-13a0-49a1-9bc8-409b17312d87 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] 10.222.0.96 "GET /compute/v2.1/os-services?host=n-d-854030-1" status: 200 len: 578 microversion: 2.1 time: 0.117089 Aug 22 17:12:39.012840 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f9897be8-a7d3-4690-a6cc-a1a1a4cba12c tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069483 Aug 22 17:12:39.022125 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 210/378] 10.222.0.96 () {58 vars in 1172 bytes} [Mon Aug 22 17:12:38 2022] GET /compute/v2.1/os-services?host=n-d-854030-1 => generated 578 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:39.022270 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 169/379] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:39.040781 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2a1ba314-71fb-4b17-b683-270c6d9f09ea tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:39.043880 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:39.043880 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:39.051160 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2a1ba314-71fb-4b17-b683-270c6d9f09ea tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:39.051160 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2a1ba314-71fb-4b17-b683-270c6d9f09ea tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:39.051160 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2a1ba314-71fb-4b17-b683-270c6d9f09ea tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:39.051160 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2a1ba314-71fb-4b17-b683-270c6d9f09ea tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:39.051706 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2a1ba314-71fb-4b17-b683-270c6d9f09ea tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:39.051706 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2a1ba314-71fb-4b17-b683-270c6d9f09ea tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:39.051989 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4423ed33-a9d5-4b64-a778-2c1de9203887 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1051541776", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "4961ed3b-1757-4867-b3c5-234aece94f27"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:39.084459 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2a1ba314-71fb-4b17-b683-270c6d9f09ea tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] 10.222.0.96 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.055258 Aug 22 17:12:39.085834 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 170/380] 10.222.0.96 () {58 vars in 1176 bytes} [Mon Aug 22 17:12:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:39.091449 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-960ffd5d-42f0-4b55-a355-8d3c5094e4c8 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-247785949", "id": 1899441162, "os-flavor-access:is_public": "True"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:39.100204 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:39.100204 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:39.203346 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-4423ed33-a9d5-4b64-a778-2c1de9203887 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] validate_networks() for [('4961ed3b-1757-4867-b3c5-234aece94f27', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:12:39.265841 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-960ffd5d-42f0-4b55-a355-8d3c5094e4c8 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.178679 Aug 22 17:12:39.266865 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 171/381] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:39 2022] POST /compute/v2.1/flavors => generated 413 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:39.280765 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0dee855f-a520-4995-a5a1-fe7739fa5bb5 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:39.288737 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:39.288737 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:39.292723 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0dee855f-a520-4995-a5a1-fe7739fa5bb5 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:39.304865 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0dee855f-a520-4995-a5a1-fe7739fa5bb5 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:39.304865 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0dee855f-a520-4995-a5a1-fe7739fa5bb5 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:39.304865 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0dee855f-a520-4995-a5a1-fe7739fa5bb5 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:39.304865 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0dee855f-a520-4995-a5a1-fe7739fa5bb5 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:39.305257 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0dee855f-a520-4995-a5a1-fe7739fa5bb5 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:39.323547 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:39.400135 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0dee855f-a520-4995-a5a1-fe7739fa5bb5 tempest-ServicesAdminTestJSON-1521761160 tempest-ServicesAdminTestJSON-1521761160-project-admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.131153 Aug 22 17:12:39.401741 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 172/382] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:12:39 2022] GET /compute/v2.1/os-services => generated 944 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:39.419299 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d23cc378-fbe4-4d43-838c-04762296728a tempest-FlavorsAdminTestJSON-1488913304 tempest-FlavorsAdminTestJSON-1488913304-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:39.447519 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d23cc378-fbe4-4d43-838c-04762296728a tempest-FlavorsAdminTestJSON-1488913304 tempest-FlavorsAdminTestJSON-1488913304-project] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.032250 Aug 22 17:12:39.448883 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 173/383] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:39 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:39.471245 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fa4dcdc0-91b5-41da-8746-9dc5e78a5a59 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:39.472100 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:39.472100 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:39.480901 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=10,nova_api:INSERT=6 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:39.636407 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-fa4dcdc0-91b5-41da-8746-9dc5e78a5a59 tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/1899441162" status: 202 len: 0 microversion: 2.1 time: 0.173181 Aug 22 17:12:39.637260 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 174/384] 10.222.0.96 () {58 vars in 1161 bytes} [Mon Aug 22 17:12:39 2022] DELETE /compute/v2.1/flavors/1899441162 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:12:39.644701 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9b77e93f-a34f-437a-b1dc-d3f2e18d7cf4 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:39.648344 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-9b77e93f-a34f-437a-b1dc-d3f2e18d7cf4 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:39.671253 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b77e93f-a34f-437a-b1dc-d3f2e18d7cf4 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:39.672937 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b77e93f-a34f-437a-b1dc-d3f2e18d7cf4 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:39.674035 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b77e93f-a34f-437a-b1dc-d3f2e18d7cf4 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:39.675104 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b77e93f-a34f-437a-b1dc-d3f2e18d7cf4 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:39.675994 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b77e93f-a34f-437a-b1dc-d3f2e18d7cf4 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:39.676828 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b77e93f-a34f-437a-b1dc-d3f2e18d7cf4 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:40.090761 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9b77e93f-a34f-437a-b1dc-d3f2e18d7cf4 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:40.098962 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9b77e93f-a34f-437a-b1dc-d3f2e18d7cf4 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1287 microversion: 2.1 time: 0.460095 Aug 22 17:12:40.099554 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 175/385] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:39 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1287 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:40.117401 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6e20ab02-4fed-4e72-95ba-6f4ea9afc76b tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:40.150606 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-4423ed33-a9d5-4b64-a778-2c1de9203887 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cff96ddc-e108-4c8c-8a7c-11a53d758110) Aug 22 17:12:40.150606 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:40.150606 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:40.150606 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:40.150606 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:40.150606 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:40.150606 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:40.150606 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:40.150606 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:40.150606 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:40.150606 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:12:40.150606 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:12:40.150606 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:12:40.150606 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:12:40.150606 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:12:40.150606 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:12:40.151987 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:12:40.151987 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:12:40.151987 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:12:40.151987 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:12:40.151987 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:12:40.151987 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:12:40.151987 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:12:40.151987 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:12:40.151987 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:12:40.151987 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:12:40.151987 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:12:40.151987 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:40.151987 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:40.151987 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:12:40.151987 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:12:40.151987 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:40.151987 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:40.151987 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:12:40.154610 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:12:40.154610 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:40.154610 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:40.154610 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:12:40.154610 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:12:40.154610 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:40.154610 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:40.154610 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:12:40.154610 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:12:40.154610 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:12:40.154610 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:12:40.154610 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:12:40.154610 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:12:40.154610 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:12:40.154610 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:12:40.154610 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:12:40.154610 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:12:40.154610 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:12:40.155583 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:12:40.155583 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:12:40.155583 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:12:40.155583 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:12:40.155583 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:12:40.155583 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:12:40.155583 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:12:40.155583 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:12:40.155583 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:12:40.155583 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:12:40.155583 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:12:40.155583 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:12:40.155583 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:12:40.155583 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:12:40.155583 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:12:40.156416 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cff96ddc-e108-4c8c-8a7c-11a53d758110) Aug 22 17:12:40.156416 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:40.158432 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-6e20ab02-4fed-4e72-95ba-6f4ea9afc76b tempest-FlavorsAdminTestJSON-851850268 tempest-FlavorsAdminTestJSON-851850268-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044738 Aug 22 17:12:40.158914 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-4423ed33-a9d5-4b64-a778-2c1de9203887 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:40.158914 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4423ed33-a9d5-4b64-a778-2c1de9203887 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Request method failure captured: Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 216 Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7j32YTw0hL_DuXnelgZHHX7C1Gmcw3vNcMfLG9RPRrF5VrBlcszKIkOXSraO-H71og8rmMDf7E7s2KJSPfbGwF0eGTzPlA7_SG_d_wJ73JQ3tD3bRiNgJUrN6P0arD1nYmVZXVS9qY9aHRTG3-l3Dr6eQBqvqcebviIUQkfdWgx-Ug Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: X-Openstack-Nova-Api-Version: 2.25 Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 4fbd6f26451e49e581f5dcb7689a1a3d Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1622325097 Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:12:40.162922 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:12:40.164176 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4fbd6f26451e49e581f5dcb7689a1a3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_4fbd6f26451e49e581f5dcb7689a1a3d", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4fbd6f26451e49e581f5dcb7689a1a3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/4fbd6f26451e49e581f5dcb7689a1a3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:40.164176 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1622325097 Aug 22 17:12:40.164176 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 4fbd6f26451e49e581f5dcb7689a1a3d Aug 22 17:12:40.164176 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1622325097 Aug 22 17:12:40.164176 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-LiveAutoBlockMigrationV225Test-1622325097-project Aug 22 17:12:40.164176 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:40.164176 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:40.164176 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: c5ad39ac5ea841d68b94dca20d12d00c Aug 22 17:12:40.164176 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1622325097-project Aug 22 17:12:40.164176 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:12:40.164176 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1051541776", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "4961ed3b-1757-4867-b3c5-234aece94f27"}]}} Aug 22 17:12:40.164831 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:40.164831 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:40.164831 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:12:40.164831 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-1051541776', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '4961ed3b-1757-4867-b3c5-234aece94f27'}]}}} Aug 22 17:12:40.164831 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:40.164831 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:40.164831 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:40.164831 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:40.164831 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:40.164831 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:40.164831 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:40.164831 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:40.164831 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:40.164831 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:40.164831 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:12:40.164831 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:12:40.164831 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:12:40.164831 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:12:40.164831 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:12:40.165880 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:12:40.165880 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:12:40.165880 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:12:40.165880 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:12:40.165880 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:12:40.165880 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:12:40.165880 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:12:40.165880 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:12:40.165880 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:12:40.165880 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:12:40.165880 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:12:40.165880 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:12:40.165880 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:40.165880 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:40.165880 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:12:40.165880 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:12:40.165880 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:40.165880 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:40.166887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:12:40.166887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:12:40.166887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:40.166887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:40.166887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:12:40.166887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:12:40.166887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:40.166887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:40.166887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:12:40.166887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:12:40.166887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:12:40.166887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:12:40.166887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:12:40.166887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:12:40.166887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:12:40.166887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:12:40.166887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:12:40.166887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:12:40.167902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:12:40.167902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:12:40.167902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:12:40.167902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:12:40.167902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:12:40.167902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:12:40.167902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:12:40.167902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:12:40.167902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:12:40.167902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:12:40.167902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:12:40.167902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:12:40.167902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:12:40.167902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:12:40.167902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:12:40.167902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:12:40.168799 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cff96ddc-e108-4c8c-8a7c-11a53d758110) Aug 22 17:12:40.168799 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:40.168799 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:40.168799 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:40.168799 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:40.168799 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:40.168799 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:40.168799 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:40.168799 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:40.168799 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:12:40.168799 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:12:40.168799 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:40.168799 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:40.168799 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:40.168799 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:40.168799 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:40.168799 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:40.168799 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:40.168799 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:40.172215 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:40.172215 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:40.172215 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:40.172215 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:40.172215 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:40.174576 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4423ed33-a9d5-4b64-a778-2c1de9203887 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:40.174576 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:40.176046 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-4423ed33-a9d5-4b64-a778-2c1de9203887 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 1.157824 Aug 22 17:12:40.178819 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 176/386] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:40.184746 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 211/387] 10.222.0.96 () {62 vars in 1188 bytes} [Mon Aug 22 17:12:39 2022] POST /compute/v2.1/servers => generated 214 bytes in 1166 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Aug 22 17:12:40.199355 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-bfdc6829-8447-4bf4-a8eb-d8f7971e8634 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Action: 'create', calling method: .version_select at 0x7f8009e4e820>, body: {"keypair": {"name": "tempest-keypair-87051449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8aUDbqio9fPzp+HX5QmYO33AkkW858op52RLiBlqVKMXKpOXWrXwG0yujxwXvDK7osb5BC4gHmd17noGtfBDmXntCSNvuxb9gZmAB76tN0EuueaU9NMmnuqNMXXfm6hw=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:40.236174 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-bfdc6829-8447-4bf4-a8eb-d8f7971e8634 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Getting quotas for project 4fbd6f26451e49e581f5dcb7689a1a3d. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:12:40.241540 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-bfdc6829-8447-4bf4-a8eb-d8f7971e8634 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Getting quotas for user c5ad39ac5ea841d68b94dca20d12d00c and project 4fbd6f26451e49e581f5dcb7689a1a3d. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:12:40.420357 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-bfdc6829-8447-4bf4-a8eb-d8f7971e8634 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.25 time: 0.226654 Aug 22 17:12:40.421272 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 177/388] 10.222.0.96 () {62 vars in 1200 bytes} [Mon Aug 22 17:12:40 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 228 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 22 17:12:40.920141 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-05d0c133-1926-4e87-86ad-0dd96561fb54 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-647216645", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": "none"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:41.080703 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-05d0c133-1926-4e87-86ad-0dd96561fb54 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:12:41.081316 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-05d0c133-1926-4e87-86ad-0dd96561fb54 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:12:41.081960 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-05d0c133-1926-4e87-86ad-0dd96561fb54 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:12:41.084913 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-05d0c133-1926-4e87-86ad-0dd96561fb54 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:12:41.084913 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-05d0c133-1926-4e87-86ad-0dd96561fb54 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:12:41.110451 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-05d0c133-1926-4e87-86ad-0dd96561fb54 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:41.111095 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-05d0c133-1926-4e87-86ad-0dd96561fb54 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:41.111651 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-05d0c133-1926-4e87-86ad-0dd96561fb54 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:41.112546 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-05d0c133-1926-4e87-86ad-0dd96561fb54 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:41.115265 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-05d0c133-1926-4e87-86ad-0dd96561fb54 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:41.115265 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-05d0c133-1926-4e87-86ad-0dd96561fb54 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:41.121822 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-cda27e4e-094d-4e76-b646-10edb6bbdde2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:41.122640 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-cda27e4e-094d-4e76-b646-10edb6bbdde2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:41.137732 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cda27e4e-094d-4e76-b646-10edb6bbdde2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:41.140302 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cda27e4e-094d-4e76-b646-10edb6bbdde2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:41.140862 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cda27e4e-094d-4e76-b646-10edb6bbdde2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:41.141866 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cda27e4e-094d-4e76-b646-10edb6bbdde2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:41.144704 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cda27e4e-094d-4e76-b646-10edb6bbdde2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:41.144704 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cda27e4e-094d-4e76-b646-10edb6bbdde2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:41.168389 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-05d0c133-1926-4e87-86ad-0dd96561fb54 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Getting quotas for project 801c0f4556624bd3aade30d393ea55a7. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:12:41.174020 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-05d0c133-1926-4e87-86ad-0dd96561fb54 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Getting quotas for user 6b0c24dd25ba4c02b473ca1054dc09ed and project 801c0f4556624bd3aade30d393ea55a7. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:12:41.190897 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-05d0c133-1926-4e87-86ad-0dd96561fb54 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Going to run 1 instances... {{(pid=123015) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:12:41.193658 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-05d0c133-1926-4e87-86ad-0dd96561fb54 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:12:41.330295 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-cda27e4e-094d-4e76-b646-10edb6bbdde2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:41.337619 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-cda27e4e-094d-4e76-b646-10edb6bbdde2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1275 microversion: 2.1 time: 0.220568 Aug 22 17:12:41.338768 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 178/389] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:41 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1275 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:41.458600 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-05d0c133-1926-4e87-86ad-0dd96561fb54 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 1.052415 Aug 22 17:12:41.471529 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-679ea6f8-9ec9-4f65-ba2c-7f6ad757c600 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:41.476143 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-679ea6f8-9ec9-4f65-ba2c-7f6ad757c600 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:41.479467 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 212/390] 10.222.0.96 () {62 vars in 1188 bytes} [Mon Aug 22 17:12:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 22 17:12:41.659288 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-679ea6f8-9ec9-4f65-ba2c-7f6ad757c600 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:41.681780 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-679ea6f8-9ec9-4f65-ba2c-7f6ad757c600 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:41.688108 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-679ea6f8-9ec9-4f65-ba2c-7f6ad757c600 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:41.710756 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-679ea6f8-9ec9-4f65-ba2c-7f6ad757c600 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "PUT /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1358 microversion: 2.75 time: 0.243574 Aug 22 17:12:41.717379 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 179/391] 10.222.0.96 () {62 vars in 1297 bytes} [Mon Aug 22 17:12:41 2022] PUT /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:12:41.748354 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a3319363-5d4e-400f-8257-32b0298e4120 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:41.749105 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a3319363-5d4e-400f-8257-32b0298e4120 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:41.813957 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a3319363-5d4e-400f-8257-32b0298e4120 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:41.826018 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a3319363-5d4e-400f-8257-32b0298e4120 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:41.828160 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a3319363-5d4e-400f-8257-32b0298e4120 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:41.838567 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a3319363-5d4e-400f-8257-32b0298e4120 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1358 microversion: 2.75 time: 0.095311 Aug 22 17:12:41.855293 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 213/392] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:12:41 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1358 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:12:42.361416 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fea0a3bf-ae6c-42fb-8d45-95e098a8a745 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:42.362633 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-fea0a3bf-ae6c-42fb-8d45-95e098a8a745 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:42.373908 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fea0a3bf-ae6c-42fb-8d45-95e098a8a745 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:42.375484 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fea0a3bf-ae6c-42fb-8d45-95e098a8a745 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:42.376881 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fea0a3bf-ae6c-42fb-8d45-95e098a8a745 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:42.380686 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fea0a3bf-ae6c-42fb-8d45-95e098a8a745 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:42.381845 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fea0a3bf-ae6c-42fb-8d45-95e098a8a745 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:42.382878 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fea0a3bf-ae6c-42fb-8d45-95e098a8a745 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:42.922484 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-fea0a3bf-ae6c-42fb-8d45-95e098a8a745 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:42.930971 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-fea0a3bf-ae6c-42fb-8d45-95e098a8a745 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1317 microversion: 2.1 time: 0.575276 Aug 22 17:12:42.931559 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 180/393] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:42 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:42.936192 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0017e014-f255-4eb0-816e-168c1f76a349 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:42.937043 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-0017e014-f255-4eb0-816e-168c1f76a349 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:43.107527 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-0017e014-f255-4eb0-816e-168c1f76a349 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:43.123611 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-0017e014-f255-4eb0-816e-168c1f76a349 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:43.123861 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-0017e014-f255-4eb0-816e-168c1f76a349 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:43.131429 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0017e014-f255-4eb0-816e-168c1f76a349 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1358 microversion: 2.75 time: 0.198840 Aug 22 17:12:43.134401 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 181/394] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:12:42 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:12:43.331791 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-65cd2b46-710d-4972-ac13-5dd3339afd87 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-2028364409", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:43.421607 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-65cd2b46-710d-4972-ac13-5dd3339afd87 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] validate_networks() for None {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:12:43.689845 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-65cd2b46-710d-4972-ac13-5dd3339afd87 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:12:43.690536 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-65cd2b46-710d-4972-ac13-5dd3339afd87 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:12:43.691246 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-65cd2b46-710d-4972-ac13-5dd3339afd87 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:12:43.692121 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-65cd2b46-710d-4972-ac13-5dd3339afd87 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:12:43.693265 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-65cd2b46-710d-4972-ac13-5dd3339afd87 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:12:43.709967 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65cd2b46-710d-4972-ac13-5dd3339afd87 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:43.710732 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65cd2b46-710d-4972-ac13-5dd3339afd87 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:43.710894 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65cd2b46-710d-4972-ac13-5dd3339afd87 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:43.714007 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65cd2b46-710d-4972-ac13-5dd3339afd87 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:43.714904 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65cd2b46-710d-4972-ac13-5dd3339afd87 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:43.715338 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65cd2b46-710d-4972-ac13-5dd3339afd87 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:43.757496 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-65cd2b46-710d-4972-ac13-5dd3339afd87 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Getting quotas for project b5c2cfdafd4547d9bca73946ae404f9d. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:12:43.765121 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-65cd2b46-710d-4972-ac13-5dd3339afd87 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Getting quotas for user a7f796c0f6b643eb8d717afc1006b584 and project b5c2cfdafd4547d9bca73946ae404f9d. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:12:43.789180 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-65cd2b46-710d-4972-ac13-5dd3339afd87 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Going to run 1 instances... {{(pid=123015) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:12:43.795145 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-65cd2b46-710d-4972-ac13-5dd3339afd87 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:12:43.953597 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6ad660b1-2d8b-4970-b830-c5bd2092502f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:43.954396 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-6ad660b1-2d8b-4970-b830-c5bd2092502f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:43.962870 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ad660b1-2d8b-4970-b830-c5bd2092502f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:43.963700 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ad660b1-2d8b-4970-b830-c5bd2092502f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:43.964493 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ad660b1-2d8b-4970-b830-c5bd2092502f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:43.965468 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ad660b1-2d8b-4970-b830-c5bd2092502f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:43.966129 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ad660b1-2d8b-4970-b830-c5bd2092502f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:43.967151 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ad660b1-2d8b-4970-b830-c5bd2092502f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:44.018545 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-65cd2b46-710d-4972-ac13-5dd3339afd87 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.248910 Aug 22 17:12:44.028907 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 214/395] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 17:12:44.041023 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6bc0c0a4-7e45-426e-a359-1cef1ad680aa tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:44.041023 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-6bc0c0a4-7e45-426e-a359-1cef1ad680aa tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:44.151106 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6bc0c0a4-7e45-426e-a359-1cef1ad680aa tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:44.160577 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6bc0c0a4-7e45-426e-a359-1cef1ad680aa tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 200 len: 1223 microversion: 2.1 time: 0.126403 Aug 22 17:12:44.169346 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 215/396] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:44 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 1223 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:44.169346 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-962b1727-613e-4117-9dea-60de37a27a9e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:44.169346 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-962b1727-613e-4117-9dea-60de37a27a9e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:44.193965 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-962b1727-613e-4117-9dea-60de37a27a9e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:44.194455 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-962b1727-613e-4117-9dea-60de37a27a9e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:44.194894 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-962b1727-613e-4117-9dea-60de37a27a9e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:44.197731 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-962b1727-613e-4117-9dea-60de37a27a9e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:44.200471 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-962b1727-613e-4117-9dea-60de37a27a9e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:44.200471 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-962b1727-613e-4117-9dea-60de37a27a9e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:44.468351 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-962b1727-613e-4117-9dea-60de37a27a9e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:44.482808 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-962b1727-613e-4117-9dea-60de37a27a9e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:44.484674 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-962b1727-613e-4117-9dea-60de37a27a9e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:44.499652 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-962b1727-613e-4117-9dea-60de37a27a9e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1410 microversion: 2.75 time: 0.336210 Aug 22 17:12:44.500247 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 216/397] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:12:44 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1410 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:12:44.935117 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-6ad660b1-2d8b-4970-b830-c5bd2092502f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:44.943840 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-6ad660b1-2d8b-4970-b830-c5bd2092502f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1317 microversion: 2.1 time: 0.995489 Aug 22 17:12:44.957004 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 182/398] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:43 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1317 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:44.974069 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a8ede354-71a8-43f4-a5e0-5705bf6c9e62 tempest-FlavorsAccessTestJSON-947337305 tempest-FlavorsAccessTestJSON-947337305-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1607106117", "id": 596539751, "os-flavor-access:is_public": "False"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:44.977064 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:44.977064 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:45.089814 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a8ede354-71a8-43f4-a5e0-5705bf6c9e62 tempest-FlavorsAccessTestJSON-947337305 tempest-FlavorsAccessTestJSON-947337305-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.345522 Aug 22 17:12:45.090989 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 217/399] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:44 2022] POST /compute/v2.1/flavors => generated 428 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:45.104597 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5c0028f4-6842-49d6-826d-a25451d93360 tempest-FlavorsAccessTestJSON-947337305 tempest-FlavorsAccessTestJSON-947337305-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1b78f79e7b794e32b130dd0f202ae253"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:45.107441 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:45.107441 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:45.187574 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cdab2e4b-0184-4738-a991-89f39c4ba5fa tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:45.188772 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-cdab2e4b-0184-4738-a991-89f39c4ba5fa tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:45.264992 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-cdab2e4b-0184-4738-a991-89f39c4ba5fa tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:45.272742 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-cdab2e4b-0184-4738-a991-89f39c4ba5fa tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 200 len: 1223 microversion: 2.1 time: 0.088908 Aug 22 17:12:45.273388 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 218/400] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:45 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:45.448972 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-f732e7b6-2ad9-4ca4-91f8-24add9982562 req-a009daba-0672-4aba-ac34-83b1bd0508cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95ed8662-ad0c-43f6-9800-8db34e26243d", "tag": "53926e96-e4b6-4b18-aa5b-faf6e595f345"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:45.460518 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-f732e7b6-2ad9-4ca4-91f8-24add9982562 req-a009daba-0672-4aba-ac34-83b1bd0508cd service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:45.461153 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-f732e7b6-2ad9-4ca4-91f8-24add9982562 req-a009daba-0672-4aba-ac34-83b1bd0508cd service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:45.461797 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-f732e7b6-2ad9-4ca4-91f8-24add9982562 req-a009daba-0672-4aba-ac34-83b1bd0508cd service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:45.473473 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-f732e7b6-2ad9-4ca4-91f8-24add9982562 req-a009daba-0672-4aba-ac34-83b1bd0508cd service nova] Creating event network-changed:53926e96-e4b6-4b18-aa5b-faf6e595f345 for instance 95ed8662-ad0c-43f6-9800-8db34e26243d on n-h1-854030-1 Aug 22 17:12:45.479538 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-f732e7b6-2ad9-4ca4-91f8-24add9982562 req-a009daba-0672-4aba-ac34-83b1bd0508cd service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034046 Aug 22 17:12:45.481043 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 219/401] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:45.531767 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7a26eae2-7669-4b74-bef3-7c48ffce9416 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:45.532470 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-7a26eae2-7669-4b74-bef3-7c48ffce9416 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:45.534743 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=6,nova_api:INSERT=7 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:45.540269 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7a26eae2-7669-4b74-bef3-7c48ffce9416 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:45.541930 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7a26eae2-7669-4b74-bef3-7c48ffce9416 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:45.542741 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7a26eae2-7669-4b74-bef3-7c48ffce9416 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:45.543675 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7a26eae2-7669-4b74-bef3-7c48ffce9416 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:45.544354 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7a26eae2-7669-4b74-bef3-7c48ffce9416 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:45.545015 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7a26eae2-7669-4b74-bef3-7c48ffce9416 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:45.638922 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-7a26eae2-7669-4b74-bef3-7c48ffce9416 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:45.649439 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-7a26eae2-7669-4b74-bef3-7c48ffce9416 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:45.654926 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-7a26eae2-7669-4b74-bef3-7c48ffce9416 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:45.657754 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7a26eae2-7669-4b74-bef3-7c48ffce9416 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1416 microversion: 2.75 time: 0.130627 Aug 22 17:12:45.658642 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 220/402] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:12:45 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1416 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:12:45.734978 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5c0028f4-6842-49d6-826d-a25451d93360 tempest-FlavorsAccessTestJSON-947337305 tempest-FlavorsAccessTestJSON-947337305-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors/596539751/action" status: 200 len: 96 microversion: 2.1 time: 0.616998 Aug 22 17:12:45.734978 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 183/403] 10.222.0.96 () {60 vars in 1197 bytes} [Mon Aug 22 17:12:45 2022] POST /compute/v2.1/flavors/596539751/action => generated 96 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:12:45.965811 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d245854d-6e9f-4ed9-86df-f3a6ef21b134 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:45.968492 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-d245854d-6e9f-4ed9-86df-f3a6ef21b134 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:45.983673 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d245854d-6e9f-4ed9-86df-f3a6ef21b134 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:45.989424 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d245854d-6e9f-4ed9-86df-f3a6ef21b134 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:45.989991 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d245854d-6e9f-4ed9-86df-f3a6ef21b134 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:45.990737 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d245854d-6e9f-4ed9-86df-f3a6ef21b134 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:45.991212 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d245854d-6e9f-4ed9-86df-f3a6ef21b134 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:45.991645 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d245854d-6e9f-4ed9-86df-f3a6ef21b134 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:46.136984 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d26a89d5-b60e-43e8-b742-85194e011c14 tempest-FlavorsAccessTestJSON-2140631653 tempest-FlavorsAccessTestJSON-2140631653-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:46.170453 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d26a89d5-b60e-43e8-b742-85194e011c14 tempest-FlavorsAccessTestJSON-2140631653 tempest-FlavorsAccessTestJSON-2140631653-project] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.429329 Aug 22 17:12:46.187373 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 221/404] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:45 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:46.193815 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-31e16fe3-1e0e-4026-a032-f607b3d49d42 tempest-FlavorsAccessTestJSON-947337305 tempest-FlavorsAccessTestJSON-947337305-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1b78f79e7b794e32b130dd0f202ae253"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:46.196830 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:46.196830 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:46.480488 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-d245854d-6e9f-4ed9-86df-f3a6ef21b134 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:46.489370 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d245854d-6e9f-4ed9-86df-f3a6ef21b134 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1317 microversion: 2.1 time: 0.528346 Aug 22 17:12:46.490895 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 184/405] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:45 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1317 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:46.496048 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c37b8271-19de-49ec-b585-64548e8d328b tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:46.496913 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c37b8271-19de-49ec-b585-64548e8d328b tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:46.511782 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c37b8271-19de-49ec-b585-64548e8d328b tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:46.512299 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c37b8271-19de-49ec-b585-64548e8d328b tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:46.512998 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c37b8271-19de-49ec-b585-64548e8d328b tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:46.513817 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c37b8271-19de-49ec-b585-64548e8d328b tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:46.514786 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c37b8271-19de-49ec-b585-64548e8d328b tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:46.516071 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c37b8271-19de-49ec-b585-64548e8d328b tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:46.663471 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c37b8271-19de-49ec-b585-64548e8d328b tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:46.681771 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c37b8271-19de-49ec-b585-64548e8d328b tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 200 len: 1275 microversion: 2.1 time: 0.186961 Aug 22 17:12:46.688169 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 185/406] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:46 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 1275 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:46.689645 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5d5f473d-84fb-4af7-a4a2-786385a6b041 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:46.691053 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5d5f473d-84fb-4af7-a4a2-786385a6b041 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:46.699692 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5d5f473d-84fb-4af7-a4a2-786385a6b041 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:46.700194 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5d5f473d-84fb-4af7-a4a2-786385a6b041 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:46.700629 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5d5f473d-84fb-4af7-a4a2-786385a6b041 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:46.701666 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5d5f473d-84fb-4af7-a4a2-786385a6b041 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:46.702149 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5d5f473d-84fb-4af7-a4a2-786385a6b041 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:46.702604 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5d5f473d-84fb-4af7-a4a2-786385a6b041 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:46.717805 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-31e16fe3-1e0e-4026-a032-f607b3d49d42 tempest-FlavorsAccessTestJSON-947337305 tempest-FlavorsAccessTestJSON-947337305-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors/596539751/action" status: 200 len: 21 microversion: 2.1 time: 0.527910 Aug 22 17:12:46.720625 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 222/407] 10.222.0.96 () {60 vars in 1197 bytes} [Mon Aug 22 17:12:46 2022] POST /compute/v2.1/flavors/596539751/action => generated 21 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:12:46.731421 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-65c43354-9c25-4b97-80a7-31ea94593626 tempest-FlavorsAccessTestJSON-2140631653 tempest-FlavorsAccessTestJSON-2140631653-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:46.765505 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-65c43354-9c25-4b97-80a7-31ea94593626 tempest-FlavorsAccessTestJSON-2140631653 tempest-FlavorsAccessTestJSON-2140631653-project] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037573 Aug 22 17:12:46.767779 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 223/408] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:46.788904 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1dfdc299-1a34-4cf0-83f8-e113abdfdb1d tempest-FlavorsAccessTestJSON-947337305 tempest-FlavorsAccessTestJSON-947337305-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:46.789758 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:46.789758 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:46.879080 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1dfdc299-1a34-4cf0-83f8-e113abdfdb1d tempest-FlavorsAccessTestJSON-947337305 tempest-FlavorsAccessTestJSON-947337305-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/596539751" status: 202 len: 0 microversion: 2.1 time: 0.096525 Aug 22 17:12:46.880553 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 224/409] 10.222.0.96 () {58 vars in 1158 bytes} [Mon Aug 22 17:12:46 2022] DELETE /compute/v2.1/flavors/596539751 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:12:46.890161 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-5d5f473d-84fb-4af7-a4a2-786385a6b041 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:46.891694 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2b7567b1-01c6-42a4-9c64-b1295b9c0a9d tempest-FlavorsAccessTestJSON-947337305 tempest-FlavorsAccessTestJSON-947337305-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:46.903394 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-5d5f473d-84fb-4af7-a4a2-786385a6b041 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:46.907894 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-5d5f473d-84fb-4af7-a4a2-786385a6b041 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:46.920445 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5d5f473d-84fb-4af7-a4a2-786385a6b041 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1416 microversion: 2.75 time: 0.235492 Aug 22 17:12:46.923104 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 186/410] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:12:46 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1416 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:12:46.925293 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2b7567b1-01c6-42a4-9c64-b1295b9c0a9d tempest-FlavorsAccessTestJSON-947337305 tempest-FlavorsAccessTestJSON-947337305-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037950 Aug 22 17:12:46.939626 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 225/411] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:46.950325 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9ee9792a-5374-4d61-86fc-f7328bf19d71 tempest-FlavorsAccessTestJSON-947337305 tempest-FlavorsAccessTestJSON-947337305-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1888812063", "id": 992670850, "os-flavor-access:is_public": "False"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:46.954693 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:46.954693 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:47.059404 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9ee9792a-5374-4d61-86fc-f7328bf19d71 tempest-FlavorsAccessTestJSON-947337305 tempest-FlavorsAccessTestJSON-947337305-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.112975 Aug 22 17:12:47.068532 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 187/412] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:12:46 2022] POST /compute/v2.1/flavors => generated 428 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:47.072770 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-98bd83b6-5100-442e-a969-91509ca2200f tempest-FlavorsAccessTestJSON-947337305 tempest-FlavorsAccessTestJSON-947337305-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:47.073584 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:47.073584 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:47.106914 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-98bd83b6-5100-442e-a969-91509ca2200f tempest-FlavorsAccessTestJSON-947337305 tempest-FlavorsAccessTestJSON-947337305-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/992670850/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.038307 Aug 22 17:12:47.112745 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 226/413] 10.222.0.96 () {58 vars in 1206 bytes} [Mon Aug 22 17:12:47 2022] GET /compute/v2.1/flavors/992670850/os-flavor-access => generated 21 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:12:47.119144 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f72c9771-1e3d-414e-8889-b1d208336304 tempest-FlavorsAccessTestJSON-947337305 tempest-FlavorsAccessTestJSON-947337305-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:47.119958 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:47.119958 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:47.214423 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a14702d0-2f23-4822-9d98-d225abb667b7 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-133196043", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "4961ed3b-1757-4867-b3c5-234aece94f27"}], "security_groups": [{"name": "tempest-securitygroup--657410505"}], "key_name": "tempest-keypair-87051449", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:47.350800 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f72c9771-1e3d-414e-8889-b1d208336304 tempest-FlavorsAccessTestJSON-947337305 tempest-FlavorsAccessTestJSON-947337305-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/992670850" status: 202 len: 0 microversion: 2.1 time: 0.236342 Aug 22 17:12:47.351396 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 188/414] 10.222.0.96 () {58 vars in 1158 bytes} [Mon Aug 22 17:12:47 2022] DELETE /compute/v2.1/flavors/992670850 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:12:47.359747 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-3fed4746-ae71-43fc-93d6-57a06be86eb4 tempest-FlavorsAccessTestJSON-947337305 tempest-FlavorsAccessTestJSON-947337305-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:47.414956 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-3fed4746-ae71-43fc-93d6-57a06be86eb4 tempest-FlavorsAccessTestJSON-947337305 tempest-FlavorsAccessTestJSON-947337305-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058894 Aug 22 17:12:47.416943 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 189/415] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:12:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:47.513046 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fde9a589-af3f-444c-a655-0154effc3dad tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:47.513894 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-fde9a589-af3f-444c-a655-0154effc3dad tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:47.521901 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fde9a589-af3f-444c-a655-0154effc3dad tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:47.530981 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fde9a589-af3f-444c-a655-0154effc3dad tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:47.531895 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fde9a589-af3f-444c-a655-0154effc3dad tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:47.532968 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fde9a589-af3f-444c-a655-0154effc3dad tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:47.533574 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fde9a589-af3f-444c-a655-0154effc3dad tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:47.534102 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fde9a589-af3f-444c-a655-0154effc3dad tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:47.798398 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-a14702d0-2f23-4822-9d98-d225abb667b7 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] validate_networks() for [('4961ed3b-1757-4867-b3c5-234aece94f27', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:12:47.852982 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-fde9a589-af3f-444c-a655-0154effc3dad tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:47.865117 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-fde9a589-af3f-444c-a655-0154effc3dad tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1317 microversion: 2.1 time: 0.357992 Aug 22 17:12:47.865937 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 190/416] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:47 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:47.884078 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-64c917a6-e753-4a57-89fe-21910bb92e7a tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:47.893430 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-64c917a6-e753-4a57-89fe-21910bb92e7a tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:47.911775 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-64c917a6-e753-4a57-89fe-21910bb92e7a tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:47.912518 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-64c917a6-e753-4a57-89fe-21910bb92e7a tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:47.913181 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-64c917a6-e753-4a57-89fe-21910bb92e7a tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:47.914096 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-64c917a6-e753-4a57-89fe-21910bb92e7a tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:47.914729 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-64c917a6-e753-4a57-89fe-21910bb92e7a tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:47.915165 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-64c917a6-e753-4a57-89fe-21910bb92e7a tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:47.998130 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-64c917a6-e753-4a57-89fe-21910bb92e7a tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:48.009257 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-64c917a6-e753-4a57-89fe-21910bb92e7a tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 200 len: 1281 microversion: 2.1 time: 0.128784 Aug 22 17:12:48.025264 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 191/417] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:47 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 1281 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:48.284189 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-a14702d0-2f23-4822-9d98-d225abb667b7 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d75d1779-da51-449b-988c-6e3b32625ae5) Aug 22 17:12:48.284189 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:48.284189 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:48.284189 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:48.284189 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:48.284189 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:48.284189 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:48.284189 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:48.284189 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:48.284189 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:48.284189 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:12:48.284189 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:12:48.284189 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:12:48.284189 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:12:48.284189 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:12:48.284189 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:12:48.285917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:12:48.285917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:12:48.285917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:12:48.285917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:12:48.285917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:12:48.285917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:12:48.285917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:12:48.285917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:12:48.285917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:12:48.285917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:12:48.285917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:12:48.285917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:48.285917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:48.285917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:12:48.285917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:12:48.285917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:48.285917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:48.285917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:12:48.287313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:12:48.287313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:48.287313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:48.287313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:12:48.287313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:12:48.287313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:48.287313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:48.287313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:12:48.287313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:12:48.287313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:12:48.287313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:12:48.287313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:12:48.287313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:12:48.287313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:12:48.287313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:12:48.287313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:12:48.287313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:12:48.287313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:12:48.289209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:12:48.289209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:12:48.289209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:12:48.289209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:12:48.289209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:12:48.289209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:12:48.289209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:12:48.289209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:12:48.289209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:12:48.289209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:12:48.289209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:12:48.289209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:12:48.289209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:12:48.289209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:12:48.289209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d75d1779-da51-449b-988c-6e3b32625ae5) Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-a14702d0-2f23-4822-9d98-d225abb667b7 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a14702d0-2f23-4822-9d98-d225abb667b7 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Request method failure captured: Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 467 Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7j32YTw0hL_DuXnelgZHHX7C1Gmcw3vNcMfLG9RPRrF5VrBlcszKIkOXSraO-H71og8rmMDf7E7s2KJSPfbGwF0eGTzPlA7_SG_d_wJ73JQ3tD3bRiNgJUrN6P0arD1nYmVZXVS9qY9aHRTG3-l3Dr6eQBqvqcebviIUQkfdWgx-Ug Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: X-Openstack-Nova-Api-Version: 2.25 Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 4fbd6f26451e49e581f5dcb7689a1a3d Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1622325097 Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:12:48.290695 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:12:48.294354 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4fbd6f26451e49e581f5dcb7689a1a3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_4fbd6f26451e49e581f5dcb7689a1a3d", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4fbd6f26451e49e581f5dcb7689a1a3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/4fbd6f26451e49e581f5dcb7689a1a3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:48.294354 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1622325097 Aug 22 17:12:48.294354 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 4fbd6f26451e49e581f5dcb7689a1a3d Aug 22 17:12:48.294354 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1622325097 Aug 22 17:12:48.294354 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-LiveAutoBlockMigrationV225Test-1622325097-project Aug 22 17:12:48.294354 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:12:48.294354 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:12:48.294354 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: c5ad39ac5ea841d68b94dca20d12d00c Aug 22 17:12:48.294354 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1622325097-project Aug 22 17:12:48.294354 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:12:48.295457 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-133196043", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "4961ed3b-1757-4867-b3c5-234aece94f27"}], "security_groups": [{"name": "tempest-securitygroup--657410505"}], "key_name": "tempest-keypair-87051449", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 22 17:12:48.295457 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:12:48.295457 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:48.295457 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:12:48.295457 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-133196043', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '4961ed3b-1757-4867-b3c5-234aece94f27'}], 'security_groups': [{'name': 'tempest-securitygroup--657410505'}], 'key_name': 'tempest-keypair-87051449', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 22 17:12:48.295457 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:48.295457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:48.295457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:48.295457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:48.295457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:48.295457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:48.295457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:48.295457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:48.300168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:48.300168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:48.300168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:12:48.300168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:12:48.300168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:12:48.300168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:12:48.300168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:12:48.300168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:12:48.300168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:12:48.300168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:12:48.300168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:12:48.300168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:12:48.300168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:12:48.300168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:12:48.300168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:12:48.300168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:12:48.300168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:12:48.300168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:12:48.303480 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:12:48.303480 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:48.303480 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:48.303480 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:12:48.303480 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:12:48.303480 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:48.303480 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:48.303480 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:12:48.303480 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:12:48.303480 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:48.303480 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:48.303480 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:12:48.303480 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:12:48.303480 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:48.303480 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:48.303480 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:12:48.303480 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:12:48.303480 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:12:48.305522 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:12:48.305522 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:12:48.305522 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:12:48.305522 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:12:48.305522 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:12:48.305522 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:12:48.305522 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:12:48.305522 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:12:48.305522 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:12:48.305522 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:12:48.305522 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:12:48.305522 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:12:48.305522 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:12:48.305522 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:12:48.305522 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:12:48.305522 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:12:48.305522 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:12:48.307114 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:12:48.307114 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:12:48.307114 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:12:48.307114 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:12:48.307114 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:12:48.307114 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:12:48.307114 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d75d1779-da51-449b-988c-6e3b32625ae5) Aug 22 17:12:48.307114 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:48.307114 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:48.307114 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:48.307114 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:48.307114 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:48.307114 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:48.307114 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:48.307114 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:48.307114 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:12:48.307114 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:12:48.309487 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:48.309487 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:48.309487 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:48.309487 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:48.309487 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:48.309487 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:48.309487 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:48.309487 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:48.309487 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:48.309487 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:48.309487 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:48.309487 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:48.309487 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:12:48.309487 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a14702d0-2f23-4822-9d98-d225abb667b7 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:48.309487 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:48.312182 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a14702d0-2f23-4822-9d98-d225abb667b7 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 1.079823 Aug 22 17:12:48.312182 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 227/418] 10.222.0.96 () {62 vars in 1188 bytes} [Mon Aug 22 17:12:47 2022] POST /compute/v2.1/servers => generated 214 bytes in 1086 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Aug 22 17:12:48.313319 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d3a6cb67-157b-43e5-8057-ad36c8628772 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:48.321147 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d3a6cb67-157b-43e5-8057-ad36c8628772 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:48.342458 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d3a6cb67-157b-43e5-8057-ad36c8628772 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:48.342953 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d3a6cb67-157b-43e5-8057-ad36c8628772 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:48.343388 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d3a6cb67-157b-43e5-8057-ad36c8628772 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:48.352510 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d3a6cb67-157b-43e5-8057-ad36c8628772 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:48.356217 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d3a6cb67-157b-43e5-8057-ad36c8628772 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:48.356689 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d3a6cb67-157b-43e5-8057-ad36c8628772 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:48.563089 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d3a6cb67-157b-43e5-8057-ad36c8628772 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:48.575702 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d3a6cb67-157b-43e5-8057-ad36c8628772 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:48.579123 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d3a6cb67-157b-43e5-8057-ad36c8628772 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:48.590453 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d3a6cb67-157b-43e5-8057-ad36c8628772 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1437 microversion: 2.75 time: 0.292967 Aug 22 17:12:48.606941 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 228/419] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:12:48 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1437 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:12:48.626090 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:48.632238 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:48.646625 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:48.650229 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:48.651051 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:48.653032 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:48.653950 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:48.655864 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:48.686980 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-01f46d66-33d3-4d49-9dbd-29aab9d26304 tempest-TenantUsagesNegativeTestJSON-75233118 tempest-TenantUsagesNegativeTestJSON-75233118-project-admin] 10.222.0.96 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-21T17%3A12%3A47.731310&end=2022-08-23T17%3A12%3A47.731310" status: 404 len: 112 microversion: - time: 0.660153 Aug 22 17:12:48.688519 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 192/420] 10.222.0.96 () {58 vars in 1316 bytes} [Mon Aug 22 17:12:48 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-21T17%3A12%3A47.731310&end=2022-08-23T17%3A12%3A47.731310 => generated 112 bytes in 662 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 22 17:12:48.700619 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7adb9d53-8674-4e1e-a823-ca436f59c067 tempest-TenantUsagesNegativeTestJSON-75233118 tempest-TenantUsagesNegativeTestJSON-75233118-project-admin] Calling method '.version_select at 0x7f8009dde280>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:48.719736 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-7adb9d53-8674-4e1e-a823-ca436f59c067 tempest-TenantUsagesNegativeTestJSON-75233118 tempest-TenantUsagesNegativeTestJSON-75233118-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7adb9d53-8674-4e1e-a823-ca436f59c067 tempest-TenantUsagesNegativeTestJSON-75233118 tempest-TenantUsagesNegativeTestJSON-75233118-project-admin] Request method failure captured: Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-simple-tenant-usage/c56fefe1893544879200e80ca0c28c87?start=2022-08-23T17%3A12%3A47.731310&end=2022-08-21T17%3A12%3A47.731310 HTTP/1.1 Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7kPjNyBqnIO33cWWkopQTV-5X9-PNpJNV1kZAewp6xYW-Oy9I3XuZ0tNxHiyOJsVyXSRTTz7aa_YSmVTJR3nUc78Mfj9hgpxymAFaw8xw-KzhG-GkofXi_gy4Ip3Y46IYtBi9YLLw0JF5gt3dwt-CG7d-_KtQA_PlmX7N3fhqnfB2M Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: c5c8bbbc9806451b81887f971a2e42ad Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-75233118 Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:12:48.729660 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:12:48.741512 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c5c8bbbc9806451b81887f971a2e42ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_c5c8bbbc9806451b81887f971a2e42ad", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c5c8bbbc9806451b81887f971a2e42ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/c5c8bbbc9806451b81887f971a2e42ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:48.741512 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-75233118 Aug 22 17:12:48.741512 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: c5c8bbbc9806451b81887f971a2e42ad Aug 22 17:12:48.741512 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-75233118 Aug 22 17:12:48.741512 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-TenantUsagesNegativeTestJSON-75233118-project-admin Aug 22 17:12:48.741512 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:12:48.741512 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:12:48.741512 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: dcbb68d6b4ba48e289b384fe21dae5e8 Aug 22 17:12:48.741512 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-75233118-project-admin Aug 22 17:12:48.741512 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:12:48.741512 n-d-854030-1 devstack@n-api.service[123016]: exception: Invalid start time. The start time cannot occur after the end time. Aug 22 17:12:48.741512 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'c56fefe1893544879200e80ca0c28c87'} Aug 22 17:12:48.742420 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:48.742420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:48.742420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:48.742420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:48.742420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:48.742420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:48.742420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:12:48.742420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:12:48.742420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 17:12:48.742420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:48.742420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:48.742420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:48.742420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 22 17:12:48.742420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 22 17:12:48.742420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 22 17:12:48.742420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 22 17:12:48.742420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 22 17:12:48.742420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 22 17:12:48.742420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 22 17:12:48.743511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:48.743511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:48.743511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:48.743511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:48.743511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:48.743511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:48.743511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:48.743511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:48.743511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 22 17:12:48.743511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:48.743511 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7adb9d53-8674-4e1e-a823-ca436f59c067 tempest-TenantUsagesNegativeTestJSON-75233118 tempest-TenantUsagesNegativeTestJSON-75233118-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:48.749711 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7adb9d53-8674-4e1e-a823-ca436f59c067 tempest-TenantUsagesNegativeTestJSON-75233118 tempest-TenantUsagesNegativeTestJSON-75233118-project-admin] 10.222.0.96 "GET /compute/v2.1/os-simple-tenant-usage/c56fefe1893544879200e80ca0c28c87?start=2022-08-23T17%3A12%3A47.731310&end=2022-08-21T17%3A12%3A47.731310" status: 400 len: 111 microversion: 2.1 time: 0.051564 Aug 22 17:12:48.752215 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 193/421] 10.222.0.96 () {58 vars in 1412 bytes} [Mon Aug 22 17:12:48 2022] GET /compute/v2.1/os-simple-tenant-usage/c56fefe1893544879200e80ca0c28c87?start=2022-08-23T17%3A12%3A47.731310&end=2022-08-21T17%3A12%3A47.731310 => generated 111 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:12:48.904087 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:12:48.906274 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:12:48.906995 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:12:48.908253 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:12:48.909483 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:12:49.235124 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:49.256313 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:49.262006 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:49.264995 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:49.266162 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:49.272257 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:49.273587 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:49.317859 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=6 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:49.329314 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-60d53c99-f1b0-4658-9c5a-0df9bcb31362 tempest-TenantUsagesNegativeTestJSON-1158504671 tempest-TenantUsagesNegativeTestJSON-1158504671-project] Calling method '.version_select at 0x7f800a0ffca0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:49.337360 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-60d53c99-f1b0-4658-9c5a-0df9bcb31362 tempest-TenantUsagesNegativeTestJSON-1158504671 tempest-TenantUsagesNegativeTestJSON-1158504671-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '5cbe558d4e1d4290add5e9ecb7998e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56fefe1893544879200e80ca0c28c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-60d53c99-f1b0-4658-9c5a-0df9bcb31362 tempest-TenantUsagesNegativeTestJSON-1158504671 tempest-TenantUsagesNegativeTestJSON-1158504671-project] Request method failure captured: Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-21T17%3A12%3A47.731310&end=2022-08-23T17%3A12%3A47.731310&detailed=1 HTTP/1.1 Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7kO73ggH8XqvdxKfjfWBxa2BvoTJQUGhnPfEqNaIOfs0j7GfaEvf5Y5RBP8HaYANnczt6jD9xNYt8t7KJmC5vnjZq5hTIj4u4e1lQb9mL6dbBkrMaii8h4_d5nqgjxS0qZkSn4aM-beppo95GYR-8eHTCNGeLHLX19vO7iuB4B1ZUo Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: c56fefe1893544879200e80ca0c28c87 Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1158504671 Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:12:49.346545 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:12:49.353266 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c56fefe1893544879200e80ca0c28c87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_c56fefe1893544879200e80ca0c28c87", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c56fefe1893544879200e80ca0c28c87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/c56fefe1893544879200e80ca0c28c87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:49.353266 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1158504671 Aug 22 17:12:49.353266 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: c56fefe1893544879200e80ca0c28c87 Aug 22 17:12:49.353266 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1158504671 Aug 22 17:12:49.353266 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-TenantUsagesNegativeTestJSON-1158504671-project Aug 22 17:12:49.353266 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:12:49.353266 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:12:49.353266 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 5cbe558d4e1d4290add5e9ecb7998e97 Aug 22 17:12:49.353266 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1158504671-project Aug 22 17:12:49.353266 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:12:49.353266 n-d-854030-1 devstack@n-api.service[123016]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 22 17:12:49.353266 n-d-854030-1 devstack@n-api.service[123016]: action_args: {} Aug 22 17:12:49.353266 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:49.354058 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:49.354058 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:49.354058 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:49.354058 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:49.354058 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:49.354058 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:12:49.354058 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:12:49.354058 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 17:12:49.354058 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:49.354058 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:49.354058 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:49.354058 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 22 17:12:49.354058 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 22 17:12:49.354058 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 22 17:12:49.354058 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 22 17:12:49.354058 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:12:49.354058 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:12:49.354058 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:12:49.354058 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:12:49.355526 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:12:49.355526 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:12:49.355526 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:12:49.355526 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:12:49.355526 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:12:49.355526 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:12:49.355526 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:12:49.355526 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:12:49.355526 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:12:49.355526 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:12:49.355526 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 22 17:12:49.355526 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:49.355526 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:49.355526 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:49.355526 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:49.355526 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:49.355526 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:49.355526 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:12:49.355526 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:12:49.356687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 22 17:12:49.356687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:49.356687 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-60d53c99-f1b0-4658-9c5a-0df9bcb31362 tempest-TenantUsagesNegativeTestJSON-1158504671 tempest-TenantUsagesNegativeTestJSON-1158504671-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:49.356687 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-60d53c99-f1b0-4658-9c5a-0df9bcb31362 tempest-TenantUsagesNegativeTestJSON-1158504671 tempest-TenantUsagesNegativeTestJSON-1158504671-project] 10.222.0.96 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-21T17%3A12%3A47.731310&end=2022-08-23T17%3A12%3A47.731310&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.588651 Aug 22 17:12:49.356687 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 194/422] 10.222.0.96 () {58 vars in 1335 bytes} [Mon Aug 22 17:12:48 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-21T17%3A12%3A47.731310&end=2022-08-23T17%3A12%3A47.731310&detailed=1 => generated 123 bytes in 591 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:12:49.356687 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-24c80f7b-2777-4bbe-ba74-d4106d4c5ec8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:49.357805 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-24c80f7b-2777-4bbe-ba74-d4106d4c5ec8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:49.367152 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-24c80f7b-2777-4bbe-ba74-d4106d4c5ec8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:49.367675 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-24c80f7b-2777-4bbe-ba74-d4106d4c5ec8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:49.368125 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-24c80f7b-2777-4bbe-ba74-d4106d4c5ec8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:49.368902 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-24c80f7b-2777-4bbe-ba74-d4106d4c5ec8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:49.369463 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-24c80f7b-2777-4bbe-ba74-d4106d4c5ec8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:49.369868 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-24c80f7b-2777-4bbe-ba74-d4106d4c5ec8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:49.401730 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:49.426425 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:49.427804 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:49.463779 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d7987fa0-4a97-4b21-8e6b-bc351f778f34 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "POST /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18/action" status: 202 len: 1494 microversion: 2.75 time: 0.846238 Aug 22 17:12:49.468578 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 229/423] 10.222.0.96 () {62 vars in 1319 bytes} [Mon Aug 22 17:12:48 2022] POST /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18/action => generated 1494 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 22 17:12:49.601462 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-40ca0bae-08a5-41c1-b8ac-c1ea0acee575 tempest-HypervisorAdminV228Test-1268042390 tempest-HypervisorAdminV228Test-1268042390-project-admin] Calling method '.version_select at 0x7f8009e673a0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:49.602999 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:49.602999 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:49.604925 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-40ca0bae-08a5-41c1-b8ac-c1ea0acee575 tempest-HypervisorAdminV228Test-1268042390 tempest-HypervisorAdminV228Test-1268042390-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:49.605627 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-40ca0bae-08a5-41c1-b8ac-c1ea0acee575 tempest-HypervisorAdminV228Test-1268042390 tempest-HypervisorAdminV228Test-1268042390-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:49.606223 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-40ca0bae-08a5-41c1-b8ac-c1ea0acee575 tempest-HypervisorAdminV228Test-1268042390 tempest-HypervisorAdminV228Test-1268042390-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:49.624122 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-40ca0bae-08a5-41c1-b8ac-c1ea0acee575 tempest-HypervisorAdminV228Test-1268042390 tempest-HypervisorAdminV228Test-1268042390-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:49.625450 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-40ca0bae-08a5-41c1-b8ac-c1ea0acee575 tempest-HypervisorAdminV228Test-1268042390 tempest-HypervisorAdminV228Test-1268042390-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:49.626111 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-40ca0bae-08a5-41c1-b8ac-c1ea0acee575 tempest-HypervisorAdminV228Test-1268042390 tempest-HypervisorAdminV228Test-1268042390-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:49.639933 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-40ca0bae-08a5-41c1-b8ac-c1ea0acee575 tempest-HypervisorAdminV228Test-1268042390 tempest-HypervisorAdminV228Test-1268042390-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:49.640993 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-40ca0bae-08a5-41c1-b8ac-c1ea0acee575 tempest-HypervisorAdminV228Test-1268042390 tempest-HypervisorAdminV228Test-1268042390-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:49.641900 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-40ca0bae-08a5-41c1-b8ac-c1ea0acee575 tempest-HypervisorAdminV228Test-1268042390 tempest-HypervisorAdminV228Test-1268042390-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:49.651125 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-40ca0bae-08a5-41c1-b8ac-c1ea0acee575 tempest-HypervisorAdminV228Test-1268042390 tempest-HypervisorAdminV228Test-1268042390-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.180783 Aug 22 17:12:49.652958 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 230/424] 10.222.0.96 () {60 vars in 1187 bytes} [Mon Aug 22 17:12:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:12:49.663454 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-07b83043-72ad-4148-ba2f-9f91e5f77d1c tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:49.664345 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-07b83043-72ad-4148-ba2f-9f91e5f77d1c tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:49.673005 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-07b83043-72ad-4148-ba2f-9f91e5f77d1c tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:49.673815 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-07b83043-72ad-4148-ba2f-9f91e5f77d1c tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:49.674600 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-07b83043-72ad-4148-ba2f-9f91e5f77d1c tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:49.676404 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-07b83043-72ad-4148-ba2f-9f91e5f77d1c tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:49.677120 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-07b83043-72ad-4148-ba2f-9f91e5f77d1c tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:49.678645 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-07b83043-72ad-4148-ba2f-9f91e5f77d1c tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:49.680723 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-24c80f7b-2777-4bbe-ba74-d4106d4c5ec8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:49.691730 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-24c80f7b-2777-4bbe-ba74-d4106d4c5ec8 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1317 microversion: 2.1 time: 0.340109 Aug 22 17:12:49.693198 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 195/425] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:49 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:49.702253 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-dbcc8c10-aa5e-408f-85f7-e9243b433e84 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:49.703300 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-dbcc8c10-aa5e-408f-85f7-e9243b433e84 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:49.709800 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dbcc8c10-aa5e-408f-85f7-e9243b433e84 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:49.710604 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dbcc8c10-aa5e-408f-85f7-e9243b433e84 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:49.711250 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dbcc8c10-aa5e-408f-85f7-e9243b433e84 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:49.712340 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dbcc8c10-aa5e-408f-85f7-e9243b433e84 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:49.713210 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dbcc8c10-aa5e-408f-85f7-e9243b433e84 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:49.713827 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dbcc8c10-aa5e-408f-85f7-e9243b433e84 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:49.800247 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-dbcc8c10-aa5e-408f-85f7-e9243b433e84 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:49.815476 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-dbcc8c10-aa5e-408f-85f7-e9243b433e84 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:49.821928 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-dbcc8c10-aa5e-408f-85f7-e9243b433e84 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:49.840236 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-dbcc8c10-aa5e-408f-85f7-e9243b433e84 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.142728 Aug 22 17:12:49.842387 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 196/426] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:12:49 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:12:49.858988 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-203ba9a7-90b8-428e-80aa-f60b157673a6 tempest-HypervisorAdminV228Test-1268042390 tempest-HypervisorAdminV228Test-1268042390-project-admin] Calling method '.version_select at 0x7f8009dcc160>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:49.859967 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:49.859967 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:49.861695 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-203ba9a7-90b8-428e-80aa-f60b157673a6 tempest-HypervisorAdminV228Test-1268042390 tempest-HypervisorAdminV228Test-1268042390-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:49.862386 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-203ba9a7-90b8-428e-80aa-f60b157673a6 tempest-HypervisorAdminV228Test-1268042390 tempest-HypervisorAdminV228Test-1268042390-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:49.865735 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-203ba9a7-90b8-428e-80aa-f60b157673a6 tempest-HypervisorAdminV228Test-1268042390 tempest-HypervisorAdminV228Test-1268042390-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:49.891340 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-203ba9a7-90b8-428e-80aa-f60b157673a6 tempest-HypervisorAdminV228Test-1268042390 tempest-HypervisorAdminV228Test-1268042390-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:49.891952 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-203ba9a7-90b8-428e-80aa-f60b157673a6 tempest-HypervisorAdminV228Test-1268042390 tempest-HypervisorAdminV228Test-1268042390-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:49.892642 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-203ba9a7-90b8-428e-80aa-f60b157673a6 tempest-HypervisorAdminV228Test-1268042390 tempest-HypervisorAdminV228Test-1268042390-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:49.913017 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-203ba9a7-90b8-428e-80aa-f60b157673a6 tempest-HypervisorAdminV228Test-1268042390 tempest-HypervisorAdminV228Test-1268042390-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 719 microversion: 2.28 time: 0.058856 Aug 22 17:12:49.929216 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 197/427] 10.222.0.96 () {60 vars in 1193 bytes} [Mon Aug 22 17:12:49 2022] GET /compute/v2.1/os-hypervisors/1 => generated 719 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:12:50.043457 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-07b83043-72ad-4148-ba2f-9f91e5f77d1c tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:50.060699 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-07b83043-72ad-4148-ba2f-9f91e5f77d1c tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 200 len: 1323 microversion: 2.1 time: 0.403383 Aug 22 17:12:50.061659 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 231/428] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:49 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 1323 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:50.724212 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ca25f129-d45f-4d2a-a38f-8cbe479321be tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:50.729801 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-ca25f129-d45f-4d2a-a38f-8cbe479321be tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:50.733921 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ca25f129-d45f-4d2a-a38f-8cbe479321be tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:50.736556 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ca25f129-d45f-4d2a-a38f-8cbe479321be tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:50.738076 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ca25f129-d45f-4d2a-a38f-8cbe479321be tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:50.739088 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ca25f129-d45f-4d2a-a38f-8cbe479321be tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:50.739768 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ca25f129-d45f-4d2a-a38f-8cbe479321be tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:50.740510 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ca25f129-d45f-4d2a-a38f-8cbe479321be tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:50.874689 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8f18498d-9adc-4d8c-bf08-51b1835542ad tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:50.875296 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8f18498d-9adc-4d8c-bf08-51b1835542ad tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:50.887815 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8f18498d-9adc-4d8c-bf08-51b1835542ad tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:50.888308 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8f18498d-9adc-4d8c-bf08-51b1835542ad tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:50.888739 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8f18498d-9adc-4d8c-bf08-51b1835542ad tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:50.889463 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8f18498d-9adc-4d8c-bf08-51b1835542ad tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:50.889912 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8f18498d-9adc-4d8c-bf08-51b1835542ad tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:50.890326 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8f18498d-9adc-4d8c-bf08-51b1835542ad tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:51.115551 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8f18498d-9adc-4d8c-bf08-51b1835542ad tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:51.127709 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8f18498d-9adc-4d8c-bf08-51b1835542ad tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:51.133896 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8f18498d-9adc-4d8c-bf08-51b1835542ad tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:51.138136 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8f18498d-9adc-4d8c-bf08-51b1835542ad tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.267752 Aug 22 17:12:51.153118 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 232/429] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:12:50 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:12:51.153700 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ca25f129-d45f-4d2a-a38f-8cbe479321be tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:51.159051 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-135c5e07-ee3a-49db-8ea0-47fa5bbb8050 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:51.160060 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-135c5e07-ee3a-49db-8ea0-47fa5bbb8050 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:51.178353 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ca25f129-d45f-4d2a-a38f-8cbe479321be tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1317 microversion: 2.1 time: 0.463276 Aug 22 17:12:51.178959 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 198/430] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:50 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1317 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:51.179466 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-135c5e07-ee3a-49db-8ea0-47fa5bbb8050 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:51.180373 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-135c5e07-ee3a-49db-8ea0-47fa5bbb8050 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:51.180881 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-135c5e07-ee3a-49db-8ea0-47fa5bbb8050 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:51.181646 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-135c5e07-ee3a-49db-8ea0-47fa5bbb8050 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:51.182107 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-135c5e07-ee3a-49db-8ea0-47fa5bbb8050 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:51.182535 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-135c5e07-ee3a-49db-8ea0-47fa5bbb8050 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:51.607262 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-135c5e07-ee3a-49db-8ea0-47fa5bbb8050 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:51.617971 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-135c5e07-ee3a-49db-8ea0-47fa5bbb8050 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 200 len: 1323 microversion: 2.1 time: 0.477822 Aug 22 17:12:51.632626 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 233/431] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:51 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 1323 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:51.788847 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-4bfa7c21-d4db-467e-b7eb-c95c336be8f1 req-6a6cc2f6-59d9-4b51-9db8-575eb5615686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "791d0306-dc08-4e10-81c8-003730a5ce09", "tag": "6e59f300-cd40-4f3d-b25e-eb03e04d54d6"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:51.804103 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-4bfa7c21-d4db-467e-b7eb-c95c336be8f1 req-6a6cc2f6-59d9-4b51-9db8-575eb5615686 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:51.804945 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-4bfa7c21-d4db-467e-b7eb-c95c336be8f1 req-6a6cc2f6-59d9-4b51-9db8-575eb5615686 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:51.805556 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-4bfa7c21-d4db-467e-b7eb-c95c336be8f1 req-6a6cc2f6-59d9-4b51-9db8-575eb5615686 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:51.816924 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-4bfa7c21-d4db-467e-b7eb-c95c336be8f1 req-6a6cc2f6-59d9-4b51-9db8-575eb5615686 service nova] Creating event network-changed:6e59f300-cd40-4f3d-b25e-eb03e04d54d6 for instance 791d0306-dc08-4e10-81c8-003730a5ce09 on n-h1-854030-1 Aug 22 17:12:51.823387 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-4bfa7c21-d4db-467e-b7eb-c95c336be8f1 req-6a6cc2f6-59d9-4b51-9db8-575eb5615686 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040890 Aug 22 17:12:51.824098 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 199/432] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:52.163989 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-08edb3a0-0b79-4a7f-abb4-07a5f19c07bb tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:52.166808 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-08edb3a0-0b79-4a7f-abb4-07a5f19c07bb tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:52.178784 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-08edb3a0-0b79-4a7f-abb4-07a5f19c07bb tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:52.180480 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-08edb3a0-0b79-4a7f-abb4-07a5f19c07bb tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:52.181585 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-08edb3a0-0b79-4a7f-abb4-07a5f19c07bb tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:52.183731 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-08edb3a0-0b79-4a7f-abb4-07a5f19c07bb tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:52.184393 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-08edb3a0-0b79-4a7f-abb4-07a5f19c07bb tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:52.185758 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-08edb3a0-0b79-4a7f-abb4-07a5f19c07bb tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:52.200929 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-06f0cefd-43d1-4e44-b48b-a947e31efa70 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:52.204083 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-06f0cefd-43d1-4e44-b48b-a947e31efa70 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:52.231613 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-06f0cefd-43d1-4e44-b48b-a947e31efa70 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:52.235888 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-06f0cefd-43d1-4e44-b48b-a947e31efa70 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:52.237764 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-06f0cefd-43d1-4e44-b48b-a947e31efa70 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:52.241726 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-06f0cefd-43d1-4e44-b48b-a947e31efa70 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:52.242445 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-06f0cefd-43d1-4e44-b48b-a947e31efa70 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:52.273752 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-06f0cefd-43d1-4e44-b48b-a947e31efa70 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:52.494734 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-08edb3a0-0b79-4a7f-abb4-07a5f19c07bb tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:52.504659 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-08edb3a0-0b79-4a7f-abb4-07a5f19c07bb tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:52.510304 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-08edb3a0-0b79-4a7f-abb4-07a5f19c07bb tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:52.517563 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-08edb3a0-0b79-4a7f-abb4-07a5f19c07bb tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.357223 Aug 22 17:12:52.518863 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 234/433] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:12:52 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:12:52.569445 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-06f0cefd-43d1-4e44-b48b-a947e31efa70 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:52.579688 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-06f0cefd-43d1-4e44-b48b-a947e31efa70 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1317 microversion: 2.1 time: 0.383448 Aug 22 17:12:52.600549 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 200/434] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:52 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:52.640302 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5285bed6-d0f7-401b-9254-0f1b887b3da9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:52.640838 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-5285bed6-d0f7-401b-9254-0f1b887b3da9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:52.654861 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5285bed6-d0f7-401b-9254-0f1b887b3da9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:52.660941 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5285bed6-d0f7-401b-9254-0f1b887b3da9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:52.660941 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5285bed6-d0f7-401b-9254-0f1b887b3da9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:52.660941 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5285bed6-d0f7-401b-9254-0f1b887b3da9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:52.660941 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5285bed6-d0f7-401b-9254-0f1b887b3da9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:52.664504 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5285bed6-d0f7-401b-9254-0f1b887b3da9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:53.231064 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-5285bed6-d0f7-401b-9254-0f1b887b3da9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:53.241640 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5285bed6-d0f7-401b-9254-0f1b887b3da9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 200 len: 1323 microversion: 2.1 time: 0.605665 Aug 22 17:12:53.246496 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 235/435] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:52 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 1323 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:53.544986 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-65dde8e8-c496-4024-8213-5fc7781e1996 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:53.545913 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-65dde8e8-c496-4024-8213-5fc7781e1996 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:53.552195 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=16 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:53.558189 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-65dde8e8-c496-4024-8213-5fc7781e1996 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:53.558678 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-65dde8e8-c496-4024-8213-5fc7781e1996 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:53.559106 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-65dde8e8-c496-4024-8213-5fc7781e1996 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:53.559812 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-65dde8e8-c496-4024-8213-5fc7781e1996 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:53.560265 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-65dde8e8-c496-4024-8213-5fc7781e1996 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:53.560685 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-65dde8e8-c496-4024-8213-5fc7781e1996 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:53.607173 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-aa527768-2f22-4780-b21a-d1e647933dce tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:53.607967 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-aa527768-2f22-4780-b21a-d1e647933dce tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:53.615902 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-aa527768-2f22-4780-b21a-d1e647933dce tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:53.616725 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-aa527768-2f22-4780-b21a-d1e647933dce tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:53.617181 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-aa527768-2f22-4780-b21a-d1e647933dce tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:53.617882 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-aa527768-2f22-4780-b21a-d1e647933dce tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:53.618331 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-aa527768-2f22-4780-b21a-d1e647933dce tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:53.618752 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-aa527768-2f22-4780-b21a-d1e647933dce tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:53.623101 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:53.691735 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-65dde8e8-c496-4024-8213-5fc7781e1996 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:53.702801 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-65dde8e8-c496-4024-8213-5fc7781e1996 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:53.704418 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-65dde8e8-c496-4024-8213-5fc7781e1996 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:53.712838 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-65dde8e8-c496-4024-8213-5fc7781e1996 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.172741 Aug 22 17:12:53.713473 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 201/436] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:12:53 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:12:53.736440 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=8 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:53.795057 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-aa527768-2f22-4780-b21a-d1e647933dce tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:53.804040 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-aa527768-2f22-4780-b21a-d1e647933dce tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1317 microversion: 2.1 time: 0.200228 Aug 22 17:12:53.815505 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 236/437] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:53 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:54.266852 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-718d13cd-a28b-49a2-9036-3594bab2ce66 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:54.267473 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-718d13cd-a28b-49a2-9036-3594bab2ce66 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:54.552260 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-718d13cd-a28b-49a2-9036-3594bab2ce66 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:54.552260 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-718d13cd-a28b-49a2-9036-3594bab2ce66 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:54.552260 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-718d13cd-a28b-49a2-9036-3594bab2ce66 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:54.552260 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-718d13cd-a28b-49a2-9036-3594bab2ce66 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:54.554179 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-718d13cd-a28b-49a2-9036-3594bab2ce66 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:54.554179 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-718d13cd-a28b-49a2-9036-3594bab2ce66 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:54.554179 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-718d13cd-a28b-49a2-9036-3594bab2ce66 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:54.554847 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-718d13cd-a28b-49a2-9036-3594bab2ce66 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 200 len: 1323 microversion: 2.1 time: 0.243262 Aug 22 17:12:54.554847 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 202/438] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:54 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 1323 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:54.738901 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d0eea7e4-4ab8-44db-a355-93fbc6bf0862 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:54.739506 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d0eea7e4-4ab8-44db-a355-93fbc6bf0862 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:54.745925 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d0eea7e4-4ab8-44db-a355-93fbc6bf0862 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:54.746410 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d0eea7e4-4ab8-44db-a355-93fbc6bf0862 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:54.747002 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d0eea7e4-4ab8-44db-a355-93fbc6bf0862 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:54.747706 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d0eea7e4-4ab8-44db-a355-93fbc6bf0862 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:54.748161 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d0eea7e4-4ab8-44db-a355-93fbc6bf0862 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:54.748582 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d0eea7e4-4ab8-44db-a355-93fbc6bf0862 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:54.824683 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-af692c0b-b0ad-4c06-988f-3e4b04009e33 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:54.825476 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-af692c0b-b0ad-4c06-988f-3e4b04009e33 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:54.833417 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d0eea7e4-4ab8-44db-a355-93fbc6bf0862 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:54.839105 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af692c0b-b0ad-4c06-988f-3e4b04009e33 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:54.843216 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af692c0b-b0ad-4c06-988f-3e4b04009e33 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:54.843216 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af692c0b-b0ad-4c06-988f-3e4b04009e33 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:54.843216 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af692c0b-b0ad-4c06-988f-3e4b04009e33 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:54.845997 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af692c0b-b0ad-4c06-988f-3e4b04009e33 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:54.846914 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af692c0b-b0ad-4c06-988f-3e4b04009e33 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:54.851304 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d0eea7e4-4ab8-44db-a355-93fbc6bf0862 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:54.855787 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d0eea7e4-4ab8-44db-a355-93fbc6bf0862 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:54.869826 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d0eea7e4-4ab8-44db-a355-93fbc6bf0862 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.135303 Aug 22 17:12:54.886745 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 237/439] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:12:54 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:12:54.886979 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=100 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:54.994648 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-063164bc-f5cb-4ed2-915d-31255082b5a2 req-1eb43656-e749-4a49-bc6c-432e73625c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95ed8662-ad0c-43f6-9800-8db34e26243d", "name": "network-vif-plugged", "status": "completed", "tag": "53926e96-e4b6-4b18-aa5b-faf6e595f345"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:55.009544 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-063164bc-f5cb-4ed2-915d-31255082b5a2 req-1eb43656-e749-4a49-bc6c-432e73625c2c service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:55.009544 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-063164bc-f5cb-4ed2-915d-31255082b5a2 req-1eb43656-e749-4a49-bc6c-432e73625c2c service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:55.009544 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-063164bc-f5cb-4ed2-915d-31255082b5a2 req-1eb43656-e749-4a49-bc6c-432e73625c2c service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:55.024436 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-063164bc-f5cb-4ed2-915d-31255082b5a2 req-1eb43656-e749-4a49-bc6c-432e73625c2c service nova] Creating event network-vif-plugged:53926e96-e4b6-4b18-aa5b-faf6e595f345 for instance 95ed8662-ad0c-43f6-9800-8db34e26243d on n-h1-854030-1 Aug 22 17:12:55.030882 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-063164bc-f5cb-4ed2-915d-31255082b5a2 req-1eb43656-e749-4a49-bc6c-432e73625c2c service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040427 Aug 22 17:12:55.032130 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 238/440] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:12:55.049851 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-af692c0b-b0ad-4c06-988f-3e4b04009e33 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:55.057183 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-af692c0b-b0ad-4c06-988f-3e4b04009e33 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1317 microversion: 2.1 time: 0.237247 Aug 22 17:12:55.058064 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 203/441] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:54 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:55.563062 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-eacccbe2-2139-40b5-8efe-af7a631ae9ef tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:55.564195 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-eacccbe2-2139-40b5-8efe-af7a631ae9ef tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:55.568109 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=20 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:55.574607 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eacccbe2-2139-40b5-8efe-af7a631ae9ef tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:55.575428 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eacccbe2-2139-40b5-8efe-af7a631ae9ef tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:55.576052 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eacccbe2-2139-40b5-8efe-af7a631ae9ef tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:55.576984 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eacccbe2-2139-40b5-8efe-af7a631ae9ef tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:55.577877 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eacccbe2-2139-40b5-8efe-af7a631ae9ef tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:55.578308 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eacccbe2-2139-40b5-8efe-af7a631ae9ef tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:55.767712 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-eacccbe2-2139-40b5-8efe-af7a631ae9ef tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:55.776206 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-eacccbe2-2139-40b5-8efe-af7a631ae9ef tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 200 len: 1323 microversion: 2.1 time: 0.219890 Aug 22 17:12:55.790125 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 239/442] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:55 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 1323 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:55.901751 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a0d5b05f-c741-4861-9354-ed2ec075393f tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:55.904416 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-a0d5b05f-c741-4861-9354-ed2ec075393f tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:55.919659 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a0d5b05f-c741-4861-9354-ed2ec075393f tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:55.924249 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a0d5b05f-c741-4861-9354-ed2ec075393f tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:55.924249 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a0d5b05f-c741-4861-9354-ed2ec075393f tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:55.924249 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a0d5b05f-c741-4861-9354-ed2ec075393f tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:55.924249 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a0d5b05f-c741-4861-9354-ed2ec075393f tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:55.925335 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a0d5b05f-c741-4861-9354-ed2ec075393f tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:55.993461 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a0d5b05f-c741-4861-9354-ed2ec075393f tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:56.002508 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a0d5b05f-c741-4861-9354-ed2ec075393f tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:56.005275 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a0d5b05f-c741-4861-9354-ed2ec075393f tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:56.008506 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:INSERT=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:56.012380 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a0d5b05f-c741-4861-9354-ed2ec075393f tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.115127 Aug 22 17:12:56.013767 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 204/443] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:12:55 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:12:56.078765 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7ed568a2-8f55-4b8c-b1ae-963b3fc9ac0a tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:56.079378 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-7ed568a2-8f55-4b8c-b1ae-963b3fc9ac0a tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:56.088885 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7ed568a2-8f55-4b8c-b1ae-963b3fc9ac0a tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:56.089418 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7ed568a2-8f55-4b8c-b1ae-963b3fc9ac0a tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:56.090118 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7ed568a2-8f55-4b8c-b1ae-963b3fc9ac0a tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:56.090888 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7ed568a2-8f55-4b8c-b1ae-963b3fc9ac0a tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:56.091764 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7ed568a2-8f55-4b8c-b1ae-963b3fc9ac0a tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:56.092391 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7ed568a2-8f55-4b8c-b1ae-963b3fc9ac0a tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:56.279280 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-7ed568a2-8f55-4b8c-b1ae-963b3fc9ac0a tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:56.286485 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7ed568a2-8f55-4b8c-b1ae-963b3fc9ac0a tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1317 microversion: 2.1 time: 0.212157 Aug 22 17:12:56.287064 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 240/444] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:56 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:56.821652 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-19f1a196-0f27-4618-b983-2c293918651e tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:56.821652 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-19f1a196-0f27-4618-b983-2c293918651e tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:56.821652 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19f1a196-0f27-4618-b983-2c293918651e tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:56.821652 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19f1a196-0f27-4618-b983-2c293918651e tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:56.822197 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19f1a196-0f27-4618-b983-2c293918651e tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:56.822197 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19f1a196-0f27-4618-b983-2c293918651e tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:56.822197 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19f1a196-0f27-4618-b983-2c293918651e tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:56.822197 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19f1a196-0f27-4618-b983-2c293918651e tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:56.975517 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-19f1a196-0f27-4618-b983-2c293918651e tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:56.983901 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-19f1a196-0f27-4618-b983-2c293918651e tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 200 len: 1323 microversion: 2.1 time: 0.189704 Aug 22 17:12:56.985746 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 205/445] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:56 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 1323 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:57.044550 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7e4cbb4d-0c14-4ac1-b047-dbb14755fded tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:57.045955 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-7e4cbb4d-0c14-4ac1-b047-dbb14755fded tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:57.053628 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7e4cbb4d-0c14-4ac1-b047-dbb14755fded tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:57.054407 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7e4cbb4d-0c14-4ac1-b047-dbb14755fded tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:57.056478 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7e4cbb4d-0c14-4ac1-b047-dbb14755fded tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:57.057799 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7e4cbb4d-0c14-4ac1-b047-dbb14755fded tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:57.058656 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7e4cbb4d-0c14-4ac1-b047-dbb14755fded tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:57.059469 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7e4cbb4d-0c14-4ac1-b047-dbb14755fded tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:57.136072 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-7e4cbb4d-0c14-4ac1-b047-dbb14755fded tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:57.145466 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-7e4cbb4d-0c14-4ac1-b047-dbb14755fded tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:57.147019 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-7e4cbb4d-0c14-4ac1-b047-dbb14755fded tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:57.152184 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7e4cbb4d-0c14-4ac1-b047-dbb14755fded tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.112205 Aug 22 17:12:57.152718 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 241/446] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:12:57 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:12:57.308124 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f148f018-20d3-4197-a455-e9752d337ab7 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:57.309109 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-f148f018-20d3-4197-a455-e9752d337ab7 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:57.321716 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f148f018-20d3-4197-a455-e9752d337ab7 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:57.325398 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f148f018-20d3-4197-a455-e9752d337ab7 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:57.327797 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f148f018-20d3-4197-a455-e9752d337ab7 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:57.330716 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f148f018-20d3-4197-a455-e9752d337ab7 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:57.332128 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f148f018-20d3-4197-a455-e9752d337ab7 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:57.335015 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f148f018-20d3-4197-a455-e9752d337ab7 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:57.662063 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-f148f018-20d3-4197-a455-e9752d337ab7 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:57.673155 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f148f018-20d3-4197-a455-e9752d337ab7 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1317 microversion: 2.1 time: 0.370151 Aug 22 17:12:57.673978 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 206/447] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:57 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:58.009685 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e3aae1b2-88c9-4e1e-b8c1-92c67d45e073 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:58.012070 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e3aae1b2-88c9-4e1e-b8c1-92c67d45e073 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:58.019959 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e3aae1b2-88c9-4e1e-b8c1-92c67d45e073 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.020828 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e3aae1b2-88c9-4e1e-b8c1-92c67d45e073 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.021469 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e3aae1b2-88c9-4e1e-b8c1-92c67d45e073 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.022449 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e3aae1b2-88c9-4e1e-b8c1-92c67d45e073 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.023827 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e3aae1b2-88c9-4e1e-b8c1-92c67d45e073 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.024477 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e3aae1b2-88c9-4e1e-b8c1-92c67d45e073 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.131704 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f9eca29c-7d44-4fee-8350-66978bd0faff tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Calling method '.version_select at 0x7f8009d2b550>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:58.142966 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:58.142966 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:58.147174 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f9eca29c-7d44-4fee-8350-66978bd0faff tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.147664 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f9eca29c-7d44-4fee-8350-66978bd0faff tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.148467 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f9eca29c-7d44-4fee-8350-66978bd0faff tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.150648 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f9eca29c-7d44-4fee-8350-66978bd0faff tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.151112 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f9eca29c-7d44-4fee-8350-66978bd0faff tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.153419 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f9eca29c-7d44-4fee-8350-66978bd0faff tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.234681 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f9eca29c-7d44-4fee-8350-66978bd0faff tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.345638 Aug 22 17:12:58.245764 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 242/448] 10.222.0.96 () {58 vars in 1128 bytes} [Mon Aug 22 17:12:57 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:58.251568 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6ed9c24a-6fb8-4bc2-9da8-dc1ace4494df tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:58.252381 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-6ed9c24a-6fb8-4bc2-9da8-dc1ace4494df tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:58.261154 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6ed9c24a-6fb8-4bc2-9da8-dc1ace4494df tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.261834 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6ed9c24a-6fb8-4bc2-9da8-dc1ace4494df tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.262422 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6ed9c24a-6fb8-4bc2-9da8-dc1ace4494df tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.263289 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6ed9c24a-6fb8-4bc2-9da8-dc1ace4494df tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.263895 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6ed9c24a-6fb8-4bc2-9da8-dc1ace4494df tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.264471 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6ed9c24a-6fb8-4bc2-9da8-dc1ace4494df tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.274916 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e3aae1b2-88c9-4e1e-b8c1-92c67d45e073 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:58.283759 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e3aae1b2-88c9-4e1e-b8c1-92c67d45e073 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 200 len: 1323 microversion: 2.1 time: 0.281698 Aug 22 17:12:58.285011 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 207/449] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:58 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 1323 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:12:58.291871 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-48a91b99-332d-44c9-add7-e5748739bac9 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Calling method '.version_select at 0x7f8009eb8d30>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:58.294805 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:58.294805 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:58.297756 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-48a91b99-332d-44c9-add7-e5748739bac9 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.299618 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-48a91b99-332d-44c9-add7-e5748739bac9 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.300992 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-48a91b99-332d-44c9-add7-e5748739bac9 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.305164 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-48a91b99-332d-44c9-add7-e5748739bac9 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.305164 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-48a91b99-332d-44c9-add7-e5748739bac9 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.305164 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-48a91b99-332d-44c9-add7-e5748739bac9 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.335808 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-48a91b99-332d-44c9-add7-e5748739bac9 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.049490 Aug 22 17:12:58.336772 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 208/450] 10.222.0.96 () {58 vars in 1139 bytes} [Mon Aug 22 17:12:58 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:58.351743 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7bbf601a-c963-479c-802f-09d6926fa130 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Calling method '.version_select at 0x7f800a0e4af0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:58.354799 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:58.354799 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:58.356252 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7bbf601a-c963-479c-802f-09d6926fa130 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.356812 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7bbf601a-c963-479c-802f-09d6926fa130 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.357483 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7bbf601a-c963-479c-802f-09d6926fa130 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.358426 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7bbf601a-c963-479c-802f-09d6926fa130 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.359088 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7bbf601a-c963-479c-802f-09d6926fa130 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.359748 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7bbf601a-c963-479c-802f-09d6926fa130 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.371565 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6ed9c24a-6fb8-4bc2-9da8-dc1ace4494df tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:58.386550 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6ed9c24a-6fb8-4bc2-9da8-dc1ace4494df tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:58.388454 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6ed9c24a-6fb8-4bc2-9da8-dc1ace4494df tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:58.401325 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7bbf601a-c963-479c-802f-09d6926fa130 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.044693 Aug 22 17:12:58.401325 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 209/451] 10.222.0.96 () {58 vars in 1145 bytes} [Mon Aug 22 17:12:58 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 22 17:12:58.401699 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6ed9c24a-6fb8-4bc2-9da8-dc1ace4494df tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.154253 Aug 22 17:12:58.404567 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 243/452] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:12:58 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:12:58.425509 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-67191b99-c1e7-4fc6-84fa-6ef0d95514b5 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Calling method '.version_select at 0x7f8009eb8430>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:58.429119 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:58.429119 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:58.430667 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-67191b99-c1e7-4fc6-84fa-6ef0d95514b5 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.430990 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-67191b99-c1e7-4fc6-84fa-6ef0d95514b5 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.432363 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-67191b99-c1e7-4fc6-84fa-6ef0d95514b5 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.433420 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-67191b99-c1e7-4fc6-84fa-6ef0d95514b5 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.439410 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-67191b99-c1e7-4fc6-84fa-6ef0d95514b5 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.439410 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-67191b99-c1e7-4fc6-84fa-6ef0d95514b5 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.466136 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-67191b99-c1e7-4fc6-84fa-6ef0d95514b5 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.059482 Aug 22 17:12:58.467217 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 210/453] 10.222.0.96 () {58 vars in 1128 bytes} [Mon Aug 22 17:12:58 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:58.482124 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6ef6b026-db04-429b-afc6-a349ad268f4c tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Calling method '.version_select at 0x7f8009e4cc10>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:58.485425 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:58.485425 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:58.487010 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6ef6b026-db04-429b-afc6-a349ad268f4c tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.488595 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6ef6b026-db04-429b-afc6-a349ad268f4c tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.490285 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6ef6b026-db04-429b-afc6-a349ad268f4c tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.490832 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6ef6b026-db04-429b-afc6-a349ad268f4c tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.493286 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6ef6b026-db04-429b-afc6-a349ad268f4c tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.494331 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6ef6b026-db04-429b-afc6-a349ad268f4c tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.578915 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6ef6b026-db04-429b-afc6-a349ad268f4c tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.093592 Aug 22 17:12:58.583597 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 244/454] 10.222.0.96 () {58 vars in 1155 bytes} [Mon Aug 22 17:12:58 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:58.594340 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2b308b41-48b8-427f-85b6-77c2cbce2a94 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Calling method '.version_select at 0x7f8009e4e280>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:58.597655 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:58.597655 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:12:58.599183 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2b308b41-48b8-427f-85b6-77c2cbce2a94 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.602353 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2b308b41-48b8-427f-85b6-77c2cbce2a94 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.603036 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2b308b41-48b8-427f-85b6-77c2cbce2a94 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.603977 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2b308b41-48b8-427f-85b6-77c2cbce2a94 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.607200 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2b308b41-48b8-427f-85b6-77c2cbce2a94 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.608059 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2b308b41-48b8-427f-85b6-77c2cbce2a94 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.643824 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2b308b41-48b8-427f-85b6-77c2cbce2a94 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.052468 Aug 22 17:12:58.645114 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 211/455] 10.222.0.96 () {58 vars in 1128 bytes} [Mon Aug 22 17:12:58 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:58.656534 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-126980e2-fa52-4a25-b816-b347d4dcfb01 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Calling method '.version_select at 0x7f8009cf94c0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:58.656534 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:58.656534 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:58.667743 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-126980e2-fa52-4a25-b816-b347d4dcfb01 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.667743 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-126980e2-fa52-4a25-b816-b347d4dcfb01 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.669040 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-126980e2-fa52-4a25-b816-b347d4dcfb01 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.686054 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-126980e2-fa52-4a25-b816-b347d4dcfb01 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.686763 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-126980e2-fa52-4a25-b816-b347d4dcfb01 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.687203 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-126980e2-fa52-4a25-b816-b347d4dcfb01 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.703568 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-126980e2-fa52-4a25-b816-b347d4dcfb01 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hosts/n-h2-854030-1" status: 200 len: 467 microversion: 2.1 time: 0.052272 Aug 22 17:12:58.707903 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 245/456] 10.222.0.96 () {58 vars in 1170 bytes} [Mon Aug 22 17:12:58 2022] GET /compute/v2.1/os-hosts/n-h2-854030-1 => generated 467 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:12:58.708121 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ef73a87c-99aa-493a-bfb6-a63f9e353118 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:58.708121 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-ef73a87c-99aa-493a-bfb6-a63f9e353118 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:58.713757 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ef73a87c-99aa-493a-bfb6-a63f9e353118 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.714236 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ef73a87c-99aa-493a-bfb6-a63f9e353118 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.714661 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ef73a87c-99aa-493a-bfb6-a63f9e353118 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.716237 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ef73a87c-99aa-493a-bfb6-a63f9e353118 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.717129 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ef73a87c-99aa-493a-bfb6-a63f9e353118 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.717793 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ef73a87c-99aa-493a-bfb6-a63f9e353118 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.718602 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-402db7aa-3ea8-4583-8200-397c0eceb600 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Calling method '.version_select at 0x7f8009df0f70>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:58.719826 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:58.719826 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:58.728112 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-402db7aa-3ea8-4583-8200-397c0eceb600 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.728672 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-402db7aa-3ea8-4583-8200-397c0eceb600 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.729288 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-402db7aa-3ea8-4583-8200-397c0eceb600 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.743211 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-402db7aa-3ea8-4583-8200-397c0eceb600 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:58.743705 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-402db7aa-3ea8-4583-8200-397c0eceb600 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:58.744241 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-402db7aa-3ea8-4583-8200-397c0eceb600 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:58.764166 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-402db7aa-3ea8-4583-8200-397c0eceb600 tempest-HostsAdminTestJSON-1896312807 tempest-HostsAdminTestJSON-1896312807-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hosts/n-h1-854030-1" status: 200 len: 598 microversion: 2.1 time: 0.050631 Aug 22 17:12:58.772675 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 246/457] 10.222.0.96 () {58 vars in 1170 bytes} [Mon Aug 22 17:12:58 2022] GET /compute/v2.1/os-hosts/n-h1-854030-1 => generated 598 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:12:58.950187 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ef73a87c-99aa-493a-bfb6-a63f9e353118 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:12:58.961490 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ef73a87c-99aa-493a-bfb6-a63f9e353118 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1467 microversion: 2.1 time: 0.258897 Aug 22 17:12:58.962488 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 212/458] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:58 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1467 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:12:59.365958 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-18c41559-2f93-48b7-a4de-550d4628f5c0 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Calling method '.version_select at 0x7f8009f28d30>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:59.369531 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:12:59.369531 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:12:59.373057 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18c41559-2f93-48b7-a4de-550d4628f5c0 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:59.373576 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18c41559-2f93-48b7-a4de-550d4628f5c0 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:59.375434 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18c41559-2f93-48b7-a4de-550d4628f5c0 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:59.447533 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18c41559-2f93-48b7-a4de-550d4628f5c0 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:59.453236 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18c41559-2f93-48b7-a4de-550d4628f5c0 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:59.458509 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18c41559-2f93-48b7-a4de-550d4628f5c0 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:59.504505 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:12:59.508128 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18c41559-2f93-48b7-a4de-550d4628f5c0 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:59.508851 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18c41559-2f93-48b7-a4de-550d4628f5c0 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:59.512060 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18c41559-2f93-48b7-a4de-550d4628f5c0 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:59.538266 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18c41559-2f93-48b7-a4de-550d4628f5c0 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:59.538266 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18c41559-2f93-48b7-a4de-550d4628f5c0 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:59.538266 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18c41559-2f93-48b7-a4de-550d4628f5c0 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:59.540112 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-51719e84-ab27-4d76-be3d-7f705ab71e3d tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-2047973732", "block_migration": true, "disk_over_commit": false}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:12:59.545721 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-51719e84-ab27-4d76-be3d-7f705ab71e3d tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:59.558478 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-51719e84-ab27-4d76-be3d-7f705ab71e3d tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:59.559172 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-51719e84-ab27-4d76-be3d-7f705ab71e3d tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:59.559766 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-51719e84-ab27-4d76-be3d-7f705ab71e3d tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:59.561014 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-51719e84-ab27-4d76-be3d-7f705ab71e3d tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:59.561752 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-51719e84-ab27-4d76-be3d-7f705ab71e3d tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:59.562591 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-51719e84-ab27-4d76-be3d-7f705ab71e3d tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:59.621325 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18c41559-2f93-48b7-a4de-550d4628f5c0 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:59.621838 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18c41559-2f93-48b7-a4de-550d4628f5c0 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:59.622311 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18c41559-2f93-48b7-a4de-550d4628f5c0 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:59.640419 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-18c41559-2f93-48b7-a4de-550d4628f5c0 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1837 microversion: 2.53 time: 0.778238 Aug 22 17:12:59.650506 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 247/459] 10.222.0.96 () {60 vars in 1243 bytes} [Mon Aug 22 17:12:58 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1837 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:12:59.658601 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d61269a4-21af-441c-9eec-ca11f2994527 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:59.660010 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d61269a4-21af-441c-9eec-ca11f2994527 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:59.670054 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d61269a4-21af-441c-9eec-ca11f2994527 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:59.673935 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d61269a4-21af-441c-9eec-ca11f2994527 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:59.673935 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d61269a4-21af-441c-9eec-ca11f2994527 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:59.676741 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d61269a4-21af-441c-9eec-ca11f2994527 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:59.677539 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d61269a4-21af-441c-9eec-ca11f2994527 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:59.681338 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d61269a4-21af-441c-9eec-ca11f2994527 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:59.782289 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-51719e84-ab27-4d76-be3d-7f705ab71e3d tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-68a006a9-d478-4109-a85b-71a82b8fb709) Aug 22 17:12:59.782289 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:59.782289 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:59.782289 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:59.782289 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:59.782289 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:59.782289 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:59.782289 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:59.782289 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:59.782289 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:59.782289 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 22 17:12:59.782289 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 22 17:12:59.782289 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 22 17:12:59.782289 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 22 17:12:59.782289 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 22 17:12:59.783470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 22 17:12:59.783470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 22 17:12:59.783470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:12:59.783470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:12:59.783470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:12:59.783470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:12:59.783470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:12:59.783470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:12:59.783470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:59.783470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:59.783470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:12:59.783470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:12:59.783470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:59.783470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:59.783470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:12:59.783470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:12:59.783470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:59.783470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:59.784590 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:12:59.784590 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:12:59.784590 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:59.784590 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:59.784590 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:12:59.784590 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:12:59.784590 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:12:59.784590 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:12:59.784590 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:12:59.784590 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:12:59.784590 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:12:59.784590 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:12:59.784590 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:12:59.784590 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:12:59.784590 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:12:59.784590 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:12:59.784590 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:12:59.785755 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:12:59.785755 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:12:59.785755 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:12:59.785755 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:12:59.785755 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:12:59.785755 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:12:59.785755 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:12:59.785755 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:12:59.785755 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:12:59.785755 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:12:59.785755 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:12:59.785755 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:12:59.785755 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:12:59.785755 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-68a006a9-d478-4109-a85b-71a82b8fb709) Aug 22 17:12:59.785755 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:59.788431 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-51719e84-ab27-4d76-be3d-7f705ab71e3d tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:59.788431 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-51719e84-ab27-4d76-be3d-7f705ab71e3d tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Request method failure captured: Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d/action HTTP/1.1 Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 107 Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7kBhyod12RGcNU-WUZ0o_o_HCRo3w1SIKSQeIrAkn8ptVXGOeWNIvLdGWp34ScIqjDtAk5KBXEORWIWnuVJgnl0iAc9rYjnPOZwuIZKQhuD_bZi8txcBfQVUECDgSFlhWAzw18DSR9vSduZw8KEym0DA7Clb9FJaAZLJ89OPzRO2qg Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 6a43513f11634ebfa97cbb1891729585 Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-LiveMigrationNegativeTest-2422917 Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:12:59.791060 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:12:59.795703 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/6a43513f11634ebfa97cbb1891729585"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_6a43513f11634ebfa97cbb1891729585", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/6a43513f11634ebfa97cbb1891729585"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/6a43513f11634ebfa97cbb1891729585"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:12:59.795703 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-LiveMigrationNegativeTest-2422917 Aug 22 17:12:59.795703 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 6a43513f11634ebfa97cbb1891729585 Aug 22 17:12:59.795703 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2422917 Aug 22 17:12:59.795703 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-LiveMigrationNegativeTest-2422917-project-admin Aug 22 17:12:59.795703 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:12:59.795703 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:12:59.795703 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 9525982cdc2f4dfbac525fa6e6063513 Aug 22 17:12:59.795703 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-LiveMigrationNegativeTest-2422917-project-admin Aug 22 17:12:59.795703 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:12:59.795703 n-d-854030-1 devstack@n-api.service[123016]: {"os-migrateLive": {"host": "tempest-host-2047973732", "block_migration": true, "disk_over_commit": false}} Aug 22 17:12:59.795703 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:12:59.796625 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:59.796625 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:12:59.796625 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '95ed8662-ad0c-43f6-9800-8db34e26243d', 'body': {'os-migrateLive': {'host': 'tempest-host-2047973732', 'block_migration': True, 'disk_over_commit': False}}} Aug 22 17:12:59.796625 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:12:59.796625 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:59.796625 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:12:59.796625 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:12:59.796625 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:59.796625 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:59.796625 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:59.796625 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:59.796625 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:12:59.796625 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:12:59.796625 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 22 17:12:59.796625 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 22 17:12:59.796625 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 22 17:12:59.796625 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 22 17:12:59.796625 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 22 17:12:59.796625 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 22 17:12:59.797826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 22 17:12:59.797826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:12:59.797826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:12:59.797826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:12:59.797826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:12:59.797826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:12:59.797826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:12:59.797826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:59.797826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:59.797826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:12:59.797826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:12:59.797826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:59.797826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:59.797826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:12:59.797826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:12:59.797826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:59.797826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:59.797826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:12:59.798879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:12:59.798879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:12:59.798879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:12:59.798879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:12:59.798879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:12:59.798879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:12:59.798879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:12:59.798879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:12:59.798879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:12:59.798879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:12:59.798879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:12:59.798879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:12:59.798879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:12:59.798879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:12:59.798879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:12:59.798879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:12:59.798879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:12:59.799981 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:12:59.799981 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:12:59.799981 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:12:59.799981 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:12:59.799981 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:12:59.799981 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:12:59.799981 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:12:59.799981 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:12:59.799981 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:12:59.799981 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:12:59.799981 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:12:59.799981 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:12:59.799981 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-68a006a9-d478-4109-a85b-71a82b8fb709) Aug 22 17:12:59.799981 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:59.799981 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:59.799981 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:59.800931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:12:59.804640 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-51719e84-ab27-4d76-be3d-7f705ab71e3d tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:12:59.804640 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:12:59.804640 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-51719e84-ab27-4d76-be3d-7f705ab71e3d tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d/action" status: 500 len: 214 microversion: 2.1 time: 0.803016 Aug 22 17:12:59.804640 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 213/460] 10.222.0.96 () {60 vars in 1279 bytes} [Mon Aug 22 17:12:58 2022] POST /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d/action => generated 214 bytes in 804 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:12:59.809966 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ca8ef20b-c22f-4957-bcff-925936a8565b tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:12:59.811098 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-ca8ef20b-c22f-4957-bcff-925936a8565b tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:12:59.818774 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ca8ef20b-c22f-4957-bcff-925936a8565b tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:59.819635 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ca8ef20b-c22f-4957-bcff-925936a8565b tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:59.820334 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ca8ef20b-c22f-4957-bcff-925936a8565b tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:59.821359 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ca8ef20b-c22f-4957-bcff-925936a8565b tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:12:59.822155 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ca8ef20b-c22f-4957-bcff-925936a8565b tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:12:59.822865 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ca8ef20b-c22f-4957-bcff-925936a8565b tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:12:59.996902 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d61269a4-21af-441c-9eec-ca11f2994527 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:00.011528 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d61269a4-21af-441c-9eec-ca11f2994527 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 200 len: 1323 microversion: 2.1 time: 0.358931 Aug 22 17:13:00.012583 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 248/461] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:12:59 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 1323 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:00.017558 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-21a056ed-454b-445d-8840-5eb2a8cb0270 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Calling method '.version_select at 0x7f8009f28d30>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:00.025649 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ca8ef20b-c22f-4957-bcff-925936a8565b tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:00.044705 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:00.044705 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:13:00.046185 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-21a056ed-454b-445d-8840-5eb2a8cb0270 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:00.048207 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-21a056ed-454b-445d-8840-5eb2a8cb0270 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:00.048766 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-21a056ed-454b-445d-8840-5eb2a8cb0270 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:00.049182 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ca8ef20b-c22f-4957-bcff-925936a8565b tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:00.054138 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ca8ef20b-c22f-4957-bcff-925936a8565b tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:00.066836 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ca8ef20b-c22f-4957-bcff-925936a8565b tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.272260 Aug 22 17:13:00.070501 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 214/462] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:12:59 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:00.077858 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-963f1f7f-30c0-42da-a9fb-bb992b73584d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1327573308", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:00.086862 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-21a056ed-454b-445d-8840-5eb2a8cb0270 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:00.087693 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-21a056ed-454b-445d-8840-5eb2a8cb0270 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:00.088383 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-21a056ed-454b-445d-8840-5eb2a8cb0270 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:00.153782 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-21a056ed-454b-445d-8840-5eb2a8cb0270 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:00.154451 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-21a056ed-454b-445d-8840-5eb2a8cb0270 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:00.155069 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-21a056ed-454b-445d-8840-5eb2a8cb0270 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:00.190760 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-963f1f7f-30c0-42da-a9fb-bb992b73584d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] validate_networks() for None {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:13:00.205862 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-21a056ed-454b-445d-8840-5eb2a8cb0270 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:00.206350 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-21a056ed-454b-445d-8840-5eb2a8cb0270 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:00.209155 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-21a056ed-454b-445d-8840-5eb2a8cb0270 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:00.281792 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-21a056ed-454b-445d-8840-5eb2a8cb0270 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:00.282309 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-21a056ed-454b-445d-8840-5eb2a8cb0270 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:00.282760 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-21a056ed-454b-445d-8840-5eb2a8cb0270 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:00.304447 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-21a056ed-454b-445d-8840-5eb2a8cb0270 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.289802 Aug 22 17:13:00.305913 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 249/463] 10.222.0.96 () {60 vars in 1222 bytes} [Mon Aug 22 17:13:00 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:13:00.331109 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-29aacad5-e97c-4c41-9a23-5a135df0bf68 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Calling method '.version_select at 0x7f8009e675e0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:00.334173 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:00.334173 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:13:00.342473 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-29aacad5-e97c-4c41-9a23-5a135df0bf68 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:00.344425 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-29aacad5-e97c-4c41-9a23-5a135df0bf68 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:00.345470 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-29aacad5-e97c-4c41-9a23-5a135df0bf68 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:00.380480 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-29aacad5-e97c-4c41-9a23-5a135df0bf68 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:00.382325 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-29aacad5-e97c-4c41-9a23-5a135df0bf68 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:00.382964 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-29aacad5-e97c-4c41-9a23-5a135df0bf68 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:00.402544 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-29aacad5-e97c-4c41-9a23-5a135df0bf68 tempest-HypervisorAdminV253TestBase-278810017 tempest-HypervisorAdminV253TestBase-278810017-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/190c2828-63d8-4621-a18d-73826677ef3c" status: 200 len: 793 microversion: 2.53 time: 0.088094 Aug 22 17:13:00.421769 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 250/464] 10.222.0.96 () {60 vars in 1298 bytes} [Mon Aug 22 17:13:00 2022] GET /compute/v2.1/os-hypervisors/190c2828-63d8-4621-a18d-73826677ef3c => generated 793 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:13:00.800469 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-963f1f7f-30c0-42da-a9fb-bb992b73584d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:13:00.801521 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-963f1f7f-30c0-42da-a9fb-bb992b73584d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:13:00.802331 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-963f1f7f-30c0-42da-a9fb-bb992b73584d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:13:00.802928 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-963f1f7f-30c0-42da-a9fb-bb992b73584d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:13:00.803522 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-963f1f7f-30c0-42da-a9fb-bb992b73584d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:13:00.820718 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-963f1f7f-30c0-42da-a9fb-bb992b73584d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:00.821536 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-963f1f7f-30c0-42da-a9fb-bb992b73584d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:00.822891 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-963f1f7f-30c0-42da-a9fb-bb992b73584d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:00.823885 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-963f1f7f-30c0-42da-a9fb-bb992b73584d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:00.828395 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-963f1f7f-30c0-42da-a9fb-bb992b73584d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:00.829130 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-963f1f7f-30c0-42da-a9fb-bb992b73584d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:00.870913 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-963f1f7f-30c0-42da-a9fb-bb992b73584d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Getting quotas for project 10f3e01147404b6a86ef50f3d441841a. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:13:00.879758 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-963f1f7f-30c0-42da-a9fb-bb992b73584d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Getting quotas for user 35652618557443a4a1dbfb3e0028f0c7 and project 10f3e01147404b6a86ef50f3d441841a. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:13:00.896931 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-963f1f7f-30c0-42da-a9fb-bb992b73584d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Going to run 1 instances... {{(pid=123016) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:13:00.899360 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-963f1f7f-30c0-42da-a9fb-bb992b73584d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:13:00.938429 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-936e3f9b-4c77-450d-847b-85dd85da3c74 tempest-NetworksTest-1869231773 tempest-NetworksTest-1869231773-project-admin] Calling method '.version_select at 0x7f8009df00d0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:01.132094 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-963f1f7f-30c0-42da-a9fb-bb992b73584d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.060142 Aug 22 17:13:01.135279 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-936e3f9b-4c77-450d-847b-85dd85da3c74 tempest-NetworksTest-1869231773 tempest-NetworksTest-1869231773-project-admin] 10.222.0.96 "GET /compute/v2.1/os-networks" status: 200 len: 4003 microversion: 2.1 time: 0.375282 Aug 22 17:13:01.140245 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 215/466] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:13:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:13:01.142804 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 251/466] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:13:00 2022] GET /compute/v2.1/os-networks => generated 4003 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:13:01.148870 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-dc3a2b59-561b-407c-820f-ec96c1d834fd tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:01.149523 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-e38c2ee4-8e59-486e-ae1f-bb568892cc18 req-21291347-7b71-4f16-8194-137452b343b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791d0306-dc08-4e10-81c8-003730a5ce09", "name": "network-vif-plugged", "status": "completed", "tag": "6e59f300-cd40-4f3d-b25e-eb03e04d54d6"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:01.149707 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-dc3a2b59-561b-407c-820f-ec96c1d834fd tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:01.168772 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dc3a2b59-561b-407c-820f-ec96c1d834fd tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:01.169351 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dc3a2b59-561b-407c-820f-ec96c1d834fd tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:01.169849 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dc3a2b59-561b-407c-820f-ec96c1d834fd tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:01.170514 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dc3a2b59-561b-407c-820f-ec96c1d834fd tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:01.170971 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dc3a2b59-561b-407c-820f-ec96c1d834fd tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:01.179906 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dc3a2b59-561b-407c-820f-ec96c1d834fd tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:01.210601 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-e38c2ee4-8e59-486e-ae1f-bb568892cc18 req-21291347-7b71-4f16-8194-137452b343b7 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:01.211104 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-e38c2ee4-8e59-486e-ae1f-bb568892cc18 req-21291347-7b71-4f16-8194-137452b343b7 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:01.211541 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-e38c2ee4-8e59-486e-ae1f-bb568892cc18 req-21291347-7b71-4f16-8194-137452b343b7 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:01.227455 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-e38c2ee4-8e59-486e-ae1f-bb568892cc18 req-21291347-7b71-4f16-8194-137452b343b7 service nova] Creating event network-vif-plugged:6e59f300-cd40-4f3d-b25e-eb03e04d54d6 for instance 791d0306-dc08-4e10-81c8-003730a5ce09 on n-h1-854030-1 Aug 22 17:13:01.233613 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-e38c2ee4-8e59-486e-ae1f-bb568892cc18 req-21291347-7b71-4f16-8194-137452b343b7 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091421 Aug 22 17:13:01.244969 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 216/467] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:01.245771 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ed02e0aa-f324-4635-87df-18b11e7adc64 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:01.246643 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-ed02e0aa-f324-4635-87df-18b11e7adc64 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:01.256835 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ed02e0aa-f324-4635-87df-18b11e7adc64 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:01.257576 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ed02e0aa-f324-4635-87df-18b11e7adc64 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:01.258237 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ed02e0aa-f324-4635-87df-18b11e7adc64 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:01.259413 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ed02e0aa-f324-4635-87df-18b11e7adc64 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:01.260345 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ed02e0aa-f324-4635-87df-18b11e7adc64 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:01.261013 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ed02e0aa-f324-4635-87df-18b11e7adc64 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:01.614521 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-dc3a2b59-561b-407c-820f-ec96c1d834fd tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:01.625730 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ed02e0aa-f324-4635-87df-18b11e7adc64 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:01.635520 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-dc3a2b59-561b-407c-820f-ec96c1d834fd tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 200 len: 1323 microversion: 2.1 time: 0.490677 Aug 22 17:13:01.639159 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 252/468] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:01 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 1323 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:01.647150 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-58da7cbc-e361-4eb5-ae2f-04ce9cbf37e9 tempest-NetworksTest-1869231773 tempest-NetworksTest-1869231773-project-admin] Calling method '.version_select at 0x7f8009e4c430>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:01.654011 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ed02e0aa-f324-4635-87df-18b11e7adc64 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:01.657042 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ed02e0aa-f324-4635-87df-18b11e7adc64 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:01.675494 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ed02e0aa-f324-4635-87df-18b11e7adc64 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.431659 Aug 22 17:13:01.677321 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 217/469] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:01 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:01.706066 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2827c1e6-ec7c-4cb6-9bd5-98023e905e6b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:01.707187 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-2827c1e6-ec7c-4cb6-9bd5-98023e905e6b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:01.999636 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-58da7cbc-e361-4eb5-ae2f-04ce9cbf37e9 tempest-NetworksTest-1869231773 tempest-NetworksTest-1869231773-project-admin] 10.222.0.96 "GET /compute/v2.1/os-networks/4c455958-7695-4977-9814-9d02d094e4ed" status: 200 len: 652 microversion: 2.1 time: 0.358902 Aug 22 17:13:02.000837 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 253/470] 10.222.0.96 () {58 vars in 1248 bytes} [Mon Aug 22 17:13:01 2022] GET /compute/v2.1/os-networks/4c455958-7695-4977-9814-9d02d094e4ed => generated 652 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:02.014336 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-22c6a355-009a-44cc-b1fd-a7cba16b1b72 tempest-NetworksTest-1869231773 tempest-NetworksTest-1869231773-project-admin] Calling method '.version_select at 0x7f8009e4cf70>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:02.014491 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-2827c1e6-ec7c-4cb6-9bd5-98023e905e6b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:02.024190 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2827c1e6-ec7c-4cb6-9bd5-98023e905e6b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1219 microversion: 2.1 time: 0.345768 Aug 22 17:13:02.024979 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 218/471] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:01 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1219 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:02.289933 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-22c6a355-009a-44cc-b1fd-a7cba16b1b72 tempest-NetworksTest-1869231773 tempest-NetworksTest-1869231773-project-admin] 10.222.0.96 "GET /compute/v2.1/os-networks" status: 200 len: 4003 microversion: 2.1 time: 0.284085 Aug 22 17:13:02.296461 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 254/472] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:13:02 2022] GET /compute/v2.1/os-networks => generated 4003 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:02.659873 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1daaa603-4886-479f-ab09-77787b174603 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:02.660594 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-1daaa603-4886-479f-ab09-77787b174603 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:02.667525 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1daaa603-4886-479f-ab09-77787b174603 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:02.668255 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1daaa603-4886-479f-ab09-77787b174603 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:02.668703 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1daaa603-4886-479f-ab09-77787b174603 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:02.669450 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1daaa603-4886-479f-ab09-77787b174603 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:02.669916 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1daaa603-4886-479f-ab09-77787b174603 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:02.670347 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1daaa603-4886-479f-ab09-77787b174603 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:02.707316 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1102ac83-687b-400e-a156-f7e0413c4405 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:02.707918 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-1102ac83-687b-400e-a156-f7e0413c4405 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:02.714272 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1102ac83-687b-400e-a156-f7e0413c4405 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:02.715124 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1102ac83-687b-400e-a156-f7e0413c4405 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:02.716067 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1102ac83-687b-400e-a156-f7e0413c4405 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:02.717125 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1102ac83-687b-400e-a156-f7e0413c4405 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:02.717796 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1102ac83-687b-400e-a156-f7e0413c4405 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:02.719029 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1102ac83-687b-400e-a156-f7e0413c4405 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:02.745249 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=100 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:02.830248 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1102ac83-687b-400e-a156-f7e0413c4405 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:02.856901 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1102ac83-687b-400e-a156-f7e0413c4405 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:02.869630 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1102ac83-687b-400e-a156-f7e0413c4405 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:02.888007 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1102ac83-687b-400e-a156-f7e0413c4405 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.185267 Aug 22 17:13:02.891135 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 255/473] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:02 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:13:02.900747 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-1daaa603-4886-479f-ab09-77787b174603 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:02.917819 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1daaa603-4886-479f-ab09-77787b174603 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 200 len: 1323 microversion: 2.1 time: 0.261267 Aug 22 17:13:02.919311 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 219/474] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:02 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 1323 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:03.053266 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cdb451c3-46d1-47cb-91ce-c7482c44855e tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:03.054549 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-cdb451c3-46d1-47cb-91ce-c7482c44855e tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:03.070933 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cdb451c3-46d1-47cb-91ce-c7482c44855e tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:03.085737 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cdb451c3-46d1-47cb-91ce-c7482c44855e tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:03.087421 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cdb451c3-46d1-47cb-91ce-c7482c44855e tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:03.089926 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cdb451c3-46d1-47cb-91ce-c7482c44855e tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:03.091745 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cdb451c3-46d1-47cb-91ce-c7482c44855e tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:03.093030 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cdb451c3-46d1-47cb-91ce-c7482c44855e tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:03.199132 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-cdb451c3-46d1-47cb-91ce-c7482c44855e tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:03.208056 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-cdb451c3-46d1-47cb-91ce-c7482c44855e tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1223 microversion: 2.1 time: 0.166157 Aug 22 17:13:03.209933 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 256/475] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:03 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1223 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:03.921792 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-59a3951a-0c49-4270-9910-bba7efafa4b4 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:03.922472 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-59a3951a-0c49-4270-9910-bba7efafa4b4 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:03.940493 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-60aafaa7-2dc2-4cd0-b45c-6507c37aae69 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:03.941244 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-60aafaa7-2dc2-4cd0-b45c-6507c37aae69 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:03.956112 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-60aafaa7-2dc2-4cd0-b45c-6507c37aae69 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:03.956981 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-60aafaa7-2dc2-4cd0-b45c-6507c37aae69 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:03.957530 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-60aafaa7-2dc2-4cd0-b45c-6507c37aae69 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:03.964755 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-60aafaa7-2dc2-4cd0-b45c-6507c37aae69 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:03.964755 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-60aafaa7-2dc2-4cd0-b45c-6507c37aae69 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:03.964755 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-60aafaa7-2dc2-4cd0-b45c-6507c37aae69 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:03.965786 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-59a3951a-0c49-4270-9910-bba7efafa4b4 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:03.965786 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-59a3951a-0c49-4270-9910-bba7efafa4b4 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:03.965786 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-59a3951a-0c49-4270-9910-bba7efafa4b4 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:03.965786 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-59a3951a-0c49-4270-9910-bba7efafa4b4 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:03.968240 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-59a3951a-0c49-4270-9910-bba7efafa4b4 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:03.970212 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-59a3951a-0c49-4270-9910-bba7efafa4b4 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:04.179119 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-59a3951a-0c49-4270-9910-bba7efafa4b4 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:04.193343 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-59a3951a-0c49-4270-9910-bba7efafa4b4 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:04.208095 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-59a3951a-0c49-4270-9910-bba7efafa4b4 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:04.222389 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-59a3951a-0c49-4270-9910-bba7efafa4b4 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.305354 Aug 22 17:13:04.237243 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 220/476] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:03 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:04.243275 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d2467eb5-aeda-49fe-829f-e7d0448425d3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:04.244269 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-d2467eb5-aeda-49fe-829f-e7d0448425d3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:04.261572 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d2467eb5-aeda-49fe-829f-e7d0448425d3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:04.264451 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d2467eb5-aeda-49fe-829f-e7d0448425d3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:04.265853 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d2467eb5-aeda-49fe-829f-e7d0448425d3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:04.270530 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d2467eb5-aeda-49fe-829f-e7d0448425d3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:04.272322 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d2467eb5-aeda-49fe-829f-e7d0448425d3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:04.273794 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d2467eb5-aeda-49fe-829f-e7d0448425d3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:04.364973 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-60aafaa7-2dc2-4cd0-b45c-6507c37aae69 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:04.377168 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-60aafaa7-2dc2-4cd0-b45c-6507c37aae69 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 200 len: 1473 microversion: 2.1 time: 0.440338 Aug 22 17:13:04.379697 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 257/477] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:03 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 1473 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:13:04.402174 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-77375c99-3bad-49e0-a405-17d09cd4cda9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:04.402174 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-77375c99-3bad-49e0-a405-17d09cd4cda9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:04.426493 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-77375c99-3bad-49e0-a405-17d09cd4cda9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:04.431756 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-77375c99-3bad-49e0-a405-17d09cd4cda9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:04.431756 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-77375c99-3bad-49e0-a405-17d09cd4cda9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:04.431756 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-77375c99-3bad-49e0-a405-17d09cd4cda9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:04.449507 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-77375c99-3bad-49e0-a405-17d09cd4cda9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:04.450230 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-77375c99-3bad-49e0-a405-17d09cd4cda9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:04.515726 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-77375c99-3bad-49e0-a405-17d09cd4cda9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-77375c99-3bad-49e0-a405-17d09cd4cda9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Request method failure captured: Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09/diagnostics HTTP/1.1 Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7kHHOiDzNKoLiSQd__0MqSg7wOQ4qsJzbrjVj758Ga1y09Z-xTQ0mQ8rRKFddQdmdfYMJUnAqTsEPzF8gzlKdj3VU652BZGA1u2kxzPh14HJvKoGVrNZmf3_BnurYa5XGzv3XkT5uxDKagQGwf2-vSfdUvV0BBU-mj5kSMuN44pKxw Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: b5c2cfdafd4547d9bca73946ae404f9d Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-804153059 Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:13:04.519904 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:13:04.521666 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/b5c2cfdafd4547d9bca73946ae404f9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_b5c2cfdafd4547d9bca73946ae404f9d", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/b5c2cfdafd4547d9bca73946ae404f9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/b5c2cfdafd4547d9bca73946ae404f9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:04.521666 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-804153059 Aug 22 17:13:04.521666 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: b5c2cfdafd4547d9bca73946ae404f9d Aug 22 17:13:04.521666 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-804153059 Aug 22 17:13:04.521666 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServerDiagnosticsNegativeTest-804153059-project Aug 22 17:13:04.521666 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:04.521666 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:04.521666 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: a7f796c0f6b643eb8d717afc1006b584 Aug 22 17:13:04.521666 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-804153059-project Aug 22 17:13:04.521666 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:13:04.521666 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'server_id': '791d0306-dc08-4e10-81c8-003730a5ce09'} Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:13:04.522409 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:13:04.523677 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:13:04.523677 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:13:04.523677 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:13:04.523677 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:13:04.523677 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:13:04.523677 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 22 17:13:04.523677 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:04.523677 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:04.523677 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:04.523677 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:04.523677 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:04.523677 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:04.523677 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:13:04.523677 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:13:04.523677 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 22 17:13:04.523677 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:04.523677 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-77375c99-3bad-49e0-a405-17d09cd4cda9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:04.524823 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-77375c99-3bad-49e0-a405-17d09cd4cda9 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.124357 Aug 22 17:13:04.526478 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 258/478] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:13:04 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09/diagnostics => generated 117 bytes in 130 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:04.533818 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3196b3c7-6401-49ed-ae71-f40a62652e82 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:04.535656 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-3196b3c7-6401-49ed-ae71-f40a62652e82 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:04.543529 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3196b3c7-6401-49ed-ae71-f40a62652e82 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:04.544416 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3196b3c7-6401-49ed-ae71-f40a62652e82 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:04.545022 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3196b3c7-6401-49ed-ae71-f40a62652e82 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:04.545921 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3196b3c7-6401-49ed-ae71-f40a62652e82 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:04.546559 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3196b3c7-6401-49ed-ae71-f40a62652e82 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:04.547147 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3196b3c7-6401-49ed-ae71-f40a62652e82 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:04.595401 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-3196b3c7-6401-49ed-ae71-f40a62652e82 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Going to try to terminate instance {{(pid=123015) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:13:04.600416 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-d2467eb5-aeda-49fe-829f-e7d0448425d3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:04.614594 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d2467eb5-aeda-49fe-829f-e7d0448425d3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1279 microversion: 2.1 time: 0.383032 Aug 22 17:13:04.617273 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 221/479] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:04 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1279 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:04.981763 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3196b3c7-6401-49ed-ae71-f40a62652e82 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "DELETE /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 204 len: 0 microversion: 2.1 time: 0.453702 Aug 22 17:13:04.982411 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 259/480] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:13:04 2022] DELETE /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:13:04.990580 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0f2d9b96-951e-4f0e-ac46-f42e508d1947 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:04.992032 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-0f2d9b96-951e-4f0e-ac46-f42e508d1947 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:05.000948 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0f2d9b96-951e-4f0e-ac46-f42e508d1947 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:05.001832 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0f2d9b96-951e-4f0e-ac46-f42e508d1947 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:05.002828 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0f2d9b96-951e-4f0e-ac46-f42e508d1947 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:05.004413 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0f2d9b96-951e-4f0e-ac46-f42e508d1947 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:05.004887 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0f2d9b96-951e-4f0e-ac46-f42e508d1947 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:05.005364 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0f2d9b96-951e-4f0e-ac46-f42e508d1947 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:05.256230 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7ab2785b-ce57-4250-b75c-4a54d41d2a1e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:05.257255 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-7ab2785b-ce57-4250-b75c-4a54d41d2a1e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:05.270466 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7ab2785b-ce57-4250-b75c-4a54d41d2a1e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:05.272375 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7ab2785b-ce57-4250-b75c-4a54d41d2a1e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:05.273023 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7ab2785b-ce57-4250-b75c-4a54d41d2a1e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:05.274079 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7ab2785b-ce57-4250-b75c-4a54d41d2a1e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:05.274611 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7ab2785b-ce57-4250-b75c-4a54d41d2a1e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:05.275111 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7ab2785b-ce57-4250-b75c-4a54d41d2a1e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:05.452099 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-7ab2785b-ce57-4250-b75c-4a54d41d2a1e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:05.467214 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-7ab2785b-ce57-4250-b75c-4a54d41d2a1e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:05.468823 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-7ab2785b-ce57-4250-b75c-4a54d41d2a1e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:05.477970 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7ab2785b-ce57-4250-b75c-4a54d41d2a1e tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.229688 Aug 22 17:13:05.481997 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-0f2d9b96-951e-4f0e-ac46-f42e508d1947 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:05.491474 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0f2d9b96-951e-4f0e-ac46-f42e508d1947 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 200 len: 1479 microversion: 2.1 time: 0.504869 Aug 22 17:13:05.492051 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 222/481] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:04 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 1479 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:05.506108 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 260/482] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:05 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:13:05.638721 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f139e498-931c-4f3c-a910-c81fd4198697 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:05.639491 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-f139e498-931c-4f3c-a910-c81fd4198697 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:05.655381 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f139e498-931c-4f3c-a910-c81fd4198697 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:05.657665 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f139e498-931c-4f3c-a910-c81fd4198697 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:05.660636 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f139e498-931c-4f3c-a910-c81fd4198697 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:05.661768 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f139e498-931c-4f3c-a910-c81fd4198697 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:05.664213 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f139e498-931c-4f3c-a910-c81fd4198697 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:05.665207 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f139e498-931c-4f3c-a910-c81fd4198697 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:05.794587 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-f139e498-931c-4f3c-a910-c81fd4198697 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:05.812065 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f139e498-931c-4f3c-a910-c81fd4198697 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1277 microversion: 2.1 time: 0.175808 Aug 22 17:13:05.816590 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 223/483] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:05 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:06.509203 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a1c9570a-d084-467d-8201-27095b7b8c08 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:06.510402 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a1c9570a-d084-467d-8201-27095b7b8c08 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:06.514266 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-79df2f16-63f0-41b4-909c-ed95be933298 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:06.515493 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-79df2f16-63f0-41b4-909c-ed95be933298 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:06.532070 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-79df2f16-63f0-41b4-909c-ed95be933298 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:06.532577 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-79df2f16-63f0-41b4-909c-ed95be933298 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:06.533042 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-79df2f16-63f0-41b4-909c-ed95be933298 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:06.533801 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-79df2f16-63f0-41b4-909c-ed95be933298 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:06.534615 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a1c9570a-d084-467d-8201-27095b7b8c08 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:06.540324 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a1c9570a-d084-467d-8201-27095b7b8c08 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:06.541983 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-79df2f16-63f0-41b4-909c-ed95be933298 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:06.542841 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-79df2f16-63f0-41b4-909c-ed95be933298 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:06.547536 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a1c9570a-d084-467d-8201-27095b7b8c08 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:06.548409 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a1c9570a-d084-467d-8201-27095b7b8c08 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:06.549210 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a1c9570a-d084-467d-8201-27095b7b8c08 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:06.552369 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a1c9570a-d084-467d-8201-27095b7b8c08 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:06.792411 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a1c9570a-d084-467d-8201-27095b7b8c08 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:06.823195 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-79df2f16-63f0-41b4-909c-ed95be933298 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:06.828900 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a1c9570a-d084-467d-8201-27095b7b8c08 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:06.835507 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a1c9570a-d084-467d-8201-27095b7b8c08 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:06.840501 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-79df2f16-63f0-41b4-909c-ed95be933298 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 200 len: 1479 microversion: 2.1 time: 0.323602 Aug 22 17:13:06.841000 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a1c9570a-d084-467d-8201-27095b7b8c08 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.337886 Aug 22 17:13:06.841615 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 261/484] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:06 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:06.843143 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 224/485] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:06 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 1479 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:06.847576 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b8b5106d-ea57-4967-ab62-51a24f12de3c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:06.848347 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b8b5106d-ea57-4967-ab62-51a24f12de3c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:06.854869 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b8b5106d-ea57-4967-ab62-51a24f12de3c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:06.855514 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b8b5106d-ea57-4967-ab62-51a24f12de3c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:06.856079 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b8b5106d-ea57-4967-ab62-51a24f12de3c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:06.856955 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b8b5106d-ea57-4967-ab62-51a24f12de3c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:06.857581 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b8b5106d-ea57-4967-ab62-51a24f12de3c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:06.858153 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b8b5106d-ea57-4967-ab62-51a24f12de3c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:06.993698 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b8b5106d-ea57-4967-ab62-51a24f12de3c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:07.004900 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b8b5106d-ea57-4967-ab62-51a24f12de3c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1277 microversion: 2.1 time: 0.161997 Aug 22 17:13:07.006432 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 262/486] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:06 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:07.866065 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0edac9ce-78e2-4e0b-bdd1-0e5f2d2925ba tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:07.866804 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0edac9ce-78e2-4e0b-bdd1-0e5f2d2925ba tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:07.876545 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0edac9ce-78e2-4e0b-bdd1-0e5f2d2925ba tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:07.878190 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0edac9ce-78e2-4e0b-bdd1-0e5f2d2925ba tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:07.914562 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0edac9ce-78e2-4e0b-bdd1-0e5f2d2925ba tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:07.920603 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0edac9ce-78e2-4e0b-bdd1-0e5f2d2925ba tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:07.921447 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0edac9ce-78e2-4e0b-bdd1-0e5f2d2925ba tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:07.926972 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0edac9ce-78e2-4e0b-bdd1-0e5f2d2925ba tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:08.186472 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0edac9ce-78e2-4e0b-bdd1-0e5f2d2925ba tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:08.200391 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0edac9ce-78e2-4e0b-bdd1-0e5f2d2925ba tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 200 len: 1437 microversion: 2.1 time: 0.339031 Aug 22 17:13:08.221308 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 263/487] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:07 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 1437 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:08.249896 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-907ce520-7607-48e5-9559-ed1eaa642465 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:08.249896 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-907ce520-7607-48e5-9559-ed1eaa642465 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:08.285652 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-907ce520-7607-48e5-9559-ed1eaa642465 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:08.285652 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-907ce520-7607-48e5-9559-ed1eaa642465 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:08.285652 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-907ce520-7607-48e5-9559-ed1eaa642465 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:08.285652 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-907ce520-7607-48e5-9559-ed1eaa642465 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:08.286897 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-907ce520-7607-48e5-9559-ed1eaa642465 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:08.287491 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-907ce520-7607-48e5-9559-ed1eaa642465 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:08.358187 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-520feaa3-baa7-49be-a1e2-2b30ccbbf962 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Calling method '.version_select at 0x7f8009d12dc0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:08.362339 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:08.362339 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:13:08.367871 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-520feaa3-baa7-49be-a1e2-2b30ccbbf962 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:08.369751 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-520feaa3-baa7-49be-a1e2-2b30ccbbf962 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:08.372315 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-520feaa3-baa7-49be-a1e2-2b30ccbbf962 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:08.374158 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-520feaa3-baa7-49be-a1e2-2b30ccbbf962 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:08.376673 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-520feaa3-baa7-49be-a1e2-2b30ccbbf962 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:08.377891 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-520feaa3-baa7-49be-a1e2-2b30ccbbf962 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:08.446911 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-907ce520-7607-48e5-9559-ed1eaa642465 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:08.449925 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-520feaa3-baa7-49be-a1e2-2b30ccbbf962 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.710147 Aug 22 17:13:08.451644 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 225/488] 10.222.0.96 () {58 vars in 1128 bytes} [Mon Aug 22 17:13:07 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:08.458629 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b639c5b9-7169-4cb0-908e-7a033bf85806 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:08.461357 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b639c5b9-7169-4cb0-908e-7a033bf85806 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:08.467071 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b639c5b9-7169-4cb0-908e-7a033bf85806 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:08.467796 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b639c5b9-7169-4cb0-908e-7a033bf85806 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:08.468401 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b639c5b9-7169-4cb0-908e-7a033bf85806 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:08.469377 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b639c5b9-7169-4cb0-908e-7a033bf85806 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:08.470137 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b639c5b9-7169-4cb0-908e-7a033bf85806 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:08.471572 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b639c5b9-7169-4cb0-908e-7a033bf85806 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:08.477597 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=100 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:08.500079 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-907ce520-7607-48e5-9559-ed1eaa642465 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:08.517649 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-907ce520-7607-48e5-9559-ed1eaa642465 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:08.541828 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:08.544123 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-907ce520-7607-48e5-9559-ed1eaa642465 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.320881 Aug 22 17:13:08.570120 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 264/489] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:08 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:08.574931 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-69f37548-79b4-459c-a2f4-359786d7856b req-d45543e1-6b57-48aa-88cc-bcbb0090af5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791d0306-dc08-4e10-81c8-003730a5ce09", "name": "network-vif-deleted", "tag": "6e59f300-cd40-4f3d-b25e-eb03e04d54d6"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:08.588488 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-69f37548-79b4-459c-a2f4-359786d7856b req-d45543e1-6b57-48aa-88cc-bcbb0090af5e service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:08.589019 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-69f37548-79b4-459c-a2f4-359786d7856b req-d45543e1-6b57-48aa-88cc-bcbb0090af5e service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:08.589512 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-69f37548-79b4-459c-a2f4-359786d7856b req-d45543e1-6b57-48aa-88cc-bcbb0090af5e service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:08.608695 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-69f37548-79b4-459c-a2f4-359786d7856b req-d45543e1-6b57-48aa-88cc-bcbb0090af5e service nova] Creating event network-vif-deleted:6e59f300-cd40-4f3d-b25e-eb03e04d54d6 for instance 791d0306-dc08-4e10-81c8-003730a5ce09 on n-h1-854030-1 Aug 22 17:13:08.621289 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-69f37548-79b4-459c-a2f4-359786d7856b req-d45543e1-6b57-48aa-88cc-bcbb0090af5e service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043952 Aug 22 17:13:08.621289 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 265/490] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:08.950139 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b639c5b9-7169-4cb0-908e-7a033bf85806 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:08.964070 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b639c5b9-7169-4cb0-908e-7a033bf85806 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1319 microversion: 2.1 time: 0.511055 Aug 22 17:13:08.964668 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 226/491] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:08 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1319 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:09.169153 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7485c804-822b-4393-ae21-45b7f2d46245 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Calling method '.version_select at 0x7f8009cf6160>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:09.175287 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:09.175287 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:13:09.185433 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-7485c804-822b-4393-ae21-45b7f2d46245 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'ff980c0336ba4ab49d1e85282a662e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec8b6ed3c1d4e30a0cf9ee09511faa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7485c804-822b-4393-ae21-45b7f2d46245 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Request method failure captured: Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7khaNPRDN2SrCuQTlko4EK0t5GIPaEwmT2n51mBcASRs_Xn63KqBqjPzvh34lHOapKV4B3NBsFO3Byp392gXC3kmzrKKIoH4zByuW8iGjL6zX-Rrj7GTsQ7heO2V6vFkMGY8oOCQN42nfSEz1BtWlnb6FROZ5yaZfvhodFq3ZHwWfE Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 9ec8b6ed3c1d4e30a0cf9ee09511faa8 Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2077406770 Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:13:09.187723 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:13:09.189616 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ec8b6ed3c1d4e30a0cf9ee09511faa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9ec8b6ed3c1d4e30a0cf9ee09511faa8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ec8b6ed3c1d4e30a0cf9ee09511faa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9ec8b6ed3c1d4e30a0cf9ee09511faa8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:09.189616 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2077406770 Aug 22 17:13:09.189616 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 9ec8b6ed3c1d4e30a0cf9ee09511faa8 Aug 22 17:13:09.189616 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2077406770 Aug 22 17:13:09.189616 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-HostsAdminNegativeTestJSON-2077406770-project Aug 22 17:13:09.189616 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:09.189616 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:09.189616 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: ff980c0336ba4ab49d1e85282a662e53 Aug 22 17:13:09.189616 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2077406770-project Aug 22 17:13:09.189616 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:13:09.189616 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 22 17:13:09.189616 n-d-854030-1 devstack@n-api.service[123015]: action_args: {} Aug 22 17:13:09.189616 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:09.191802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:09.191802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:09.191802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:09.191802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:09.191802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:09.191802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:09.191802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:09.191802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 17:13:09.191802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:09.191802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:09.191802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:09.191802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 22 17:13:09.191802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 22 17:13:09.191802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:13:09.191802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:13:09.191802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:13:09.191802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:13:09.191802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:13:09.191802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:13:09.197454 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:13:09.197454 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:13:09.197454 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:13:09.197454 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:13:09.197454 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:13:09.197454 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:13:09.197454 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:13:09.197454 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:13:09.197454 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 22 17:13:09.197454 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.197454 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:09.197454 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.197454 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:09.197454 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:09.197454 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:09.197454 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:13:09.197454 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:13:09.197454 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 22 17:13:09.197454 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.198721 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7485c804-822b-4393-ae21-45b7f2d46245 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:09.198721 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7485c804-822b-4393-ae21-45b7f2d46245 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] 10.222.0.96 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.570864 Aug 22 17:13:09.205317 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-12a53152-34d8-4102-bd2a-c753b6098ebc tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Calling method '.version_select at 0x7f8009cba1f0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:09.206609 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:09.206609 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:13:09.208256 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-12a53152-34d8-4102-bd2a-c753b6098ebc tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'ff980c0336ba4ab49d1e85282a662e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec8b6ed3c1d4e30a0cf9ee09511faa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:09.210058 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 266/492] 10.222.0.96 () {58 vars in 1128 bytes} [Mon Aug 22 17:13:08 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 592 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-12a53152-34d8-4102-bd2a-c753b6098ebc tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Request method failure captured: Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-hosts/n-d-854030-1/reboot HTTP/1.1 Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7khaNPRDN2SrCuQTlko4EK0t5GIPaEwmT2n51mBcASRs_Xn63KqBqjPzvh34lHOapKV4B3NBsFO3Byp392gXC3kmzrKKIoH4zByuW8iGjL6zX-Rrj7GTsQ7heO2V6vFkMGY8oOCQN42nfSEz1BtWlnb6FROZ5yaZfvhodFq3ZHwWfE Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 9ec8b6ed3c1d4e30a0cf9ee09511faa8 Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2077406770 Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:13:09.212094 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:13:09.213698 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ec8b6ed3c1d4e30a0cf9ee09511faa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9ec8b6ed3c1d4e30a0cf9ee09511faa8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ec8b6ed3c1d4e30a0cf9ee09511faa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9ec8b6ed3c1d4e30a0cf9ee09511faa8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:09.213698 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2077406770 Aug 22 17:13:09.213698 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 9ec8b6ed3c1d4e30a0cf9ee09511faa8 Aug 22 17:13:09.213698 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2077406770 Aug 22 17:13:09.213698 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-HostsAdminNegativeTestJSON-2077406770-project Aug 22 17:13:09.213698 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:13:09.213698 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:13:09.213698 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: ff980c0336ba4ab49d1e85282a662e53 Aug 22 17:13:09.213698 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2077406770-project Aug 22 17:13:09.213698 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:13:09.213698 n-d-854030-1 devstack@n-api.service[123016]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 22 17:13:09.213698 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'n-d-854030-1'} Aug 22 17:13:09.213698 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:09.214557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:09.214557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:09.214557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:09.214557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:09.214557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:09.214557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:09.214557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:09.214557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:09.214557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:09.214557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 22 17:13:09.214557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 22 17:13:09.214557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:13:09.214557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:13:09.214557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:13:09.214557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:13:09.214557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:13:09.214557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:13:09.214557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:13:09.214557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:13:09.215910 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:13:09.215910 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:13:09.215910 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:13:09.215910 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:13:09.215910 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:13:09.215910 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:13:09.215910 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 22 17:13:09.215910 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.215910 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:09.215910 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.215910 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:09.215910 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:09.215910 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:09.215910 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:13:09.215910 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:13:09.215910 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 22 17:13:09.215910 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.217157 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-12a53152-34d8-4102-bd2a-c753b6098ebc tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:09.218407 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-12a53152-34d8-4102-bd2a-c753b6098ebc tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] 10.222.0.96 "GET /compute/v2.1/os-hosts/n-d-854030-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.020251 Aug 22 17:13:09.219403 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 227/493] 10.222.0.96 () {58 vars in 1188 bytes} [Mon Aug 22 17:13:09 2022] GET /compute/v2.1/os-hosts/n-d-854030-1/reboot => generated 111 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:09.228198 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e242b7b2-155d-48a1-a64a-6260dffc1afb tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:09.229034 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-e242b7b2-155d-48a1-a64a-6260dffc1afb tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:09.238435 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-24ee43d3-bb24-4bfe-83f2-3231aefb5833 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Calling method '.version_select at 0x7f8009d42f70>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:09.246939 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e242b7b2-155d-48a1-a64a-6260dffc1afb tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:09.247436 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e242b7b2-155d-48a1-a64a-6260dffc1afb tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:09.254144 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e242b7b2-155d-48a1-a64a-6260dffc1afb tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:09.255354 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e242b7b2-155d-48a1-a64a-6260dffc1afb tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:09.257638 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e242b7b2-155d-48a1-a64a-6260dffc1afb tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:09.258742 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e242b7b2-155d-48a1-a64a-6260dffc1afb tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:09.270597 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-24ee43d3-bb24-4bfe-83f2-3231aefb5833 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-24ee43d3-bb24-4bfe-83f2-3231aefb5833 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Request method failure captured: Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7kjCKyVZJYjRAamYwD1Q6N8QShaSk7HvP5MvubN6kPFiwoNJNpm6_LwsrVZ-ztKcCLRfbJANF0BkV8NkDSZEHDuXb0xq0vfX91dn60ge7M1aWfiZUXezEYwKfvRy09EN0QvigTyl57oAWTfqZ-Mwu-l6tfvuZABalwzuh0aI0dVUhU Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 9d888f65b31546348bb61ea2563630cc Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:13:09.274844 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:13:09.276470 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9d888f65b31546348bb61ea2563630cc", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:09.276470 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:09.276470 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 9d888f65b31546348bb61ea2563630cc Aug 22 17:13:09.276470 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:09.276470 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-HostsAdminNegativeTestJSON-410957140-project-admin Aug 22 17:13:09.276470 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:13:09.276470 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:13:09.276470 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 48ce39eec5a84c52bf89bc1a9a291337 Aug 22 17:13:09.276470 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-HostsAdminNegativeTestJSON-410957140-project-admin Aug 22 17:13:09.276470 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:13:09.276470 n-d-854030-1 devstack@n-api.service[123016]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:09.276470 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'nonexistent_hostname'} Aug 22 17:13:09.276470 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:09.277517 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:09.277517 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 22 17:13:09.277517 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 22 17:13:09.277517 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 22 17:13:09.277517 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 22 17:13:09.277517 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:13:09.277517 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:13:09.277517 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:13:09.277517 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:13:09.277517 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 22 17:13:09.277517 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 22 17:13:09.277517 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 22 17:13:09.277517 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 22 17:13:09.277517 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:13:09.277517 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:13:09.277517 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 22 17:13:09.277517 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 22 17:13:09.277517 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:13:09.277517 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:13:09.278649 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 22 17:13:09.278649 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 22 17:13:09.278649 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:09.278649 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.278649 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:09.278649 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.278649 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:09.278649 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:09.278649 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:09.278649 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:09.278649 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:09.278649 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:09.278649 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:09.278649 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:09.278649 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:09.278649 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 22 17:13:09.278649 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 22 17:13:09.278649 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 22 17:13:09.278649 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:13:09.279883 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:09.279883 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.279883 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:09.279883 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.279883 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:09.279883 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:09.279883 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:09.279883 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:13:09.279883 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:13:09.279883 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:09.279883 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.281900 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-24ee43d3-bb24-4bfe-83f2-3231aefb5833 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:09.283776 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-24ee43d3-bb24-4bfe-83f2-3231aefb5833 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.054675 Aug 22 17:13:09.285102 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 228/494] 10.222.0.96 () {58 vars in 1212 bytes} [Mon Aug 22 17:13:09 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 22 17:13:09.318286 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-10307ae5-3b72-44c1-8a26-20a6f09aa9f9 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Calling method '.version_select at 0x7f8009eb0430>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:09.324194 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:09.324194 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:13:09.328106 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-10307ae5-3b72-44c1-8a26-20a6f09aa9f9 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'ff980c0336ba4ab49d1e85282a662e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec8b6ed3c1d4e30a0cf9ee09511faa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-10307ae5-3b72-44c1-8a26-20a6f09aa9f9 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Request method failure captured: Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-hosts/n-d-854030-1 HTTP/1.1 Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7khaNPRDN2SrCuQTlko4EK0t5GIPaEwmT2n51mBcASRs_Xn63KqBqjPzvh34lHOapKV4B3NBsFO3Byp392gXC3kmzrKKIoH4zByuW8iGjL6zX-Rrj7GTsQ7heO2V6vFkMGY8oOCQN42nfSEz1BtWlnb6FROZ5yaZfvhodFq3ZHwWfE Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 9ec8b6ed3c1d4e30a0cf9ee09511faa8 Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2077406770 Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:13:09.338706 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:13:09.340390 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ec8b6ed3c1d4e30a0cf9ee09511faa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9ec8b6ed3c1d4e30a0cf9ee09511faa8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ec8b6ed3c1d4e30a0cf9ee09511faa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9ec8b6ed3c1d4e30a0cf9ee09511faa8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:09.340390 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2077406770 Aug 22 17:13:09.340390 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 9ec8b6ed3c1d4e30a0cf9ee09511faa8 Aug 22 17:13:09.340390 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2077406770 Aug 22 17:13:09.340390 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-HostsAdminNegativeTestJSON-2077406770-project Aug 22 17:13:09.340390 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:13:09.340390 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:13:09.340390 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: ff980c0336ba4ab49d1e85282a662e53 Aug 22 17:13:09.340390 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2077406770-project Aug 22 17:13:09.340390 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:13:09.340390 n-d-854030-1 devstack@n-api.service[123016]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 22 17:13:09.340390 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'n-d-854030-1'} Aug 22 17:13:09.340390 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:09.341520 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:09.341520 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:09.341520 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:09.341520 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:09.341520 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:09.341520 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:09.341520 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:09.341520 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:09.341520 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:09.341520 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 22 17:13:09.341520 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 22 17:13:09.341520 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:13:09.341520 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:13:09.341520 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:13:09.341520 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:13:09.341520 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:13:09.341520 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:13:09.341520 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:13:09.341520 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:13:09.344347 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:13:09.344347 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:13:09.344347 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:13:09.344347 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:13:09.344347 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:13:09.344347 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:13:09.344347 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 22 17:13:09.344347 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.344347 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:09.344347 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.344347 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:09.344347 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:09.344347 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:09.344347 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:13:09.344347 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:13:09.344347 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 22 17:13:09.344347 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.350418 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-10307ae5-3b72-44c1-8a26-20a6f09aa9f9 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:09.351980 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-10307ae5-3b72-44c1-8a26-20a6f09aa9f9 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] 10.222.0.96 "GET /compute/v2.1/os-hosts/n-d-854030-1" status: 403 len: 109 microversion: 2.1 time: 0.055272 Aug 22 17:13:09.354775 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 229/495] 10.222.0.96 () {58 vars in 1167 bytes} [Mon Aug 22 17:13:09 2022] GET /compute/v2.1/os-hosts/n-d-854030-1 => generated 109 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:09.370601 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-4d9861db-cac8-447b-9005-810f0136f32d req-5efc5c41-db28-4427-81dc-58ea13034991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "818bc982-f088-43a6-930c-f998d3345296", "tag": "ab4e3be9-90f8-44af-9b6e-35ddf22fde9e"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:09.395315 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e242b7b2-155d-48a1-a64a-6260dffc1afb tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:09.402991 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-4d9861db-cac8-447b-9005-810f0136f32d req-5efc5c41-db28-4427-81dc-58ea13034991 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:09.403433 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-4d9861db-cac8-447b-9005-810f0136f32d req-5efc5c41-db28-4427-81dc-58ea13034991 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:09.404085 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e242b7b2-155d-48a1-a64a-6260dffc1afb tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:09.404837 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e242b7b2-155d-48a1-a64a-6260dffc1afb tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:09.408027 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-e242b7b2-155d-48a1-a64a-6260dffc1afb tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lazy-loading 'fault' on Instance uuid 791d0306-dc08-4e10-81c8-003730a5ce09 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:09.410154 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-4d9861db-cac8-447b-9005-810f0136f32d req-5efc5c41-db28-4427-81dc-58ea13034991 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:09.442471 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-4d9861db-cac8-447b-9005-810f0136f32d req-5efc5c41-db28-4427-81dc-58ea13034991 service nova] Creating event network-changed:ab4e3be9-90f8-44af-9b6e-35ddf22fde9e for instance 818bc982-f088-43a6-930c-f998d3345296 on n-h2-854030-1 Aug 22 17:13:09.469485 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-4d9861db-cac8-447b-9005-810f0136f32d req-5efc5c41-db28-4427-81dc-58ea13034991 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111142 Aug 22 17:13:09.476507 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 230/496] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:09.483047 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ca788f71-79f0-496c-905a-8d350b1f5206 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Calling method '.version_select at 0x7f8009d125e0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:09.483930 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:09.483930 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:13:09.509235 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-ca788f71-79f0-496c-905a-8d350b1f5206 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ca788f71-79f0-496c-905a-8d350b1f5206 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Request method failure captured: Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7kjCKyVZJYjRAamYwD1Q6N8QShaSk7HvP5MvubN6kPFiwoNJNpm6_LwsrVZ-ztKcCLRfbJANF0BkV8NkDSZEHDuXb0xq0vfX91dn60ge7M1aWfiZUXezEYwKfvRy09EN0QvigTyl57oAWTfqZ-Mwu-l6tfvuZABalwzuh0aI0dVUhU Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 9d888f65b31546348bb61ea2563630cc Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:13:09.513964 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:13:09.515293 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9d888f65b31546348bb61ea2563630cc", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:09.515293 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:09.515293 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 9d888f65b31546348bb61ea2563630cc Aug 22 17:13:09.515293 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:09.515293 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-HostsAdminNegativeTestJSON-410957140-project-admin Aug 22 17:13:09.515293 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:13:09.515293 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:13:09.515293 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 48ce39eec5a84c52bf89bc1a9a291337 Aug 22 17:13:09.515293 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-HostsAdminNegativeTestJSON-410957140-project-admin Aug 22 17:13:09.515293 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:13:09.515293 n-d-854030-1 devstack@n-api.service[123016]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:09.515293 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'nonexistent_hostname'} Aug 22 17:13:09.515293 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:09.516124 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:09.516124 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 22 17:13:09.516124 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 22 17:13:09.516124 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:13:09.516124 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:13:09.516124 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 22 17:13:09.516124 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 22 17:13:09.516124 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:13:09.516124 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:13:09.516124 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 22 17:13:09.516124 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 22 17:13:09.516124 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:09.516124 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.516124 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:09.516124 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.516124 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:09.516124 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:09.516124 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:09.516124 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:09.518014 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:09.518014 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:09.518014 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:09.518014 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:09.518014 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:09.518014 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 22 17:13:09.518014 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:13:09.518014 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:09.518014 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.518014 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:09.518014 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.518014 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:09.518014 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:09.518014 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:09.518014 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:13:09.518014 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:13:09.518014 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:09.518014 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.519092 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ca788f71-79f0-496c-905a-8d350b1f5206 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:09.519092 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ca788f71-79f0-496c-905a-8d350b1f5206 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.033306 Aug 22 17:13:09.525530 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 231/497] 10.222.0.96 () {58 vars in 1191 bytes} [Mon Aug 22 17:13:09 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:13:09.586327 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e242b7b2-155d-48a1-a64a-6260dffc1afb tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f796c0f6b643eb8d717afc1006b584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c2cfdafd4547d9bca73946ae404f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:09.603176 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e242b7b2-155d-48a1-a64a-6260dffc1afb tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 200 len: 1313 microversion: 2.1 time: 0.381801 Aug 22 17:13:09.604065 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 267/498] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:09 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:09.622348 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d9d1cc46-95fa-4165-b4db-96cd0598edd4 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Calling method '.version_select at 0x7f8009cf9430>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:09.623436 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:09.623436 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:13:09.624973 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d9d1cc46-95fa-4165-b4db-96cd0598edd4 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'ff980c0336ba4ab49d1e85282a662e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec8b6ed3c1d4e30a0cf9ee09511faa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d9d1cc46-95fa-4165-b4db-96cd0598edd4 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Request method failure captured: Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-hosts/n-d-854030-1/shutdown HTTP/1.1 Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7khaNPRDN2SrCuQTlko4EK0t5GIPaEwmT2n51mBcASRs_Xn63KqBqjPzvh34lHOapKV4B3NBsFO3Byp392gXC3kmzrKKIoH4zByuW8iGjL6zX-Rrj7GTsQ7heO2V6vFkMGY8oOCQN42nfSEz1BtWlnb6FROZ5yaZfvhodFq3ZHwWfE Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 9ec8b6ed3c1d4e30a0cf9ee09511faa8 Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2077406770 Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:13:09.642283 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:13:09.643968 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ec8b6ed3c1d4e30a0cf9ee09511faa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9ec8b6ed3c1d4e30a0cf9ee09511faa8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ec8b6ed3c1d4e30a0cf9ee09511faa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9ec8b6ed3c1d4e30a0cf9ee09511faa8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:09.643968 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2077406770 Aug 22 17:13:09.643968 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 9ec8b6ed3c1d4e30a0cf9ee09511faa8 Aug 22 17:13:09.643968 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2077406770 Aug 22 17:13:09.643968 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-HostsAdminNegativeTestJSON-2077406770-project Aug 22 17:13:09.643968 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:09.643968 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:09.643968 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: ff980c0336ba4ab49d1e85282a662e53 Aug 22 17:13:09.643968 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2077406770-project Aug 22 17:13:09.643968 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:13:09.643968 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 22 17:13:09.643968 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'n-d-854030-1'} Aug 22 17:13:09.643968 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:09.644708 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:09.644708 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:09.644708 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:09.644708 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:09.644708 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:09.644708 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:09.644708 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:09.644708 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:09.644708 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:09.644708 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 22 17:13:09.644708 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 22 17:13:09.644708 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:13:09.644708 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:13:09.644708 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:13:09.644708 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:13:09.644708 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:13:09.644708 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:13:09.644708 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:13:09.644708 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:13:09.645833 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:13:09.645833 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:13:09.645833 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:13:09.645833 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:13:09.645833 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:13:09.645833 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:13:09.645833 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 22 17:13:09.645833 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.645833 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:09.645833 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.645833 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:09.645833 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:09.645833 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:09.645833 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:13:09.645833 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:13:09.645833 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 22 17:13:09.645833 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.646797 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d9d1cc46-95fa-4165-b4db-96cd0598edd4 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:09.646929 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d9d1cc46-95fa-4165-b4db-96cd0598edd4 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] 10.222.0.96 "GET /compute/v2.1/os-hosts/n-d-854030-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.041892 Aug 22 17:13:09.650323 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 268/499] 10.222.0.96 () {58 vars in 1194 bytes} [Mon Aug 22 17:13:09 2022] GET /compute/v2.1/os-hosts/n-d-854030-1/shutdown => generated 113 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:09.674408 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-228b3140-d83b-477d-b76c-2257883b34a8 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:09.677113 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-228b3140-d83b-477d-b76c-2257883b34a8 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:09.697770 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-228b3140-d83b-477d-b76c-2257883b34a8 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:09.701014 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-228b3140-d83b-477d-b76c-2257883b34a8 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:09.701014 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-228b3140-d83b-477d-b76c-2257883b34a8 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:09.702250 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-228b3140-d83b-477d-b76c-2257883b34a8 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:09.702732 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-228b3140-d83b-477d-b76c-2257883b34a8 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:09.703160 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-228b3140-d83b-477d-b76c-2257883b34a8 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:09.871762 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-228b3140-d83b-477d-b76c-2257883b34a8 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:09.884458 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-228b3140-d83b-477d-b76c-2257883b34a8 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:09.886021 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-228b3140-d83b-477d-b76c-2257883b34a8 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:09.890745 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6bc626fb-79e3-40f7-a606-591cb21c55c2 tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] Action: 'create', calling method: .version_select at 0x7f8009d425e0>, body: {"pool": null} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:09.909979 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-228b3140-d83b-477d-b76c-2257883b34a8 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.253004 Aug 22 17:13:09.922332 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 269/500] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:09 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:09.933741 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5961a950-f3fe-4b80-b213-413d4e23cb9f tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Calling method '.version_select at 0x7f800a3c68b0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:09.934517 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:09.934517 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:13:09.952166 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-5961a950-f3fe-4b80-b213-413d4e23cb9f tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5961a950-f3fe-4b80-b213-413d4e23cb9f tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Request method failure captured: Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7kjCKyVZJYjRAamYwD1Q6N8QShaSk7HvP5MvubN6kPFiwoNJNpm6_LwsrVZ-ztKcCLRfbJANF0BkV8NkDSZEHDuXb0xq0vfX91dn60ge7M1aWfiZUXezEYwKfvRy09EN0QvigTyl57oAWTfqZ-Mwu-l6tfvuZABalwzuh0aI0dVUhU Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 9d888f65b31546348bb61ea2563630cc Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:13:09.953974 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:13:09.956300 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9d888f65b31546348bb61ea2563630cc", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:09.956300 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:09.956300 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 9d888f65b31546348bb61ea2563630cc Aug 22 17:13:09.956300 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:09.956300 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-HostsAdminNegativeTestJSON-410957140-project-admin Aug 22 17:13:09.956300 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:09.956300 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:09.956300 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 48ce39eec5a84c52bf89bc1a9a291337 Aug 22 17:13:09.956300 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-HostsAdminNegativeTestJSON-410957140-project-admin Aug 22 17:13:09.956300 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:13:09.956300 n-d-854030-1 devstack@n-api.service[123015]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:09.956300 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'nonexistent_hostname'} Aug 22 17:13:09.956300 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:09.957139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:09.957139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 22 17:13:09.957139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 22 17:13:09.957139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 22 17:13:09.957139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 22 17:13:09.957139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:13:09.957139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:13:09.957139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:13:09.957139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:13:09.957139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 22 17:13:09.957139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 22 17:13:09.957139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 22 17:13:09.957139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 22 17:13:09.957139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:13:09.957139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:13:09.957139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 22 17:13:09.957139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 22 17:13:09.957139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:13:09.957139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:13:09.958317 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 22 17:13:09.958317 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 22 17:13:09.958317 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:09.958317 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.958317 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:09.958317 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.958317 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:09.958317 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:09.958317 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:09.958317 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:09.958317 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:09.958317 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:09.958317 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:09.958317 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:09.958317 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:09.958317 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 22 17:13:09.958317 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 22 17:13:09.958317 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 22 17:13:09.958317 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:13:09.959397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:09.959397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.959397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:09.959397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.959397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:09.959397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:09.959397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:09.959397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:13:09.959397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:13:09.959397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:09.959397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.961307 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5961a950-f3fe-4b80-b213-413d4e23cb9f tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:09.962611 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5961a950-f3fe-4b80-b213-413d4e23cb9f tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.047402 Aug 22 17:13:09.963366 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 270/501] 10.222.0.96 () {58 vars in 1218 bytes} [Mon Aug 22 17:13:09 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:13:09.973488 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-132238b8-4dd9-4499-aa51-be8290cfa5f1 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Calling method '.version_select at 0x7f8009d1d160>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:09.974588 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:09.974588 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:13:09.978295 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-132238b8-4dd9-4499-aa51-be8290cfa5f1 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'ff980c0336ba4ab49d1e85282a662e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec8b6ed3c1d4e30a0cf9ee09511faa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-132238b8-4dd9-4499-aa51-be8290cfa5f1 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Request method failure captured: Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-hosts/n-d-854030-1/startup HTTP/1.1 Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7khaNPRDN2SrCuQTlko4EK0t5GIPaEwmT2n51mBcASRs_Xn63KqBqjPzvh34lHOapKV4B3NBsFO3Byp392gXC3kmzrKKIoH4zByuW8iGjL6zX-Rrj7GTsQ7heO2V6vFkMGY8oOCQN42nfSEz1BtWlnb6FROZ5yaZfvhodFq3ZHwWfE Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 9ec8b6ed3c1d4e30a0cf9ee09511faa8 Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2077406770 Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:13:09.980185 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:13:09.981725 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ec8b6ed3c1d4e30a0cf9ee09511faa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9ec8b6ed3c1d4e30a0cf9ee09511faa8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ec8b6ed3c1d4e30a0cf9ee09511faa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9ec8b6ed3c1d4e30a0cf9ee09511faa8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:09.981725 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2077406770 Aug 22 17:13:09.981725 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 9ec8b6ed3c1d4e30a0cf9ee09511faa8 Aug 22 17:13:09.981725 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2077406770 Aug 22 17:13:09.981725 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-HostsAdminNegativeTestJSON-2077406770-project Aug 22 17:13:09.981725 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:09.981725 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:09.981725 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: ff980c0336ba4ab49d1e85282a662e53 Aug 22 17:13:09.981725 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2077406770-project Aug 22 17:13:09.981725 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:13:09.981725 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 22 17:13:09.981725 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'n-d-854030-1'} Aug 22 17:13:09.981725 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:09.982486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:09.982486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:09.982486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:09.982486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:09.982486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:09.982486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:09.982486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:09.982486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:09.982486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:09.982486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 22 17:13:09.982486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 22 17:13:09.982486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:13:09.982486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:13:09.982486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:13:09.982486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:13:09.982486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:13:09.982486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:13:09.982486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:13:09.982486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:13:09.983571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:13:09.983571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:13:09.983571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:13:09.983571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:13:09.983571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:13:09.983571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:13:09.983571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 22 17:13:09.983571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.983571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:09.983571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.983571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:09.983571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:09.983571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:09.983571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:13:09.983571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:13:09.983571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 22 17:13:09.983571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:09.989608 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-132238b8-4dd9-4499-aa51-be8290cfa5f1 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:09.990556 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-132238b8-4dd9-4499-aa51-be8290cfa5f1 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] 10.222.0.96 "GET /compute/v2.1/os-hosts/n-d-854030-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.021705 Aug 22 17:13:09.994030 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 271/502] 10.222.0.96 () {58 vars in 1191 bytes} [Mon Aug 22 17:13:09 2022] GET /compute/v2.1/os-hosts/n-d-854030-1/startup => generated 110 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:13:10.006496 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-94c74769-71f9-41c4-bca0-c99f6dbaa6d6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:10.013180 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-94c74769-71f9-41c4-bca0-c99f6dbaa6d6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:10.027671 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94c74769-71f9-41c4-bca0-c99f6dbaa6d6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:10.032364 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94c74769-71f9-41c4-bca0-c99f6dbaa6d6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:10.034142 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94c74769-71f9-41c4-bca0-c99f6dbaa6d6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:10.035101 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94c74769-71f9-41c4-bca0-c99f6dbaa6d6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:10.035718 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94c74769-71f9-41c4-bca0-c99f6dbaa6d6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:10.036419 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94c74769-71f9-41c4-bca0-c99f6dbaa6d6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:10.387932 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-94c74769-71f9-41c4-bca0-c99f6dbaa6d6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:10.420468 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-94c74769-71f9-41c4-bca0-c99f6dbaa6d6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1319 microversion: 2.1 time: 0.424834 Aug 22 17:13:10.423072 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 272/503] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:09 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1319 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:10.441755 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a9d67ee4-1c59-4b43-a147-4c12543aa0de tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Calling method '.version_select at 0x7f8009f28d30>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:10.443504 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:10.443504 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:13:10.459224 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-a9d67ee4-1c59-4b43-a147-4c12543aa0de tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a9d67ee4-1c59-4b43-a147-4c12543aa0de tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Request method failure captured: Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7kjCKyVZJYjRAamYwD1Q6N8QShaSk7HvP5MvubN6kPFiwoNJNpm6_LwsrVZ-ztKcCLRfbJANF0BkV8NkDSZEHDuXb0xq0vfX91dn60ge7M1aWfiZUXezEYwKfvRy09EN0QvigTyl57oAWTfqZ-Mwu-l6tfvuZABalwzuh0aI0dVUhU Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 9d888f65b31546348bb61ea2563630cc Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:13:10.461460 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:13:10.462727 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9d888f65b31546348bb61ea2563630cc", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:10.462727 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:10.462727 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 9d888f65b31546348bb61ea2563630cc Aug 22 17:13:10.462727 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:10.462727 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-HostsAdminNegativeTestJSON-410957140-project-admin Aug 22 17:13:10.462727 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:10.462727 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:10.462727 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 48ce39eec5a84c52bf89bc1a9a291337 Aug 22 17:13:10.462727 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-HostsAdminNegativeTestJSON-410957140-project-admin Aug 22 17:13:10.462727 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:13:10.462727 n-d-854030-1 devstack@n-api.service[123015]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:10.462727 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'nonexistent_hostname'} Aug 22 17:13:10.462727 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:10.463658 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.463658 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 22 17:13:10.463658 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 22 17:13:10.463658 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 22 17:13:10.463658 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 22 17:13:10.463658 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:13:10.463658 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:13:10.463658 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:13:10.463658 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:13:10.463658 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 22 17:13:10.463658 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 22 17:13:10.463658 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 22 17:13:10.463658 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 22 17:13:10.463658 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:13:10.463658 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:13:10.463658 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 22 17:13:10.463658 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 22 17:13:10.463658 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:13:10.463658 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:13:10.464737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 22 17:13:10.464737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 22 17:13:10.464737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:10.464737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.464737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:10.464737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.464737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.464737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:10.464737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:10.464737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:10.464737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:10.464737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:10.464737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:10.464737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:10.464737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:10.464737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 22 17:13:10.464737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 22 17:13:10.464737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 22 17:13:10.464737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:13:10.466113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:10.466113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.466113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:10.466113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.466113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.466113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:10.466113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:10.466113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:13:10.466113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:13:10.466113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:10.466113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.471099 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a9d67ee4-1c59-4b43-a147-4c12543aa0de tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:10.472171 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a9d67ee4-1c59-4b43-a147-4c12543aa0de tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.047335 Aug 22 17:13:10.472887 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 273/504] 10.222.0.96 () {58 vars in 1215 bytes} [Mon Aug 22 17:13:10 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:13:10.489112 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7aeec7d9-0326-4e71-8d6f-cc5b1c185775 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Action: 'update', calling method: .version_select at 0x7f8009cf6430>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7aeec7d9-0326-4e71-8d6f-cc5b1c185775 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Request method failure captured: Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: request: PUT /compute/v2.1/os-hosts/n-d-854030-1 HTTP/1.1 Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 51 Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7kjCKyVZJYjRAamYwD1Q6N8QShaSk7HvP5MvubN6kPFiwoNJNpm6_LwsrVZ-ztKcCLRfbJANF0BkV8NkDSZEHDuXb0xq0vfX91dn60ge7M1aWfiZUXezEYwKfvRy09EN0QvigTyl57oAWTfqZ-Mwu-l6tfvuZABalwzuh0aI0dVUhU Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 9d888f65b31546348bb61ea2563630cc Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:13:10.493783 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:13:10.495200 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9d888f65b31546348bb61ea2563630cc", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:10.495200 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:10.495200 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 9d888f65b31546348bb61ea2563630cc Aug 22 17:13:10.495200 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:10.495200 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-HostsAdminNegativeTestJSON-410957140-project-admin Aug 22 17:13:10.495200 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:10.495200 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:10.495200 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 48ce39eec5a84c52bf89bc1a9a291337 Aug 22 17:13:10.495200 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-HostsAdminNegativeTestJSON-410957140-project-admin Aug 22 17:13:10.495200 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:13:10.495200 n-d-854030-1 devstack@n-api.service[123015]: {"status": "enable", "maintenance_mode": "invalid"} Aug 22 17:13:10.495200 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:13:10.495200 n-d-854030-1 devstack@n-api.service[123015]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'n-d-854030-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'disable', Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'Enable', Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'Disable', Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi On instance: Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'invalid' Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.496322 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:10.497939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:10.497939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:10.497939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:10.497939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:10.497939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:10.497939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:10.497939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:10.497939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:13:10.497939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:13:10.497939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:13:10.497939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:13:10.497939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:13:10.497939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:13:10.497939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 22 17:13:10.497939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.497939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:10.497939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.497939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.497939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:10.499064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:10.499064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:13:10.499064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:13:10.499064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 22 17:13:10.499064 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.499064 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7aeec7d9-0326-4e71-8d6f-cc5b1c185775 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:10.499064 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7aeec7d9-0326-4e71-8d6f-cc5b1c185775 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-hosts/n-d-854030-1" status: 400 len: 199 microversion: 2.1 time: 0.011010 Aug 22 17:13:10.499064 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 274/505] 10.222.0.96 () {60 vars in 1187 bytes} [Mon Aug 22 17:13:10 2022] PUT /compute/v2.1/os-hosts/n-d-854030-1 => generated 199 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 22 17:13:10.511838 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c28c1198-33bf-4f18-9941-7978f8c2004d tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Action: 'update', calling method: .version_select at 0x7f8009ce1430>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c28c1198-33bf-4f18-9941-7978f8c2004d tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Request method failure captured: Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: request: PUT /compute/v2.1/os-hosts/n-d-854030-1 HTTP/1.1 Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 51 Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7kjCKyVZJYjRAamYwD1Q6N8QShaSk7HvP5MvubN6kPFiwoNJNpm6_LwsrVZ-ztKcCLRfbJANF0BkV8NkDSZEHDuXb0xq0vfX91dn60ge7M1aWfiZUXezEYwKfvRy09EN0QvigTyl57oAWTfqZ-Mwu-l6tfvuZABalwzuh0aI0dVUhU Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 9d888f65b31546348bb61ea2563630cc Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:13:10.517841 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:13:10.519183 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9d888f65b31546348bb61ea2563630cc", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:10.519183 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:10.519183 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 9d888f65b31546348bb61ea2563630cc Aug 22 17:13:10.519183 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:10.519183 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-HostsAdminNegativeTestJSON-410957140-project-admin Aug 22 17:13:10.519183 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:10.519183 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:10.519183 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 48ce39eec5a84c52bf89bc1a9a291337 Aug 22 17:13:10.519183 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-HostsAdminNegativeTestJSON-410957140-project-admin Aug 22 17:13:10.519183 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:13:10.519183 n-d-854030-1 devstack@n-api.service[123015]: {"status": "invalid", "maintenance_mode": "enable"} Aug 22 17:13:10.519183 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:13:10.519183 n-d-854030-1 devstack@n-api.service[123015]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'n-d-854030-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'disable', Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'Enable', Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'Disable', Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi On instance: Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'invalid' Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.520188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:10.522188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:10.522188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:10.522188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:10.522188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:10.522188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:10.522188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:10.522188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:10.522188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:13:10.522188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:13:10.522188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:13:10.522188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:13:10.522188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:13:10.522188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:13:10.522188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 22 17:13:10.522188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.522188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:10.522188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.522188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.522188 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:10.523431 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:10.523431 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:13:10.523431 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:13:10.523431 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 22 17:13:10.523431 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.523431 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c28c1198-33bf-4f18-9941-7978f8c2004d tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:10.523431 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c28c1198-33bf-4f18-9941-7978f8c2004d tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-hosts/n-d-854030-1" status: 400 len: 189 microversion: 2.1 time: 0.016758 Aug 22 17:13:10.523431 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 275/506] 10.222.0.96 () {60 vars in 1187 bytes} [Mon Aug 22 17:13:10 2022] PUT /compute/v2.1/os-hosts/n-d-854030-1 => generated 189 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:13:10.541154 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-891b24e5-89fd-4b5b-8f5b-b7130f4b8dc8 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Action: 'update', calling method: .version_select at 0x7f8009df00d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-891b24e5-89fd-4b5b-8f5b-b7130f4b8dc8 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'ff980c0336ba4ab49d1e85282a662e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec8b6ed3c1d4e30a0cf9ee09511faa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-891b24e5-89fd-4b5b-8f5b-b7130f4b8dc8 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Request method failure captured: Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: request: PUT /compute/v2.1/os-hosts/n-d-854030-1 HTTP/1.1 Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 50 Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7khaNPRDN2SrCuQTlko4EK0t5GIPaEwmT2n51mBcASRs_Xn63KqBqjPzvh34lHOapKV4B3NBsFO3Byp392gXC3kmzrKKIoH4zByuW8iGjL6zX-Rrj7GTsQ7heO2V6vFkMGY8oOCQN42nfSEz1BtWlnb6FROZ5yaZfvhodFq3ZHwWfE Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:10.581027 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:10.582577 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 9ec8b6ed3c1d4e30a0cf9ee09511faa8 Aug 22 17:13:10.582577 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2077406770 Aug 22 17:13:10.582577 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:13:10.582577 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:13:10.582577 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ec8b6ed3c1d4e30a0cf9ee09511faa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9ec8b6ed3c1d4e30a0cf9ee09511faa8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9ec8b6ed3c1d4e30a0cf9ee09511faa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9ec8b6ed3c1d4e30a0cf9ee09511faa8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:10.582577 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2077406770 Aug 22 17:13:10.582577 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 9ec8b6ed3c1d4e30a0cf9ee09511faa8 Aug 22 17:13:10.582577 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2077406770 Aug 22 17:13:10.582577 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-HostsAdminNegativeTestJSON-2077406770-project Aug 22 17:13:10.582577 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:10.582577 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:10.582577 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: ff980c0336ba4ab49d1e85282a662e53 Aug 22 17:13:10.582577 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2077406770-project Aug 22 17:13:10.582577 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:13:10.582577 n-d-854030-1 devstack@n-api.service[123015]: {"status": "enable", "maintenance_mode": "enable"} Aug 22 17:13:10.582577 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'n-d-854030-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:13:10.583578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:13:10.584898 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 22 17:13:10.586057 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.586057 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-891b24e5-89fd-4b5b-8f5b-b7130f4b8dc8 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:10.586057 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-891b24e5-89fd-4b5b-8f5b-b7130f4b8dc8 tempest-HostsAdminNegativeTestJSON-2077406770 tempest-HostsAdminNegativeTestJSON-2077406770-project] 10.222.0.96 "PUT /compute/v2.1/os-hosts/n-d-854030-1" status: 403 len: 111 microversion: 2.1 time: 0.022693 Aug 22 17:13:10.586057 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 276/507] 10.222.0.96 () {60 vars in 1187 bytes} [Mon Aug 22 17:13:10 2022] PUT /compute/v2.1/os-hosts/n-d-854030-1 => generated 111 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:10.592420 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4d9692f7-f154-4e76-8698-6dca5f5ff20e tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Action: 'update', calling method: .version_select at 0x7f8009d2b5e0>, body: {"status": null, "maintenance_mode": null} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4d9692f7-f154-4e76-8698-6dca5f5ff20e tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Request method failure captured: Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: request: PUT /compute/v2.1/os-hosts/n-d-854030-1 HTTP/1.1 Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 42 Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7kjCKyVZJYjRAamYwD1Q6N8QShaSk7HvP5MvubN6kPFiwoNJNpm6_LwsrVZ-ztKcCLRfbJANF0BkV8NkDSZEHDuXb0xq0vfX91dn60ge7M1aWfiZUXezEYwKfvRy09EN0QvigTyl57oAWTfqZ-Mwu-l6tfvuZABalwzuh0aI0dVUhU Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 9d888f65b31546348bb61ea2563630cc Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:13:10.598240 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:13:10.599840 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9d888f65b31546348bb61ea2563630cc", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:10.599840 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:10.599840 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 9d888f65b31546348bb61ea2563630cc Aug 22 17:13:10.599840 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:10.599840 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-HostsAdminNegativeTestJSON-410957140-project-admin Aug 22 17:13:10.599840 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:10.599840 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:10.599840 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 48ce39eec5a84c52bf89bc1a9a291337 Aug 22 17:13:10.599840 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-HostsAdminNegativeTestJSON-410957140-project-admin Aug 22 17:13:10.599840 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:13:10.599840 n-d-854030-1 devstack@n-api.service[123015]: {"status": null, "maintenance_mode": null} Aug 22 17:13:10.599840 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:13:10.599840 n-d-854030-1 devstack@n-api.service[123015]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 22 17:13:10.599840 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'n-d-854030-1', 'body': {'status': None, 'maintenance_mode': None}} Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'disable', Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'Enable', Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'Disable', Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi On instance: Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi None Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:10.600715 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:10.602733 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:10.602733 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:10.602733 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:10.602733 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:10.602733 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:10.602733 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:10.602733 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:13:10.602733 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:13:10.602733 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:13:10.602733 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:13:10.602733 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:13:10.602733 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:13:10.602733 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 22 17:13:10.602733 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.602733 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:10.602733 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.602733 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.602733 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:10.602733 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:10.603832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:13:10.603832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:13:10.603832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 22 17:13:10.603832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.603832 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4d9692f7-f154-4e76-8698-6dca5f5ff20e tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:10.603832 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-4d9692f7-f154-4e76-8698-6dca5f5ff20e tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-hosts/n-d-854030-1" status: 400 len: 127 microversion: 2.1 time: 0.012177 Aug 22 17:13:10.605577 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 277/508] 10.222.0.96 () {60 vars in 1187 bytes} [Mon Aug 22 17:13:10 2022] PUT /compute/v2.1/os-hosts/n-d-854030-1 => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:13:10.610393 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-04312357-7362-4168-adb2-3c0fb85b2446 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Action: 'update', calling method: .version_select at 0x7f8009f289d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:10.613903 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.hosts [None req-04312357-7362-4168-adb2-3c0fb85b2446 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Enabling host nonexistent_hostname. Aug 22 17:13:10.632590 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-04312357-7362-4168-adb2-3c0fb85b2446 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-04312357-7362-4168-adb2-3c0fb85b2446 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Request method failure captured: Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 50 Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7kjCKyVZJYjRAamYwD1Q6N8QShaSk7HvP5MvubN6kPFiwoNJNpm6_LwsrVZ-ztKcCLRfbJANF0BkV8NkDSZEHDuXb0xq0vfX91dn60ge7M1aWfiZUXezEYwKfvRy09EN0QvigTyl57oAWTfqZ-Mwu-l6tfvuZABalwzuh0aI0dVUhU Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 9d888f65b31546348bb61ea2563630cc Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:13:10.634618 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:13:10.635940 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9d888f65b31546348bb61ea2563630cc", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9d888f65b31546348bb61ea2563630cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:10.635940 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:10.635940 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 9d888f65b31546348bb61ea2563630cc Aug 22 17:13:10.635940 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-410957140 Aug 22 17:13:10.635940 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-HostsAdminNegativeTestJSON-410957140-project-admin Aug 22 17:13:10.635940 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:10.635940 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:10.635940 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 48ce39eec5a84c52bf89bc1a9a291337 Aug 22 17:13:10.635940 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-HostsAdminNegativeTestJSON-410957140-project-admin Aug 22 17:13:10.635940 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:13:10.635940 n-d-854030-1 devstack@n-api.service[123015]: {"status": "enable", "maintenance_mode": "enable"} Aug 22 17:13:10.635940 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:13:10.635940 n-d-854030-1 devstack@n-api.service[123015]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:10.635940 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 22 17:13:10.636849 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:10.636849 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.636849 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 22 17:13:10.636849 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 22 17:13:10.636849 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 22 17:13:10.636849 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 22 17:13:10.636849 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:13:10.636849 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:13:10.636849 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:13:10.636849 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:13:10.636849 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 22 17:13:10.636849 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 22 17:13:10.636849 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 22 17:13:10.636849 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 22 17:13:10.636849 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:13:10.636849 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:13:10.636849 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 22 17:13:10.636849 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:10.637996 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 22 17:13:10.639379 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 22 17:13:10.639379 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 22 17:13:10.639379 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:13:10.639379 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:10.639379 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.639379 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:10.639379 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.639379 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.639379 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:10.639379 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:10.639379 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:13:10.639379 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:13:10.639379 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 22 17:13:10.639379 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.639379 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-04312357-7362-4168-adb2-3c0fb85b2446 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:10.640585 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-04312357-7362-4168-adb2-3c0fb85b2446 tempest-HostsAdminNegativeTestJSON-410957140 tempest-HostsAdminNegativeTestJSON-410957140-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.029402 Aug 22 17:13:10.640585 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 278/509] 10.222.0.96 () {60 vars in 1211 bytes} [Mon Aug 22 17:13:10 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:13:10.641412 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b4b53c84-e2d4-487c-a812-87bf82c09251 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:10.650844 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b4b53c84-e2d4-487c-a812-87bf82c09251 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] [instance: 791d0306-dc08-4e10-81c8-003730a5ce09] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:10.664956 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b4b53c84-e2d4-487c-a812-87bf82c09251 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:10.666817 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b4b53c84-e2d4-487c-a812-87bf82c09251 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:10.668376 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b4b53c84-e2d4-487c-a812-87bf82c09251 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:10.670384 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b4b53c84-e2d4-487c-a812-87bf82c09251 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:10.671614 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b4b53c84-e2d4-487c-a812-87bf82c09251 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:10.672098 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b4b53c84-e2d4-487c-a812-87bf82c09251 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:10.688971 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-b4b53c84-e2d4-487c-a812-87bf82c09251 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] HTTP exception thrown: Instance 791d0306-dc08-4e10-81c8-003730a5ce09 could not be found. Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b4b53c84-e2d4-487c-a812-87bf82c09251 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Request method failure captured: Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 HTTP/1.1 Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7kHHOiDzNKoLiSQd__0MqSg7wOQ4qsJzbrjVj758Ga1y09Z-xTQ0mQ8rRKFddQdmdfYMJUnAqTsEPzF8gzlKdj3VU652BZGA1u2kxzPh14HJvKoGVrNZmf3_BnurYa5XGzv3XkT5uxDKagQGwf2-vSfdUvV0BBU-mj5kSMuN44pKxw Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: b5c2cfdafd4547d9bca73946ae404f9d Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-804153059 Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:13:10.690650 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:13:10.692008 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/b5c2cfdafd4547d9bca73946ae404f9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_b5c2cfdafd4547d9bca73946ae404f9d", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/b5c2cfdafd4547d9bca73946ae404f9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/b5c2cfdafd4547d9bca73946ae404f9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:10.692008 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-804153059 Aug 22 17:13:10.692008 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: b5c2cfdafd4547d9bca73946ae404f9d Aug 22 17:13:10.692008 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-804153059 Aug 22 17:13:10.692008 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServerDiagnosticsNegativeTest-804153059-project Aug 22 17:13:10.692008 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:10.692008 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:10.692008 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: a7f796c0f6b643eb8d717afc1006b584 Aug 22 17:13:10.692008 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-804153059-project Aug 22 17:13:10.692008 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:13:10.692008 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance 791d0306-dc08-4e10-81c8-003730a5ce09 could not be found. Aug 22 17:13:10.692008 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '791d0306-dc08-4e10-81c8-003730a5ce09'} Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 791d0306-dc08-4e10-81c8-003730a5ce09 could not be found. Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:10.692826 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:10.694780 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:10.694780 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:13:10.694780 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:13:10.694780 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:13:10.694780 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:13:10.694780 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:13:10.694780 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:13:10.694780 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 791d0306-dc08-4e10-81c8-003730a5ce09 could not be found. Aug 22 17:13:10.694780 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.694780 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:10.694780 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.694780 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:10.694780 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:10.694780 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:10.694780 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:13:10.694780 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:13:10.694780 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 791d0306-dc08-4e10-81c8-003730a5ce09 could not be found. Aug 22 17:13:10.694780 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:10.695928 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b4b53c84-e2d4-487c-a812-87bf82c09251 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] Returning 404 to user: Instance 791d0306-dc08-4e10-81c8-003730a5ce09 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:10.695928 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b4b53c84-e2d4-487c-a812-87bf82c09251 tempest-ServerDiagnosticsNegativeTest-804153059 tempest-ServerDiagnosticsNegativeTest-804153059-project] 10.222.0.96 "GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09" status: 404 len: 111 microversion: 2.1 time: 0.054545 Aug 22 17:13:10.695928 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 279/510] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:10 2022] GET /compute/v2.1/servers/791d0306-dc08-4e10-81c8-003730a5ce09 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:10.938066 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e1dc5188-058d-4bbe-9b48-0aad0ab2bc00 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:10.938699 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-e1dc5188-058d-4bbe-9b48-0aad0ab2bc00 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:10.945667 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e1dc5188-058d-4bbe-9b48-0aad0ab2bc00 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:10.946182 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e1dc5188-058d-4bbe-9b48-0aad0ab2bc00 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:10.946617 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e1dc5188-058d-4bbe-9b48-0aad0ab2bc00 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:10.947315 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e1dc5188-058d-4bbe-9b48-0aad0ab2bc00 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:10.947816 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e1dc5188-058d-4bbe-9b48-0aad0ab2bc00 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:10.948240 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e1dc5188-058d-4bbe-9b48-0aad0ab2bc00 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:11.016179 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e1dc5188-058d-4bbe-9b48-0aad0ab2bc00 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:11.027395 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e1dc5188-058d-4bbe-9b48-0aad0ab2bc00 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:11.027395 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e1dc5188-058d-4bbe-9b48-0aad0ab2bc00 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:11.031907 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e1dc5188-058d-4bbe-9b48-0aad0ab2bc00 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.098033 Aug 22 17:13:11.032482 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 280/511] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:10 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:13:11.446238 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8673e50b-e72a-427c-8850-eb00470453b5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:11.447776 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8673e50b-e72a-427c-8850-eb00470453b5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:11.455983 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8673e50b-e72a-427c-8850-eb00470453b5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:11.456474 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8673e50b-e72a-427c-8850-eb00470453b5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:11.456912 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8673e50b-e72a-427c-8850-eb00470453b5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:11.459903 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8673e50b-e72a-427c-8850-eb00470453b5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:11.460376 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8673e50b-e72a-427c-8850-eb00470453b5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:11.460812 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8673e50b-e72a-427c-8850-eb00470453b5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:11.832822 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8673e50b-e72a-427c-8850-eb00470453b5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:11.836706 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:11.847304 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8673e50b-e72a-427c-8850-eb00470453b5 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1319 microversion: 2.1 time: 0.404950 Aug 22 17:13:11.849105 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 281/512] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:11 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1319 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:13:12.018187 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=8 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:12.058613 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c2d51b45-72c2-44ed-90fc-dda0b92891c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:12.059361 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-c2d51b45-72c2-44ed-90fc-dda0b92891c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:12.070084 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c2d51b45-72c2-44ed-90fc-dda0b92891c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:12.074406 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c2d51b45-72c2-44ed-90fc-dda0b92891c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:12.074979 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c2d51b45-72c2-44ed-90fc-dda0b92891c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:12.079278 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c2d51b45-72c2-44ed-90fc-dda0b92891c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:12.080422 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c2d51b45-72c2-44ed-90fc-dda0b92891c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:12.082947 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c2d51b45-72c2-44ed-90fc-dda0b92891c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:12.326610 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c2d51b45-72c2-44ed-90fc-dda0b92891c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:12.342739 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c2d51b45-72c2-44ed-90fc-dda0b92891c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:12.344298 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c2d51b45-72c2-44ed-90fc-dda0b92891c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:12.365503 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c2d51b45-72c2-44ed-90fc-dda0b92891c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.311159 Aug 22 17:13:12.366105 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 282/513] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:12 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:13:12.868328 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c1c4ac8a-284f-42e6-9437-fd5a91327ed2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:12.870109 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-c1c4ac8a-284f-42e6-9437-fd5a91327ed2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:12.878856 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c1c4ac8a-284f-42e6-9437-fd5a91327ed2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:12.882006 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c1c4ac8a-284f-42e6-9437-fd5a91327ed2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:12.884339 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c1c4ac8a-284f-42e6-9437-fd5a91327ed2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:12.889903 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c1c4ac8a-284f-42e6-9437-fd5a91327ed2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:12.890579 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c1c4ac8a-284f-42e6-9437-fd5a91327ed2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:12.891219 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c1c4ac8a-284f-42e6-9437-fd5a91327ed2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:13.290793 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c1c4ac8a-284f-42e6-9437-fd5a91327ed2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:13.302198 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c1c4ac8a-284f-42e6-9437-fd5a91327ed2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1319 microversion: 2.1 time: 0.437702 Aug 22 17:13:13.320418 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 283/514] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:12 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1319 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:13:13.815679 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2ebd79a9-31b4-4f63-a438-6fe4cd1a5246 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Calling method '.version_select at 0x7f8009ee4ee0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:14.040352 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2ebd79a9-31b4-4f63-a438-6fe4cd1a5246 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/26a5850264ad4abfb92a24ba32d0748b" status: 200 len: 371 microversion: 2.1 time: 0.718603 Aug 22 17:13:14.049789 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 284/515] 10.222.0.96 () {58 vars in 1242 bytes} [Mon Aug 22 17:13:13 2022] GET /compute/v2.1/os-quota-sets/26a5850264ad4abfb92a24ba32d0748b => generated 371 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:14.056131 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-56a6431a-49c8-4a16-80ff-4de3ba84b3c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:14.056739 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-56a6431a-49c8-4a16-80ff-4de3ba84b3c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:14.125394 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-56a6431a-49c8-4a16-80ff-4de3ba84b3c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:14.126702 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-56a6431a-49c8-4a16-80ff-4de3ba84b3c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:14.127494 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-56a6431a-49c8-4a16-80ff-4de3ba84b3c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:14.128638 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-56a6431a-49c8-4a16-80ff-4de3ba84b3c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:14.129335 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-56a6431a-49c8-4a16-80ff-4de3ba84b3c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:14.129943 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-56a6431a-49c8-4a16-80ff-4de3ba84b3c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:14.374900 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-56a6431a-49c8-4a16-80ff-4de3ba84b3c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:14.387051 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-56a6431a-49c8-4a16-80ff-4de3ba84b3c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:14.387051 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-56a6431a-49c8-4a16-80ff-4de3ba84b3c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:14.402636 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-56a6431a-49c8-4a16-80ff-4de3ba84b3c7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.350206 Aug 22 17:13:14.426383 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 285/516] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:14 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:14.433336 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b513767c-16c9-4f17-bb11-bb5d1df5ec32 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Action: 'update', calling method: .version_select at 0x7f8009d2b700>, body: {"quota_set": {"ram": "5120"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:14.668002 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-6bc626fb-79e3-40f7-a606-591cb21c55c2 tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] 10.222.0.96 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.134445 Aug 22 17:13:14.668002 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 232/517] 10.222.0.96 () {60 vars in 1170 bytes} [Mon Aug 22 17:13:09 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:14.668002 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e28e7bd9-ba1f-4c3c-968f-350c0ac13946 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:14.668697 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e28e7bd9-ba1f-4c3c-968f-350c0ac13946 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:14.685911 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e28e7bd9-ba1f-4c3c-968f-350c0ac13946 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:14.686396 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e28e7bd9-ba1f-4c3c-968f-350c0ac13946 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:14.692118 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e28e7bd9-ba1f-4c3c-968f-350c0ac13946 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:14.693547 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e28e7bd9-ba1f-4c3c-968f-350c0ac13946 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:14.695224 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e28e7bd9-ba1f-4c3c-968f-350c0ac13946 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:14.696677 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e28e7bd9-ba1f-4c3c-968f-350c0ac13946 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:14.905967 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b513767c-16c9-4f17-bb11-bb5d1df5ec32 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:14.908268 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b513767c-16c9-4f17-bb11-bb5d1df5ec32 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:14.911675 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b513767c-16c9-4f17-bb11-bb5d1df5ec32 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:14.912703 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b513767c-16c9-4f17-bb11-bb5d1df5ec32 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:14.913705 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b513767c-16c9-4f17-bb11-bb5d1df5ec32 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:14.914134 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b513767c-16c9-4f17-bb11-bb5d1df5ec32 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:15.002462 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:15.012250 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e28e7bd9-ba1f-4c3c-968f-350c0ac13946 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:15.028764 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e28e7bd9-ba1f-4c3c-968f-350c0ac13946 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1319 microversion: 2.1 time: 0.361118 Aug 22 17:13:15.049329 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 233/518] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:14 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:15.054642 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-af8d9559-4beb-44d8-ac95-d72ce3a716c4 tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] Calling method '.version_select at 0x7f8009e5bb80>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:15.109040 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b513767c-16c9-4f17-bb11-bb5d1df5ec32 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-quota-sets/26a5850264ad4abfb92a24ba32d0748b" status: 200 len: 328 microversion: 2.1 time: 0.680964 Aug 22 17:13:15.113139 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 286/519] 10.222.0.96 () {60 vars in 1262 bytes} [Mon Aug 22 17:13:14 2022] PUT /compute/v2.1/os-quota-sets/26a5850264ad4abfb92a24ba32d0748b => generated 328 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:15.123213 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2f9252c6-9844-4bf0-b4a2-1b8295d0444b tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:15.223085 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2f9252c6-9844-4bf0-b4a2-1b8295d0444b tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-quota-sets/26a5850264ad4abfb92a24ba32d0748b" status: 202 len: 0 microversion: 2.1 time: 0.104479 Aug 22 17:13:15.224043 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 287/520] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:13:15 2022] DELETE /compute/v2.1/os-quota-sets/26a5850264ad4abfb92a24ba32d0748b => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:13:15.234089 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d520c604-2bac-433d-bf15-6409df541071 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Calling method '.version_select at 0x7f8009e9f280>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:15.499861 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d520c604-2bac-433d-bf15-6409df541071 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/26a5850264ad4abfb92a24ba32d0748b" status: 200 len: 371 microversion: 2.1 time: 0.271343 Aug 22 17:13:15.500467 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 288/521] 10.222.0.96 () {58 vars in 1242 bytes} [Mon Aug 22 17:13:15 2022] GET /compute/v2.1/os-quota-sets/26a5850264ad4abfb92a24ba32d0748b => generated 371 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:13:15.514252 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b1a33fc3-7547-44a1-aede-bdc25783a8bd tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:15.514868 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b1a33fc3-7547-44a1-aede-bdc25783a8bd tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:15.534926 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b1a33fc3-7547-44a1-aede-bdc25783a8bd tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:15.535121 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b1a33fc3-7547-44a1-aede-bdc25783a8bd tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:15.535705 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b1a33fc3-7547-44a1-aede-bdc25783a8bd tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:15.536677 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b1a33fc3-7547-44a1-aede-bdc25783a8bd tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:15.537371 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b1a33fc3-7547-44a1-aede-bdc25783a8bd tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:15.537760 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b1a33fc3-7547-44a1-aede-bdc25783a8bd tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:15.574807 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-af8d9559-4beb-44d8-ac95-d72ce3a716c4 tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] 10.222.0.96 "GET /compute/v2.1/os-floating-ips/76197fb7-61d2-4ee5-9f7e-f2ac6b50b514" status: 200 len: 141 microversion: 2.1 time: 0.523890 Aug 22 17:13:15.577297 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 234/522] 10.222.0.96 () {58 vars in 1260 bytes} [Mon Aug 22 17:13:15 2022] GET /compute/v2.1/os-floating-ips/76197fb7-61d2-4ee5-9f7e-f2ac6b50b514 => generated 141 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:15.590172 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e5a87de4-b5d4-4daa-8627-6be77ca8cf52 tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] Calling method '.version_select at 0x7f8009eb0a60>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:15.675025 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b1a33fc3-7547-44a1-aede-bdc25783a8bd tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:15.685536 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b1a33fc3-7547-44a1-aede-bdc25783a8bd tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:15.691332 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b1a33fc3-7547-44a1-aede-bdc25783a8bd tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:15.707912 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b1a33fc3-7547-44a1-aede-bdc25783a8bd tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.195947 Aug 22 17:13:15.710699 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 289/523] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:15 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:15.973579 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b43c1d8a-0e4e-4b8c-a66d-30054bad203e tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Calling method '.version_select at 0x7f8009c3a9d0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:16.044747 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e5a87de4-b5d4-4daa-8627-6be77ca8cf52 tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] 10.222.0.96 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.459209 Aug 22 17:13:16.045403 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 235/524] 10.222.0.96 () {58 vars in 1149 bytes} [Mon Aug 22 17:13:15 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:16.052807 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-723a14cf-5cfb-4a8c-ac67-60cfb45c6d58 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:16.055021 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-723a14cf-5cfb-4a8c-ac67-60cfb45c6d58 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:16.074698 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-723a14cf-5cfb-4a8c-ac67-60cfb45c6d58 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:16.075188 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-723a14cf-5cfb-4a8c-ac67-60cfb45c6d58 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:16.082768 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-723a14cf-5cfb-4a8c-ac67-60cfb45c6d58 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:16.085197 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-723a14cf-5cfb-4a8c-ac67-60cfb45c6d58 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:16.088539 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-723a14cf-5cfb-4a8c-ac67-60cfb45c6d58 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:16.089118 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-723a14cf-5cfb-4a8c-ac67-60cfb45c6d58 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:16.632140 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b43c1d8a-0e4e-4b8c-a66d-30054bad203e tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/7c4f70b6c5ed4dc6885f27363c61379d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.664505 Aug 22 17:13:16.633324 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 290/525] 10.222.0.96 () {58 vars in 1269 bytes} [Mon Aug 22 17:13:15 2022] GET /compute/v2.1/os-quota-sets/7c4f70b6c5ed4dc6885f27363c61379d/defaults => generated 371 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:13:16.637979 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1a8273e8-07a5-4708-87a8-af847cd2e0ae tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] Calling method '.version_select at 0x7f8009c3a700>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:16.743482 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-723a14cf-5cfb-4a8c-ac67-60cfb45c6d58 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:16.760901 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-723a14cf-5cfb-4a8c-ac67-60cfb45c6d58 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1319 microversion: 2.1 time: 0.712168 Aug 22 17:13:16.761770 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 236/526] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:16 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1319 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:13:16.774003 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b002fd20-6485-44e7-8d6c-eceea117b9f7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:16.776949 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b002fd20-6485-44e7-8d6c-eceea117b9f7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:16.795334 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b002fd20-6485-44e7-8d6c-eceea117b9f7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:16.803068 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b002fd20-6485-44e7-8d6c-eceea117b9f7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:16.804710 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b002fd20-6485-44e7-8d6c-eceea117b9f7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:16.806314 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b002fd20-6485-44e7-8d6c-eceea117b9f7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:16.809530 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b002fd20-6485-44e7-8d6c-eceea117b9f7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:16.810141 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b002fd20-6485-44e7-8d6c-eceea117b9f7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:17.002708 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b002fd20-6485-44e7-8d6c-eceea117b9f7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:17.014930 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b002fd20-6485-44e7-8d6c-eceea117b9f7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:17.017368 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b002fd20-6485-44e7-8d6c-eceea117b9f7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:17.028061 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b002fd20-6485-44e7-8d6c-eceea117b9f7 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1446 microversion: 2.75 time: 0.261280 Aug 22 17:13:17.030919 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 237/527] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:16 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1446 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:17.245605 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7e8728dc-d55a-4c9e-93c5-8993606a2a71 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Action: 'update', calling method: .version_select at 0x7f8009df2430>, body: {"quota_set": {"ram": "5120"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:17.864993 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e8728dc-d55a-4c9e-93c5-8993606a2a71 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:17.865520 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e8728dc-d55a-4c9e-93c5-8993606a2a71 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:17.865956 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e8728dc-d55a-4c9e-93c5-8993606a2a71 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:17.866683 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e8728dc-d55a-4c9e-93c5-8993606a2a71 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:17.867138 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e8728dc-d55a-4c9e-93c5-8993606a2a71 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:17.867563 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e8728dc-d55a-4c9e-93c5-8993606a2a71 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:17.942602 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:18.083402 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7e8728dc-d55a-4c9e-93c5-8993606a2a71 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-quota-sets/2aa47af4f61146deb0335f5e6b5291dc" status: 200 len: 328 microversion: 2.1 time: 0.839312 Aug 22 17:13:18.092173 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 238/528] 10.222.0.96 () {60 vars in 1262 bytes} [Mon Aug 22 17:13:17 2022] PUT /compute/v2.1/os-quota-sets/2aa47af4f61146deb0335f5e6b5291dc => generated 328 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:13:18.097345 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-976c1968-506c-43f3-add8-bd11c69e04c9 req-5b71bb1e-57ea-490d-9db9-a65320a5a95f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818bc982-f088-43a6-930c-f998d3345296", "name": "network-vif-plugged", "status": "completed", "tag": "ab4e3be9-90f8-44af-9b6e-35ddf22fde9e"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:18.139151 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-976c1968-506c-43f3-add8-bd11c69e04c9 req-5b71bb1e-57ea-490d-9db9-a65320a5a95f service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:18.139633 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-976c1968-506c-43f3-add8-bd11c69e04c9 req-5b71bb1e-57ea-490d-9db9-a65320a5a95f service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:18.140073 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-976c1968-506c-43f3-add8-bd11c69e04c9 req-5b71bb1e-57ea-490d-9db9-a65320a5a95f service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:18.170480 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-976c1968-506c-43f3-add8-bd11c69e04c9 req-5b71bb1e-57ea-490d-9db9-a65320a5a95f service nova] Creating event network-vif-plugged:ab4e3be9-90f8-44af-9b6e-35ddf22fde9e for instance 818bc982-f088-43a6-930c-f998d3345296 on n-h2-854030-1 Aug 22 17:13:18.195342 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-976c1968-506c-43f3-add8-bd11c69e04c9 req-5b71bb1e-57ea-490d-9db9-a65320a5a95f service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101726 Aug 22 17:13:18.196376 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 239/529] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:18.204929 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1d9618b3-333a-458b-a6a3-3dd99ac6f238 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:18.217737 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-1d9618b3-333a-458b-a6a3-3dd99ac6f238 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:18.271939 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1d9618b3-333a-458b-a6a3-3dd99ac6f238 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:18.272562 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1d9618b3-333a-458b-a6a3-3dd99ac6f238 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:18.272874 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1d9618b3-333a-458b-a6a3-3dd99ac6f238 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:18.285654 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1d9618b3-333a-458b-a6a3-3dd99ac6f238 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:18.290963 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1d9618b3-333a-458b-a6a3-3dd99ac6f238 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:18.291689 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1d9618b3-333a-458b-a6a3-3dd99ac6f238 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:18.514138 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-1d9618b3-333a-458b-a6a3-3dd99ac6f238 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:18.523775 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1d9618b3-333a-458b-a6a3-3dd99ac6f238 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1319 microversion: 2.1 time: 0.325883 Aug 22 17:13:18.530075 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 240/530] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:18 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:18.540393 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-cb1e5989-e8ac-4b35-bfe1-2d632c40b372 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:18.541217 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-cb1e5989-e8ac-4b35-bfe1-2d632c40b372 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:18.553557 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb1e5989-e8ac-4b35-bfe1-2d632c40b372 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:18.559815 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb1e5989-e8ac-4b35-bfe1-2d632c40b372 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:18.561625 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb1e5989-e8ac-4b35-bfe1-2d632c40b372 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:18.563952 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb1e5989-e8ac-4b35-bfe1-2d632c40b372 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:18.565420 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb1e5989-e8ac-4b35-bfe1-2d632c40b372 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:18.566729 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb1e5989-e8ac-4b35-bfe1-2d632c40b372 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:18.734845 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-cb1e5989-e8ac-4b35-bfe1-2d632c40b372 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:18.745813 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-cb1e5989-e8ac-4b35-bfe1-2d632c40b372 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:18.748506 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-cb1e5989-e8ac-4b35-bfe1-2d632c40b372 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:18.763376 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-cb1e5989-e8ac-4b35-bfe1-2d632c40b372 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1452 microversion: 2.75 time: 0.231218 Aug 22 17:13:18.764496 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 241/531] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:18 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1452 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:18.770323 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-49913d54-437c-4432-9fad-cd2b2ad9a62a tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Calling method '.version_select at 0x7f8009eb88b0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:18.929230 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1a8273e8-07a5-4708-87a8-af847cd2e0ae tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] 10.222.0.96 "DELETE /compute/v2.1/os-floating-ips/76197fb7-61d2-4ee5-9f7e-f2ac6b50b514" status: 202 len: 0 microversion: 2.1 time: 2.294586 Aug 22 17:13:18.929967 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 291/532] 10.222.0.96 () {58 vars in 1263 bytes} [Mon Aug 22 17:13:16 2022] DELETE /compute/v2.1/os-floating-ips/76197fb7-61d2-4ee5-9f7e-f2ac6b50b514 => generated 0 bytes in 2296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:13:18.949820 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7e444d1f-1f16-4772-be51-5fa1da89c458 tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] Action: 'create', calling method: .version_select at 0x7f8009e9f550>, body: {"pool": null} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:19.125216 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-49913d54-437c-4432-9fad-cd2b2ad9a62a tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:19.126172 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-49913d54-437c-4432-9fad-cd2b2ad9a62a tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:19.126552 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-49913d54-437c-4432-9fad-cd2b2ad9a62a tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:19.127335 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-49913d54-437c-4432-9fad-cd2b2ad9a62a tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:19.127837 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-49913d54-437c-4432-9fad-cd2b2ad9a62a tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:19.128262 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-49913d54-437c-4432-9fad-cd2b2ad9a62a tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:19.170901 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-49913d54-437c-4432-9fad-cd2b2ad9a62a tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/2aa47af4f61146deb0335f5e6b5291dc/detail" status: 200 len: 916 microversion: 2.1 time: 0.404995 Aug 22 17:13:19.171528 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 242/533] 10.222.0.96 () {58 vars in 1263 bytes} [Mon Aug 22 17:13:18 2022] GET /compute/v2.1/os-quota-sets/2aa47af4f61146deb0335f5e6b5291dc/detail => generated 916 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:19.557366 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-34da2d94-1807-4150-8637-7335cc727bf6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:19.557366 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-34da2d94-1807-4150-8637-7335cc727bf6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:19.571201 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-34da2d94-1807-4150-8637-7335cc727bf6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:19.571700 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-34da2d94-1807-4150-8637-7335cc727bf6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:19.572275 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-34da2d94-1807-4150-8637-7335cc727bf6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:19.573048 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-34da2d94-1807-4150-8637-7335cc727bf6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:19.573798 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-34da2d94-1807-4150-8637-7335cc727bf6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:19.574578 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-34da2d94-1807-4150-8637-7335cc727bf6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:19.733954 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-34da2d94-1807-4150-8637-7335cc727bf6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:19.766547 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-34da2d94-1807-4150-8637-7335cc727bf6 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1319 microversion: 2.1 time: 0.194851 Aug 22 17:13:19.769560 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 243/534] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:19 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:13:19.805225 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6200893e-0f66-40fc-997c-e631687d8cb6 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:19.806426 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-6200893e-0f66-40fc-997c-e631687d8cb6 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:19.825861 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6200893e-0f66-40fc-997c-e631687d8cb6 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:19.826500 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6200893e-0f66-40fc-997c-e631687d8cb6 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:19.826950 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6200893e-0f66-40fc-997c-e631687d8cb6 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:19.827701 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6200893e-0f66-40fc-997c-e631687d8cb6 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:19.828161 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6200893e-0f66-40fc-997c-e631687d8cb6 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:19.828582 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6200893e-0f66-40fc-997c-e631687d8cb6 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:19.912672 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-6200893e-0f66-40fc-997c-e631687d8cb6 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:19.931554 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-6200893e-0f66-40fc-997c-e631687d8cb6 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:19.933437 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-6200893e-0f66-40fc-997c-e631687d8cb6 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:19.942544 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-6200893e-0f66-40fc-997c-e631687d8cb6 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1437 microversion: 2.75 time: 0.143225 Aug 22 17:13:19.966125 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 244/535] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:19 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1437 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:19.972611 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-08d9cd69-7f7f-4f5f-ba95-f1f89529209f tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Action: 'update', calling method: .version_select at 0x7f8009cba1f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:20.599623 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08d9cd69-7f7f-4f5f-ba95-f1f89529209f tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:20.600987 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08d9cd69-7f7f-4f5f-ba95-f1f89529209f tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:20.601672 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08d9cd69-7f7f-4f5f-ba95-f1f89529209f tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:20.603501 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08d9cd69-7f7f-4f5f-ba95-f1f89529209f tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:20.604543 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08d9cd69-7f7f-4f5f-ba95-f1f89529209f tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:20.605513 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08d9cd69-7f7f-4f5f-ba95-f1f89529209f tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:20.648282 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08d9cd69-7f7f-4f5f-ba95-f1f89529209f tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:20.648766 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08d9cd69-7f7f-4f5f-ba95-f1f89529209f tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:20.649255 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08d9cd69-7f7f-4f5f-ba95-f1f89529209f tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:20.650017 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08d9cd69-7f7f-4f5f-ba95-f1f89529209f tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:20.650474 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08d9cd69-7f7f-4f5f-ba95-f1f89529209f tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:20.650899 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08d9cd69-7f7f-4f5f-ba95-f1f89529209f tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:20.880412 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-08d9cd69-7f7f-4f5f-ba95-f1f89529209f tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-quota-sets/2aa47af4f61146deb0335f5e6b5291dc?user_id=64188385904347e09b0db57f35294ae4" status: 200 len: 328 microversion: 2.1 time: 0.912420 Aug 22 17:13:20.890268 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 245/536] 10.222.0.96 () {60 vars in 1343 bytes} [Mon Aug 22 17:13:19 2022] PUT /compute/v2.1/os-quota-sets/2aa47af4f61146deb0335f5e6b5291dc?user_id=64188385904347e09b0db57f35294ae4 => generated 328 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:21.250109 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:21.256425 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:21.265202 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:21.265912 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:21.266785 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:21.267681 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:21.268317 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:21.268755 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:21.362340 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:13:21.362760 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:13:21.363426 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:13:21.363839 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:13:21.364254 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:13:21.649470 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:21.660441 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:21.661228 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:21.661821 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:21.663613 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:21.664227 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:21.664810 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:21.803983 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:21.877726 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-19572f58-f759-42e3-ba0a-c06d6b762990 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18/action" status: 202 len: 1940 microversion: 2.75 time: 0.986490 Aug 22 17:13:21.878703 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 246/537] 10.222.0.96 () {62 vars in 1319 bytes} [Mon Aug 22 17:13:20 2022] POST /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18/action => generated 1940 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 22 17:13:22.029008 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ca039844-492d-4626-b68a-fac36245a71a tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1388298074", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:22.108714 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-ca039844-492d-4626-b68a-fac36245a71a tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] validate_networks() for None {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:13:22.154101 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7e444d1f-1f16-4772-be51-5fa1da89c458 tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] 10.222.0.96 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.216706 Aug 22 17:13:22.154723 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 292/538] 10.222.0.96 () {60 vars in 1170 bytes} [Mon Aug 22 17:13:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:13:22.166386 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b695fd11-adee-4aaf-82c8-d7157c5dbe31 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:22.167001 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b695fd11-adee-4aaf-82c8-d7157c5dbe31 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:22.175587 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b695fd11-adee-4aaf-82c8-d7157c5dbe31 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:22.176263 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b695fd11-adee-4aaf-82c8-d7157c5dbe31 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:22.176876 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b695fd11-adee-4aaf-82c8-d7157c5dbe31 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:22.178254 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b695fd11-adee-4aaf-82c8-d7157c5dbe31 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:22.179203 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b695fd11-adee-4aaf-82c8-d7157c5dbe31 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:22.179826 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b695fd11-adee-4aaf-82c8-d7157c5dbe31 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:22.355627 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-ca039844-492d-4626-b68a-fac36245a71a tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:13:22.356336 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-ca039844-492d-4626-b68a-fac36245a71a tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:13:22.357016 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-ca039844-492d-4626-b68a-fac36245a71a tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:13:22.357650 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-ca039844-492d-4626-b68a-fac36245a71a tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:13:22.358288 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-ca039844-492d-4626-b68a-fac36245a71a tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:13:22.369401 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ca039844-492d-4626-b68a-fac36245a71a tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:22.370368 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ca039844-492d-4626-b68a-fac36245a71a tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:22.371045 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ca039844-492d-4626-b68a-fac36245a71a tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:22.372002 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ca039844-492d-4626-b68a-fac36245a71a tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:22.372116 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b695fd11-adee-4aaf-82c8-d7157c5dbe31 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:22.372765 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ca039844-492d-4626-b68a-fac36245a71a tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:22.373454 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ca039844-492d-4626-b68a-fac36245a71a tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:22.382423 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b695fd11-adee-4aaf-82c8-d7157c5dbe31 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1469 microversion: 2.1 time: 0.222043 Aug 22 17:13:22.395048 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 293/539] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:22 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1469 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:22.395207 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=22 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:22.395306 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7c895545-52f3-4008-879a-c651b0ea2cba tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Calling method '.version_select at 0x7f8009ea7dc0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:22.395395 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-ca039844-492d-4626-b68a-fac36245a71a tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Getting quotas for project ffdd27bb05144d16aac5c3e39bc05a65. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:13:22.399583 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-ca039844-492d-4626-b68a-fac36245a71a tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Getting quotas for user 9fd8e9807c9b44e1b83ac7bacbaf8599 and project ffdd27bb05144d16aac5c3e39bc05a65. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:13:22.416505 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-ca039844-492d-4626-b68a-fac36245a71a tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Going to run 1 instances... {{(pid=123016) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:13:22.419303 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-ca039844-492d-4626-b68a-fac36245a71a tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:13:22.616144 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7c895545-52f3-4008-879a-c651b0ea2cba tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/2aa47af4f61146deb0335f5e6b5291dc?user_id=64188385904347e09b0db57f35294ae4" status: 200 len: 370 microversion: 2.1 time: 0.231022 Aug 22 17:13:22.616737 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 294/540] 10.222.0.96 () {58 vars in 1323 bytes} [Mon Aug 22 17:13:22 2022] GET /compute/v2.1/os-quota-sets/2aa47af4f61146deb0335f5e6b5291dc?user_id=64188385904347e09b0db57f35294ae4 => generated 370 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:22.654628 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ca039844-492d-4626-b68a-fac36245a71a tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774562 Aug 22 17:13:22.662782 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 247/541] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:13:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:13:22.668067 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-def7ddcb-bc1d-4c93-a17c-806a5343add0 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:22.668979 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-def7ddcb-bc1d-4c93-a17c-806a5343add0 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:22.679718 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-def7ddcb-bc1d-4c93-a17c-806a5343add0 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:22.681733 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-def7ddcb-bc1d-4c93-a17c-806a5343add0 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:22.681733 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-def7ddcb-bc1d-4c93-a17c-806a5343add0 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:22.682055 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-def7ddcb-bc1d-4c93-a17c-806a5343add0 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:22.682723 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-def7ddcb-bc1d-4c93-a17c-806a5343add0 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:22.683312 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-def7ddcb-bc1d-4c93-a17c-806a5343add0 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:22.783527 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-def7ddcb-bc1d-4c93-a17c-806a5343add0 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:22.805105 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-def7ddcb-bc1d-4c93-a17c-806a5343add0 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1927 microversion: 2.75 time: 0.140499 Aug 22 17:13:22.821872 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 248/542] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:22 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1927 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:22.831822 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c3d5cb29-38e4-4a1e-8d8a-cd0268787aa0 tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Calling method '.version_select at 0x7f8009c3c0d0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:22.832497 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-3989e666-06e3-4ee7-bf8a-03398991c5ba tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] Calling method '.version_select at 0x7f8009df23a0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:22.832651 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:22.832651 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:13:22.833923 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c3d5cb29-38e4-4a1e-8d8a-cd0268787aa0 tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '93fd7931d06b4cce9f1b58cf08470756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbcc424b120485393099eabc19db149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c3d5cb29-38e4-4a1e-8d8a-cd0268787aa0 tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Request method failure captured: Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7kvwodQ7ZrW9FGDMSi2ZIzRo6XJaW_gqEgK8aStixNS-bUtAL0Csmq8qJ5Oj1PsWwUU570J1ruIC3d9MAvIZ2KaoJdxkKQPlFonrxbOpm1I3oL7bciiNUSUqi1GkMlrHWycQFkv65toicxE628qKk9niBEFLZW-VSUHSAYDd2M8EDc Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 8fbcc424b120485393099eabc19db149 Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1733182789 Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:13:22.836977 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:13:22.838627 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8fbcc424b120485393099eabc19db149"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_8fbcc424b120485393099eabc19db149", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8fbcc424b120485393099eabc19db149"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/8fbcc424b120485393099eabc19db149"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:22.838627 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1733182789 Aug 22 17:13:22.838627 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 8fbcc424b120485393099eabc19db149 Aug 22 17:13:22.838627 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1733182789 Aug 22 17:13:22.838627 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-HypervisorAdminNegativeTestJSON-1733182789-project Aug 22 17:13:22.838627 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:22.838627 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:22.838627 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 93fd7931d06b4cce9f1b58cf08470756 Aug 22 17:13:22.838627 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1733182789-project Aug 22 17:13:22.838627 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:13:22.838627 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 22 17:13:22.838627 n-d-854030-1 devstack@n-api.service[123015]: action_args: {} Aug 22 17:13:22.838627 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:22.839841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:22.839841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:22.839841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:22.839841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:22.839841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:22.839841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:22.839841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:22.839841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:22.839841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:22.839841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 22 17:13:22.839841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 22 17:13:22.839841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 22 17:13:22.839841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 22 17:13:22.839841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:13:22.839841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:13:22.839841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:13:22.839841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:13:22.839841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:13:22.839841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:13:22.841457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:13:22.841457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:13:22.841457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:13:22.841457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:13:22.841457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:13:22.841457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:13:22.841457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:13:22.841457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:13:22.841457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 22 17:13:22.841457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:22.841457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:22.841457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:22.841457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:22.841457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:22.841457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:22.841457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:13:22.841457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:13:22.841457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 22 17:13:22.841457 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:22.844761 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c3d5cb29-38e4-4a1e-8d8a-cd0268787aa0 tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:22.850159 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c3d5cb29-38e4-4a1e-8d8a-cd0268787aa0 tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.232328 Aug 22 17:13:22.851693 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 295/543] 10.222.0.96 () {58 vars in 1167 bytes} [Mon Aug 22 17:13:22 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 234 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:22.858626 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-99301a58-9a83-4784-a9e0-192fc75e30f4 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:22.859368 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-99301a58-9a83-4784-a9e0-192fc75e30f4 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:22.870481 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-99301a58-9a83-4784-a9e0-192fc75e30f4 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:22.870481 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-99301a58-9a83-4784-a9e0-192fc75e30f4 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:22.870481 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-99301a58-9a83-4784-a9e0-192fc75e30f4 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:22.870481 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-99301a58-9a83-4784-a9e0-192fc75e30f4 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:22.870924 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-99301a58-9a83-4784-a9e0-192fc75e30f4 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:22.870924 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-99301a58-9a83-4784-a9e0-192fc75e30f4 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:22.898734 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-99301a58-9a83-4784-a9e0-192fc75e30f4 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lazy-loading 'flavor' on Instance uuid 818bc982-f088-43a6-930c-f998d3345296 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:23.500922 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-99301a58-9a83-4784-a9e0-192fc75e30f4 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296/action" status: 202 len: 0 microversion: 2.1 time: 0.646387 Aug 22 17:13:23.505909 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 296/544] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:13:22 2022] POST /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:13:23.511997 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d60fa17f-673f-4c45-a3fa-3c2bfd867993 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:23.512803 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d60fa17f-673f-4c45-a3fa-3c2bfd867993 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:23.579989 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d60fa17f-673f-4c45-a3fa-3c2bfd867993 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:23.587858 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d60fa17f-673f-4c45-a3fa-3c2bfd867993 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 200 len: 1222 microversion: 2.1 time: 0.080411 Aug 22 17:13:23.592400 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 297/545] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:23 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:23.595156 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-90289d48-d131-4d07-a42c-a64ff36a7c6e tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Calling method '.version_select at 0x7f8009e67430>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:23.596122 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:23.596122 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:13:23.597321 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-90289d48-d131-4d07-a42c-a64ff36a7c6e tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '93fd7931d06b4cce9f1b58cf08470756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbcc424b120485393099eabc19db149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-90289d48-d131-4d07-a42c-a64ff36a7c6e tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Request method failure captured: Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7kvwodQ7ZrW9FGDMSi2ZIzRo6XJaW_gqEgK8aStixNS-bUtAL0Csmq8qJ5Oj1PsWwUU570J1ruIC3d9MAvIZ2KaoJdxkKQPlFonrxbOpm1I3oL7bciiNUSUqi1GkMlrHWycQFkv65toicxE628qKk9niBEFLZW-VSUHSAYDd2M8EDc Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 8fbcc424b120485393099eabc19db149 Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1733182789 Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:13:23.598995 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:13:23.600290 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8fbcc424b120485393099eabc19db149"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_8fbcc424b120485393099eabc19db149", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8fbcc424b120485393099eabc19db149"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/8fbcc424b120485393099eabc19db149"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:23.600290 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1733182789 Aug 22 17:13:23.600290 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 8fbcc424b120485393099eabc19db149 Aug 22 17:13:23.600290 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1733182789 Aug 22 17:13:23.600290 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-HypervisorAdminNegativeTestJSON-1733182789-project Aug 22 17:13:23.600290 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:23.600290 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:23.600290 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 93fd7931d06b4cce9f1b58cf08470756 Aug 22 17:13:23.600290 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1733182789-project Aug 22 17:13:23.600290 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:13:23.600290 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 22 17:13:23.600290 n-d-854030-1 devstack@n-api.service[123015]: action_args: {} Aug 22 17:13:23.600290 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:23.601069 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:23.601069 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:23.601069 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:23.601069 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:23.601069 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:23.601069 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:23.601069 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:23.601069 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:23.601069 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:23.601069 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 22 17:13:23.601069 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 22 17:13:23.601069 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 22 17:13:23.601069 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 22 17:13:23.601069 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:13:23.601069 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:13:23.601069 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:13:23.601069 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:13:23.601069 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:13:23.601069 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:13:23.602265 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:13:23.602265 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:13:23.602265 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:13:23.602265 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:13:23.602265 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:13:23.602265 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:13:23.602265 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:13:23.602265 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:13:23.602265 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 22 17:13:23.602265 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:23.602265 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:23.602265 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:23.602265 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:23.602265 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:23.602265 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:23.602265 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:13:23.602265 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:13:23.602265 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 22 17:13:23.602265 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:23.604100 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-90289d48-d131-4d07-a42c-a64ff36a7c6e tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:23.604100 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-90289d48-d131-4d07-a42c-a64ff36a7c6e tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] 10.222.0.96 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.010501 Aug 22 17:13:23.605216 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 298/546] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:13:23 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:23.612987 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1b2b9286-6c8f-47a8-85a9-796d00d9d9c9 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:23.613737 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-1b2b9286-6c8f-47a8-85a9-796d00d9d9c9 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:23.620391 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1b2b9286-6c8f-47a8-85a9-796d00d9d9c9 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:23.620801 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1b2b9286-6c8f-47a8-85a9-796d00d9d9c9 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:23.621273 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1b2b9286-6c8f-47a8-85a9-796d00d9d9c9 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:23.621996 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1b2b9286-6c8f-47a8-85a9-796d00d9d9c9 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:23.622449 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1b2b9286-6c8f-47a8-85a9-796d00d9d9c9 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:23.623047 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1b2b9286-6c8f-47a8-85a9-796d00d9d9c9 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:23.821827 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-3989e666-06e3-4ee7-bf8a-03398991c5ba tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] 10.222.0.96 "DELETE /compute/v2.1/os-floating-ips/7627afa9-1de2-4de3-a198-b8eb12cf9eae" status: 202 len: 0 microversion: 2.1 time: 0.998476 Aug 22 17:13:23.823044 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 249/547] 10.222.0.96 () {58 vars in 1263 bytes} [Mon Aug 22 17:13:22 2022] DELETE /compute/v2.1/os-floating-ips/7627afa9-1de2-4de3-a198-b8eb12cf9eae => generated 0 bytes in 1000 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:13:23.828267 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d08d2456-6905-4437-af92-719516f55842 tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Calling method '.version_select at 0x7f8009c4a940>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:23.829246 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:23.829246 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:13:23.830832 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-d08d2456-6905-4437-af92-719516f55842 tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '93fd7931d06b4cce9f1b58cf08470756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbcc424b120485393099eabc19db149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d08d2456-6905-4437-af92-719516f55842 tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Request method failure captured: Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7kvwodQ7ZrW9FGDMSi2ZIzRo6XJaW_gqEgK8aStixNS-bUtAL0Csmq8qJ5Oj1PsWwUU570J1ruIC3d9MAvIZ2KaoJdxkKQPlFonrxbOpm1I3oL7bciiNUSUqi1GkMlrHWycQFkv65toicxE628qKk9niBEFLZW-VSUHSAYDd2M8EDc Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 8fbcc424b120485393099eabc19db149 Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1733182789 Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:13:23.832517 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:13:23.838566 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8fbcc424b120485393099eabc19db149"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_8fbcc424b120485393099eabc19db149", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8fbcc424b120485393099eabc19db149"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/8fbcc424b120485393099eabc19db149"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:23.838566 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1733182789 Aug 22 17:13:23.838566 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 8fbcc424b120485393099eabc19db149 Aug 22 17:13:23.838566 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1733182789 Aug 22 17:13:23.838566 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-HypervisorAdminNegativeTestJSON-1733182789-project Aug 22 17:13:23.838566 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:13:23.838566 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:13:23.838566 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 93fd7931d06b4cce9f1b58cf08470756 Aug 22 17:13:23.838566 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1733182789-project Aug 22 17:13:23.838566 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:13:23.838566 n-d-854030-1 devstack@n-api.service[123016]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 22 17:13:23.838566 n-d-854030-1 devstack@n-api.service[123016]: action_args: {} Aug 22 17:13:23.838566 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:23.839645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:23.839645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:23.839645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:23.839645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:23.839645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:23.839645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:23.839645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:23.839645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:23.839645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:23.839645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 22 17:13:23.839645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 22 17:13:23.839645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:13:23.839645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:13:23.839645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:13:23.839645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:13:23.839645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:13:23.839645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:13:23.839645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:13:23.839645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:13:23.840950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:13:23.840950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:13:23.840950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:13:23.840950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:13:23.840950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:13:23.840950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:13:23.840950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 22 17:13:23.840950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:23.840950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:23.840950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:23.840950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:23.840950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:23.840950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:23.840950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:13:23.840950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:13:23.840950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 22 17:13:23.840950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:23.842612 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1b2b9286-6c8f-47a8-85a9-796d00d9d9c9 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:23.842737 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d08d2456-6905-4437-af92-719516f55842 tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:23.842737 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d08d2456-6905-4437-af92-719516f55842 tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.010889 Aug 22 17:13:23.842737 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 250/548] 10.222.0.96 () {58 vars in 1179 bytes} [Mon Aug 22 17:13:23 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:23.842737 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5e79f65b-fe31-42b7-9d6a-5144d4a4018b tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Calling method '.version_select at 0x7f8009eb0a60>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:23.845340 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1b2b9286-6c8f-47a8-85a9-796d00d9d9c9 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1477 microversion: 2.1 time: 0.237973 Aug 22 17:13:23.845950 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 299/549] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:23 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1477 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:23.855254 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b579f0d8-1786-4443-bf50-cfd43390e792 tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] Calling method '.version_select at 0x7f8009ce1820>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:23.899298 n-d-854030-1 devstack@n-api.service[123015]: DEBUG neutronclient.v2_0.client [None req-b579f0d8-1786-4443-bf50-cfd43390e792 tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7627afa9-1de2-4de3-a198-b8eb12cf9eae could not be found", "detail": ""}} {{(pid=123015) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:13:23.900050 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-b579f0d8-1786-4443-bf50-cfd43390e792 tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] HTTP exception thrown: Floating IP not found for ID 7627afa9-1de2-4de3-a198-b8eb12cf9eae Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b579f0d8-1786-4443-bf50-cfd43390e792 tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] Request method failure captured: Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-floating-ips/7627afa9-1de2-4de3-a198-b8eb12cf9eae HTTP/1.1 Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7klg3os3Y2e3hx-PJLdUf4dhykGCMEMHsNb0iUT3I4VqE0ufcSGEdygdaHuTPYOLwM7DG7DViMOyDPczZAkrZR_dio5JfFJhafOeju8GNpOYHEDcRHOUuaXKEEYRGlwZT6knl83vb4DvFf2EiuqomlAx8XZyAnbSaYAXYkVejKhMHI Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: baa2ad93707e4fb3b60dada01019a930 Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-FloatingIPsTestJSON-1231021123 Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:13:23.902191 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:13:23.903477 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/baa2ad93707e4fb3b60dada01019a930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_baa2ad93707e4fb3b60dada01019a930", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/baa2ad93707e4fb3b60dada01019a930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/baa2ad93707e4fb3b60dada01019a930"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:23.903477 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-FloatingIPsTestJSON-1231021123 Aug 22 17:13:23.903477 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: baa2ad93707e4fb3b60dada01019a930 Aug 22 17:13:23.903477 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1231021123 Aug 22 17:13:23.903477 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-FloatingIPsTestJSON-1231021123-project Aug 22 17:13:23.903477 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:23.903477 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:23.903477 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 162121ed8cf942a990219ba63fcd0e19 Aug 22 17:13:23.903477 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-FloatingIPsTestJSON-1231021123-project Aug 22 17:13:23.903477 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:13:23.903477 n-d-854030-1 devstack@n-api.service[123015]: exception: Floating IP not found for ID 7627afa9-1de2-4de3-a198-b8eb12cf9eae Aug 22 17:13:23.903477 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '7627afa9-1de2-4de3-a198-b8eb12cf9eae'} Aug 22 17:13:23.903477 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:23.904248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:23.904248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 22 17:13:23.904248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 22 17:13:23.904248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:23.904248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:23.904248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 22 17:13:23.904248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 22 17:13:23.904248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:23.904248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:23.904248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:13:23.904248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:13:23.904248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:23.904248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:23.904248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:13:23.904248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:13:23.904248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:23.904248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:23.904248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 22 17:13:23.904248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7627afa9-1de2-4de3-a198-b8eb12cf9eae could not be found Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-705f5a71-2c48-4268-865f-8699bb619a06'] Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7627afa9-1de2-4de3-a198-b8eb12cf9eae. Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:23.905411 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7627afa9-1de2-4de3-a198-b8eb12cf9eae Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:13:23.907248 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:13:23.910580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7627afa9-1de2-4de3-a198-b8eb12cf9eae Aug 22 17:13:23.910580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:23.910580 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b579f0d8-1786-4443-bf50-cfd43390e792 tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] Returning 404 to user: Floating IP not found for ID 7627afa9-1de2-4de3-a198-b8eb12cf9eae {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:23.910580 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b579f0d8-1786-4443-bf50-cfd43390e792 tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] 10.222.0.96 "GET /compute/v2.1/os-floating-ips/7627afa9-1de2-4de3-a198-b8eb12cf9eae" status: 404 len: 111 microversion: 2.1 time: 0.056662 Aug 22 17:13:23.910580 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 300/550] 10.222.0.96 () {58 vars in 1260 bytes} [Mon Aug 22 17:13:23 2022] GET /compute/v2.1/os-floating-ips/7627afa9-1de2-4de3-a198-b8eb12cf9eae => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:23.911362 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9855ab4e-f15c-426c-b1e7-3f4ddf3fe20a tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:23.911957 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9855ab4e-f15c-426c-b1e7-3f4ddf3fe20a tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:23.918844 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9855ab4e-f15c-426c-b1e7-3f4ddf3fe20a tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:23.919319 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9855ab4e-f15c-426c-b1e7-3f4ddf3fe20a tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:23.919738 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9855ab4e-f15c-426c-b1e7-3f4ddf3fe20a tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:23.920415 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9855ab4e-f15c-426c-b1e7-3f4ddf3fe20a tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:23.920863 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9855ab4e-f15c-426c-b1e7-3f4ddf3fe20a tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:23.921314 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9855ab4e-f15c-426c-b1e7-3f4ddf3fe20a tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:24.059065 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5e79f65b-fe31-42b7-9d6a-5144d4a4018b tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/7c4f70b6c5ed4dc6885f27363c61379d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.222324 Aug 22 17:13:24.060021 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 251/551] 10.222.0.96 () {58 vars in 1269 bytes} [Mon Aug 22 17:13:23 2022] GET /compute/v2.1/os-quota-sets/7c4f70b6c5ed4dc6885f27363c61379d/defaults => generated 371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:24.074530 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-9855ab4e-f15c-426c-b1e7-3f4ddf3fe20a tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:24.152247 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9855ab4e-f15c-426c-b1e7-3f4ddf3fe20a tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1927 microversion: 2.75 time: 0.245818 Aug 22 17:13:24.154716 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 301/552] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:23 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1927 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:24.162791 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-26ec392c-1672-414f-8ce6-f37635abcf2c tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] Calling method '.version_select at 0x7f8009ee4790>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:24.250147 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-657137c9-fd78-42ea-9123-e8fe70cecbff tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Calling method '.version_select at 0x7f8009c4aa60>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:24.251470 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:24.251470 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:13:24.251688 n-d-854030-1 devstack@n-api.service[123015]: DEBUG neutronclient.v2_0.client [None req-26ec392c-1672-414f-8ce6-f37635abcf2c tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7627afa9-1de2-4de3-a198-b8eb12cf9eae could not be found", "detail": ""}} {{(pid=123015) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:13:24.252264 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-26ec392c-1672-414f-8ce6-f37635abcf2c tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] HTTP exception thrown: Floating IP not found for ID 7627afa9-1de2-4de3-a198-b8eb12cf9eae Aug 22 17:13:24.253180 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-657137c9-fd78-42ea-9123-e8fe70cecbff tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:24.253856 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-657137c9-fd78-42ea-9123-e8fe70cecbff tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:24.258342 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-657137c9-fd78-42ea-9123-e8fe70cecbff tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-26ec392c-1672-414f-8ce6-f37635abcf2c tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] Request method failure captured: Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/os-floating-ips/7627afa9-1de2-4de3-a198-b8eb12cf9eae HTTP/1.1 Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7klg3os3Y2e3hx-PJLdUf4dhykGCMEMHsNb0iUT3I4VqE0ufcSGEdygdaHuTPYOLwM7DG7DViMOyDPczZAkrZR_dio5JfFJhafOeju8GNpOYHEDcRHOUuaXKEEYRGlwZT6knl83vb4DvFf2EiuqomlAx8XZyAnbSaYAXYkVejKhMHI Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: baa2ad93707e4fb3b60dada01019a930 Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-FloatingIPsTestJSON-1231021123 Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:13:24.261428 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:13:24.262707 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/baa2ad93707e4fb3b60dada01019a930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_baa2ad93707e4fb3b60dada01019a930", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/baa2ad93707e4fb3b60dada01019a930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/baa2ad93707e4fb3b60dada01019a930"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:24.262707 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-FloatingIPsTestJSON-1231021123 Aug 22 17:13:24.262707 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: baa2ad93707e4fb3b60dada01019a930 Aug 22 17:13:24.262707 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1231021123 Aug 22 17:13:24.262707 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-FloatingIPsTestJSON-1231021123-project Aug 22 17:13:24.262707 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:24.262707 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:24.262707 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 162121ed8cf942a990219ba63fcd0e19 Aug 22 17:13:24.262707 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-FloatingIPsTestJSON-1231021123-project Aug 22 17:13:24.262707 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:13:24.262707 n-d-854030-1 devstack@n-api.service[123015]: exception: Floating IP not found for ID 7627afa9-1de2-4de3-a198-b8eb12cf9eae Aug 22 17:13:24.262707 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '7627afa9-1de2-4de3-a198-b8eb12cf9eae'} Aug 22 17:13:24.262707 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:24.263474 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:24.263474 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 22 17:13:24.263474 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 22 17:13:24.263474 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:24.263474 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:24.263474 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 22 17:13:24.263474 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 22 17:13:24.263474 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:24.263474 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:24.263474 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:13:24.263474 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:13:24.263474 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:24.263474 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:24.263474 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:13:24.263474 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:13:24.263474 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:24.263474 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:24.263474 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 22 17:13:24.263474 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7627afa9-1de2-4de3-a198-b8eb12cf9eae could not be found Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2e2fda6-34cc-4bc5-972f-e44036b07915'] Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7627afa9-1de2-4de3-a198-b8eb12cf9eae. Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:24.265113 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7627afa9-1de2-4de3-a198-b8eb12cf9eae Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:13:24.267482 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:13:24.270011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7627afa9-1de2-4de3-a198-b8eb12cf9eae Aug 22 17:13:24.270011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.270011 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-26ec392c-1672-414f-8ce6-f37635abcf2c tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] Returning 404 to user: Floating IP not found for ID 7627afa9-1de2-4de3-a198-b8eb12cf9eae {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:24.270011 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-26ec392c-1672-414f-8ce6-f37635abcf2c tempest-FloatingIPsTestJSON-1231021123 tempest-FloatingIPsTestJSON-1231021123-project] 10.222.0.96 "DELETE /compute/v2.1/os-floating-ips/7627afa9-1de2-4de3-a198-b8eb12cf9eae" status: 404 len: 111 microversion: 2.1 time: 0.107294 Aug 22 17:13:24.270011 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 302/553] 10.222.0.96 () {58 vars in 1263 bytes} [Mon Aug 22 17:13:24 2022] DELETE /compute/v2.1/os-floating-ips/7627afa9-1de2-4de3-a198-b8eb12cf9eae => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:24.273897 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1e02b08b-72c6-440b-aa4e-0348a37ccf5a tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Action: 'update', calling method: .version_select at 0x7f8009e4cf70>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:24.317802 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-657137c9-fd78-42ea-9123-e8fe70cecbff tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:24.318648 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-657137c9-fd78-42ea-9123-e8fe70cecbff tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:24.319363 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-657137c9-fd78-42ea-9123-e8fe70cecbff tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:24.343595 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-657137c9-fd78-42ea-9123-e8fe70cecbff tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:24.344674 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-657137c9-fd78-42ea-9123-e8fe70cecbff tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:24.345378 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-657137c9-fd78-42ea-9123-e8fe70cecbff tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:24.353636 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-657137c9-fd78-42ea-9123-e8fe70cecbff tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.292241 Aug 22 17:13:24.354818 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 252/554] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:13:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:24.366130 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-44babbff-c4d0-4705-9e11-ae2ba55d5457 tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Calling method '.version_select at 0x7f8009d120d0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:24.367210 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:24.367210 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:13:24.370256 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-44babbff-c4d0-4705-9e11-ae2ba55d5457 tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '93fd7931d06b4cce9f1b58cf08470756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbcc424b120485393099eabc19db149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-44babbff-c4d0-4705-9e11-ae2ba55d5457 tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Request method failure captured: Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7kvwodQ7ZrW9FGDMSi2ZIzRo6XJaW_gqEgK8aStixNS-bUtAL0Csmq8qJ5Oj1PsWwUU570J1ruIC3d9MAvIZ2KaoJdxkKQPlFonrxbOpm1I3oL7bciiNUSUqi1GkMlrHWycQFkv65toicxE628qKk9niBEFLZW-VSUHSAYDd2M8EDc Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 8fbcc424b120485393099eabc19db149 Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1733182789 Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:13:24.372355 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:13:24.373902 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8fbcc424b120485393099eabc19db149"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_8fbcc424b120485393099eabc19db149", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8fbcc424b120485393099eabc19db149"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/8fbcc424b120485393099eabc19db149"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:24.373902 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1733182789 Aug 22 17:13:24.373902 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 8fbcc424b120485393099eabc19db149 Aug 22 17:13:24.373902 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1733182789 Aug 22 17:13:24.373902 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-HypervisorAdminNegativeTestJSON-1733182789-project Aug 22 17:13:24.373902 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:13:24.373902 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:13:24.373902 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 93fd7931d06b4cce9f1b58cf08470756 Aug 22 17:13:24.373902 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1733182789-project Aug 22 17:13:24.373902 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:13:24.373902 n-d-854030-1 devstack@n-api.service[123016]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 22 17:13:24.373902 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '1'} Aug 22 17:13:24.373902 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:24.374707 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:24.374707 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:24.374707 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:24.374707 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:24.374707 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:24.374707 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:24.374707 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:24.374707 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:24.374707 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:24.374707 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 22 17:13:24.374707 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 22 17:13:24.374707 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:13:24.374707 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:13:24.374707 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:13:24.374707 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:13:24.374707 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:13:24.374707 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:13:24.374707 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:13:24.374707 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:13:24.376376 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:13:24.376376 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:13:24.376376 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:13:24.376376 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:13:24.376376 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:13:24.376376 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:13:24.376376 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 22 17:13:24.376376 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.376376 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:24.376376 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.376376 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:24.376376 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:24.376376 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:24.376376 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:13:24.376376 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:13:24.376376 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 22 17:13:24.376376 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.381969 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-44babbff-c4d0-4705-9e11-ae2ba55d5457 tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:24.381969 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-44babbff-c4d0-4705-9e11-ae2ba55d5457 tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.018673 Aug 22 17:13:24.381969 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 253/555] 10.222.0.96 () {58 vars in 1173 bytes} [Mon Aug 22 17:13:24 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:24.388272 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1e02b08b-72c6-440b-aa4e-0348a37ccf5a tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:24.394426 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1e02b08b-72c6-440b-aa4e-0348a37ccf5a tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:24.394952 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1e02b08b-72c6-440b-aa4e-0348a37ccf5a tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:24.395726 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1e02b08b-72c6-440b-aa4e-0348a37ccf5a tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:24.396160 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1e02b08b-72c6-440b-aa4e-0348a37ccf5a tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:24.396776 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c80910d5-f670-4d95-872c-a04d03b72ced tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Calling method '.version_select at 0x7f8009cdff70>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:24.396906 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1e02b08b-72c6-440b-aa4e-0348a37ccf5a tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:24.398243 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-c80910d5-f670-4d95-872c-a04d03b72ced tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] HTTP exception thrown: Hypervisor with ID '9ea69f43-1849-4820-b8f4-500ebc25a7d3' could not be found. Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c80910d5-f670-4d95-872c-a04d03b72ced tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Request method failure captured: Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-hypervisors/9ea69f43-1849-4820-b8f4-500ebc25a7d3/uptime HTTP/1.1 Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7kw6fl9syOVonoVfZweo07YT7eimDqR4kzfmXiM2Z61LX3_z5qKRt_0dKWmPJnmYB708Eh26kH3UwHNC2fIWbgkNrSvweE53ZkD_kM1kBdayfltVJUg4wpDfHb8yWyANOWO9XpSSY0r4tm9rbrRjAZB9gFlzn730NXMGL2LUgAwbpQ Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 2da7ab53ca99435ca3293c68c5c2a75c Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1907542466 Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:13:24.408821 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:13:24.410200 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/2da7ab53ca99435ca3293c68c5c2a75c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_2da7ab53ca99435ca3293c68c5c2a75c", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/2da7ab53ca99435ca3293c68c5c2a75c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/2da7ab53ca99435ca3293c68c5c2a75c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:24.410200 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1907542466 Aug 22 17:13:24.410200 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 2da7ab53ca99435ca3293c68c5c2a75c Aug 22 17:13:24.410200 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1907542466 Aug 22 17:13:24.410200 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin Aug 22 17:13:24.410200 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:13:24.410200 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:13:24.410200 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 2006517e5fee40dda2333a4786217e91 Aug 22 17:13:24.410200 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin Aug 22 17:13:24.410200 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:13:24.410200 n-d-854030-1 devstack@n-api.service[123016]: exception: Hypervisor with ID '9ea69f43-1849-4820-b8f4-500ebc25a7d3' could not be found. Aug 22 17:13:24.410200 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '9ea69f43-1849-4820-b8f4-500ebc25a7d3'} Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '9ea69f43-1849-4820-b8f4-500ebc25a7d3' Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 22 17:13:24.410939 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '9ea69f43-1849-4820-b8f4-500ebc25a7d3' could not be found. Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:24.412242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.416202 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:24.416202 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:24.416202 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:24.416202 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:13:24.416202 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:13:24.416202 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '9ea69f43-1849-4820-b8f4-500ebc25a7d3' could not be found. Aug 22 17:13:24.416202 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.421866 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c80910d5-f670-4d95-872c-a04d03b72ced tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Returning 404 to user: Hypervisor with ID '9ea69f43-1849-4820-b8f4-500ebc25a7d3' could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:24.425830 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c80910d5-f670-4d95-872c-a04d03b72ced tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/9ea69f43-1849-4820-b8f4-500ebc25a7d3/uptime" status: 404 len: 123 microversion: 2.1 time: 0.038258 Aug 22 17:13:24.427540 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 254/556] 10.222.0.96 () {58 vars in 1278 bytes} [Mon Aug 22 17:13:24 2022] GET /compute/v2.1/os-hypervisors/9ea69f43-1849-4820-b8f4-500ebc25a7d3/uptime => generated 123 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:13:24.445688 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-3d257566-196b-49e1-a793-8fa12388a351 tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Calling method '.version_select at 0x7f800a4dae50>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:24.451273 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:24.451273 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:13:24.454000 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3d257566-196b-49e1-a793-8fa12388a351 tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:24.458307 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3d257566-196b-49e1-a793-8fa12388a351 tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:24.459370 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3d257566-196b-49e1-a793-8fa12388a351 tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:24.492685 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3d257566-196b-49e1-a793-8fa12388a351 tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:24.493339 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3d257566-196b-49e1-a793-8fa12388a351 tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:24.493812 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3d257566-196b-49e1-a793-8fa12388a351 tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:24.497473 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:24.508103 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3d257566-196b-49e1-a793-8fa12388a351 tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:24.508617 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3d257566-196b-49e1-a793-8fa12388a351 tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:24.509165 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3d257566-196b-49e1-a793-8fa12388a351 tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:24.516974 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-3d257566-196b-49e1-a793-8fa12388a351 tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.083595 Aug 22 17:13:24.518074 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 255/557] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:13:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:13:24.532154 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0929c4ee-dfbb-48a5-9e53-5fd6d957db1c tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Calling method '.version_select at 0x7f8009df2280>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:24.534045 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:24.534045 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:13:24.535170 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-0929c4ee-dfbb-48a5-9e53-5fd6d957db1c tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '93fd7931d06b4cce9f1b58cf08470756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbcc424b120485393099eabc19db149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0929c4ee-dfbb-48a5-9e53-5fd6d957db1c tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Request method failure captured: Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7kvwodQ7ZrW9FGDMSi2ZIzRo6XJaW_gqEgK8aStixNS-bUtAL0Csmq8qJ5Oj1PsWwUU570J1ruIC3d9MAvIZ2KaoJdxkKQPlFonrxbOpm1I3oL7bciiNUSUqi1GkMlrHWycQFkv65toicxE628qKk9niBEFLZW-VSUHSAYDd2M8EDc Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 8fbcc424b120485393099eabc19db149 Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1733182789 Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:13:24.538301 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:13:24.540137 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8fbcc424b120485393099eabc19db149"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_8fbcc424b120485393099eabc19db149", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8fbcc424b120485393099eabc19db149"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/8fbcc424b120485393099eabc19db149"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:24.540137 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1733182789 Aug 22 17:13:24.540137 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 8fbcc424b120485393099eabc19db149 Aug 22 17:13:24.540137 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1733182789 Aug 22 17:13:24.540137 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-HypervisorAdminNegativeTestJSON-1733182789-project Aug 22 17:13:24.540137 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:13:24.540137 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:13:24.540137 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 93fd7931d06b4cce9f1b58cf08470756 Aug 22 17:13:24.540137 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1733182789-project Aug 22 17:13:24.540137 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:13:24.540137 n-d-854030-1 devstack@n-api.service[123016]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 22 17:13:24.540137 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '1'} Aug 22 17:13:24.540137 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:24.541065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:24.541065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:24.541065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:24.541065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:24.541065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:24.541065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:24.541065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:24.541065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:24.541065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:24.541065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 22 17:13:24.541065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 22 17:13:24.541065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 22 17:13:24.541065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 22 17:13:24.541065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:13:24.541065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:13:24.541065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:13:24.541065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:13:24.541065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:13:24.541065 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:13:24.542481 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:13:24.542481 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:13:24.542481 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:13:24.542481 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:13:24.542481 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:13:24.542481 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:13:24.542481 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:13:24.542481 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:13:24.542481 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 22 17:13:24.542481 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.542481 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:24.542481 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.542481 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:24.542481 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:24.542481 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:24.542481 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:13:24.542481 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:13:24.542481 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 22 17:13:24.542481 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.544068 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0929c4ee-dfbb-48a5-9e53-5fd6d957db1c tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:24.544605 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0929c4ee-dfbb-48a5-9e53-5fd6d957db1c tempest-HypervisorAdminNegativeTestJSON-1733182789 tempest-HypervisorAdminNegativeTestJSON-1733182789-project] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.016994 Aug 22 17:13:24.545809 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 256/558] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:13:24 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:24.556663 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-cba03692-3bcc-4e61-8649-e15d09813f1d tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Calling method '.version_select at 0x7f8009cbac10>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:24.558628 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-cba03692-3bcc-4e61-8649-e15d09813f1d tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] HTTP exception thrown: Hypervisor with ID '3c673185-dabf-4434-86fe-d58481360502' could not be found. Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-cba03692-3bcc-4e61-8649-e15d09813f1d tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Request method failure captured: Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-hypervisors/3c673185-dabf-4434-86fe-d58481360502 HTTP/1.1 Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7kw6fl9syOVonoVfZweo07YT7eimDqR4kzfmXiM2Z61LX3_z5qKRt_0dKWmPJnmYB708Eh26kH3UwHNC2fIWbgkNrSvweE53ZkD_kM1kBdayfltVJUg4wpDfHb8yWyANOWO9XpSSY0r4tm9rbrRjAZB9gFlzn730NXMGL2LUgAwbpQ Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 2da7ab53ca99435ca3293c68c5c2a75c Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1907542466 Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:13:24.561994 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:13:24.564207 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/2da7ab53ca99435ca3293c68c5c2a75c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_2da7ab53ca99435ca3293c68c5c2a75c", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/2da7ab53ca99435ca3293c68c5c2a75c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/2da7ab53ca99435ca3293c68c5c2a75c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:24.564207 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1907542466 Aug 22 17:13:24.564207 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 2da7ab53ca99435ca3293c68c5c2a75c Aug 22 17:13:24.564207 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1907542466 Aug 22 17:13:24.564207 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin Aug 22 17:13:24.564207 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:13:24.564207 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:13:24.564207 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 2006517e5fee40dda2333a4786217e91 Aug 22 17:13:24.564207 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin Aug 22 17:13:24.564207 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:13:24.564207 n-d-854030-1 devstack@n-api.service[123016]: exception: Hypervisor with ID '3c673185-dabf-4434-86fe-d58481360502' could not be found. Aug 22 17:13:24.564207 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '3c673185-dabf-4434-86fe-d58481360502'} Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '3c673185-dabf-4434-86fe-d58481360502' Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 22 17:13:24.565163 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 22 17:13:24.567231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '3c673185-dabf-4434-86fe-d58481360502' could not be found. Aug 22 17:13:24.569791 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.569791 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:24.569791 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.569791 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:24.569791 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:24.569791 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:24.569791 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:13:24.569791 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:13:24.569791 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '3c673185-dabf-4434-86fe-d58481360502' could not be found. Aug 22 17:13:24.569791 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:24.572608 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-cba03692-3bcc-4e61-8649-e15d09813f1d tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] Returning 404 to user: Hypervisor with ID '3c673185-dabf-4434-86fe-d58481360502' could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:24.573907 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-cba03692-3bcc-4e61-8649-e15d09813f1d tempest-HypervisorAdminNegativeTestJSON-1907542466 tempest-HypervisorAdminNegativeTestJSON-1907542466-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors/3c673185-dabf-4434-86fe-d58481360502" status: 404 len: 123 microversion: 2.1 time: 0.021755 Aug 22 17:13:24.575372 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 257/559] 10.222.0.96 () {58 vars in 1257 bytes} [Mon Aug 22 17:13:24 2022] GET /compute/v2.1/os-hypervisors/3c673185-dabf-4434-86fe-d58481360502 => generated 123 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:24.614050 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d22bc994-e8a1-4bc6-93a1-f4c1da0bdf84 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:24.614811 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-d22bc994-e8a1-4bc6-93a1-f4c1da0bdf84 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:24.635783 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d22bc994-e8a1-4bc6-93a1-f4c1da0bdf84 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:24.636884 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d22bc994-e8a1-4bc6-93a1-f4c1da0bdf84 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:24.638438 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d22bc994-e8a1-4bc6-93a1-f4c1da0bdf84 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:24.639284 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d22bc994-e8a1-4bc6-93a1-f4c1da0bdf84 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:24.640866 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d22bc994-e8a1-4bc6-93a1-f4c1da0bdf84 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:24.641934 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d22bc994-e8a1-4bc6-93a1-f4c1da0bdf84 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:24.791894 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-d22bc994-e8a1-4bc6-93a1-f4c1da0bdf84 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:24.809268 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d22bc994-e8a1-4bc6-93a1-f4c1da0bdf84 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 200 len: 1226 microversion: 2.1 time: 0.202593 Aug 22 17:13:24.810130 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 258/560] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:24 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 1226 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:13:24.872663 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-11d87455-8774-45dd-8bc8-638202c21121 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:24.874313 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-11d87455-8774-45dd-8bc8-638202c21121 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:24.903352 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-11d87455-8774-45dd-8bc8-638202c21121 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:24.903851 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-11d87455-8774-45dd-8bc8-638202c21121 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:24.904357 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-11d87455-8774-45dd-8bc8-638202c21121 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:24.905102 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-11d87455-8774-45dd-8bc8-638202c21121 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:24.905562 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-11d87455-8774-45dd-8bc8-638202c21121 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:24.905990 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-11d87455-8774-45dd-8bc8-638202c21121 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:25.313553 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-11d87455-8774-45dd-8bc8-638202c21121 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:25.328069 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-11d87455-8774-45dd-8bc8-638202c21121 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1460 microversion: 2.1 time: 0.459684 Aug 22 17:13:25.329599 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 259/561] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:24 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1460 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:25.337582 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7e0a68ff-a0f5-467a-a987-6d9d9646a6fe tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:25.339259 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-7e0a68ff-a0f5-467a-a987-6d9d9646a6fe tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:25.366259 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e0a68ff-a0f5-467a-a987-6d9d9646a6fe tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:25.367484 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e0a68ff-a0f5-467a-a987-6d9d9646a6fe tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:25.372949 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e0a68ff-a0f5-467a-a987-6d9d9646a6fe tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:25.374004 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e0a68ff-a0f5-467a-a987-6d9d9646a6fe tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:25.374650 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e0a68ff-a0f5-467a-a987-6d9d9646a6fe tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:25.375286 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7e0a68ff-a0f5-467a-a987-6d9d9646a6fe tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:25.518447 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-7e0a68ff-a0f5-467a-a987-6d9d9646a6fe tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:25.579700 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7e0a68ff-a0f5-467a-a987-6d9d9646a6fe tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1927 microversion: 2.75 time: 0.248818 Aug 22 17:13:25.586396 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 260/562] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:25 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1927 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:25.601408 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-794f2d71-5361-4211-85d8-cd384db21e00 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:25.602136 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-794f2d71-5361-4211-85d8-cd384db21e00 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:25.623497 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-794f2d71-5361-4211-85d8-cd384db21e00 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:25.626269 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-794f2d71-5361-4211-85d8-cd384db21e00 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:25.629720 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-794f2d71-5361-4211-85d8-cd384db21e00 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:25.629720 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-794f2d71-5361-4211-85d8-cd384db21e00 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:25.639910 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-794f2d71-5361-4211-85d8-cd384db21e00 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:25.640384 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-794f2d71-5361-4211-85d8-cd384db21e00 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:26.250572 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-794f2d71-5361-4211-85d8-cd384db21e00 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1611 microversion: 2.1 time: 0.661768 Aug 22 17:13:26.251397 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 261/563] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:25 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1611 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:26.258766 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f6538b3f-9be7-4437-8a83-077fd671f33f tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:26.260033 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-f6538b3f-9be7-4437-8a83-077fd671f33f tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:26.272550 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6538b3f-9be7-4437-8a83-077fd671f33f tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:26.273050 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6538b3f-9be7-4437-8a83-077fd671f33f tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:26.277420 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6538b3f-9be7-4437-8a83-077fd671f33f tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:26.278271 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6538b3f-9be7-4437-8a83-077fd671f33f tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:26.282366 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6538b3f-9be7-4437-8a83-077fd671f33f tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:26.283292 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6538b3f-9be7-4437-8a83-077fd671f33f tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:26.434510 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-f6538b3f-9be7-4437-8a83-077fd671f33f tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:26.441197 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1e02b08b-72c6-440b-aa4e-0348a37ccf5a tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-quota-sets/7c4f70b6c5ed4dc6885f27363c61379d" status: 200 len: 329 microversion: 2.1 time: 2.174600 Aug 22 17:13:26.443465 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 303/564] 10.222.0.96 () {60 vars in 1263 bytes} [Mon Aug 22 17:13:24 2022] PUT /compute/v2.1/os-quota-sets/7c4f70b6c5ed4dc6885f27363c61379d => generated 329 bytes in 2179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:26.446444 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f6538b3f-9be7-4437-8a83-077fd671f33f tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 200 len: 1274 microversion: 2.1 time: 0.194070 Aug 22 17:13:26.449926 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 262/565] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:26 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 1274 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:26.450379 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-af600aa9-a37f-4b4c-9777-cde7213f418c tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:26.461434 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ad71544e-2917-40c9-96c1-26f3578b3968 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Action: 'update', calling method: .version_select at 0x7f8009d429d0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:26.467065 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:26.467065 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:13:26.468920 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-af600aa9-a37f-4b4c-9777-cde7213f418c tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:26.470592 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-af600aa9-a37f-4b4c-9777-cde7213f418c tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:26.471370 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-af600aa9-a37f-4b4c-9777-cde7213f418c tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:26.472401 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-af600aa9-a37f-4b4c-9777-cde7213f418c tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:26.473110 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-af600aa9-a37f-4b4c-9777-cde7213f418c tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:26.473743 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-af600aa9-a37f-4b4c-9777-cde7213f418c tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:26.512061 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-af600aa9-a37f-4b4c-9777-cde7213f418c tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] 10.222.0.96 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.066354 Aug 22 17:13:26.513478 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 304/566] 10.222.0.96 () {58 vars in 1176 bytes} [Mon Aug 22 17:13:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:26.531886 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0a8ba0c8-1dec-493e-812d-4c056ea06228 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854030-1", "block_migration": true, "disk_over_commit": false}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:26.537782 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0a8ba0c8-1dec-493e-812d-4c056ea06228 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:26.552294 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0a8ba0c8-1dec-493e-812d-4c056ea06228 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:26.555064 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0a8ba0c8-1dec-493e-812d-4c056ea06228 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:26.555679 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0a8ba0c8-1dec-493e-812d-4c056ea06228 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:26.557798 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0a8ba0c8-1dec-493e-812d-4c056ea06228 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:26.574168 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0a8ba0c8-1dec-493e-812d-4c056ea06228 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:26.574168 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0a8ba0c8-1dec-493e-812d-4c056ea06228 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:26.717620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-0a8ba0c8-1dec-493e-812d-4c056ea06228 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fe1b644a-9598-4c17-8582-9c14b9ca1756) Aug 22 17:13:26.717620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:26.717620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:26.717620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:26.717620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:26.717620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:26.717620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:26.717620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:26.717620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:26.717620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:26.717620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 22 17:13:26.717620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 22 17:13:26.717620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 22 17:13:26.717620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 22 17:13:26.717620 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 22 17:13:26.718872 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 22 17:13:26.718872 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 22 17:13:26.718872 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:13:26.718872 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:13:26.718872 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:13:26.718872 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:13:26.718872 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:13:26.718872 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:13:26.718872 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:26.718872 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:26.718872 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:13:26.718872 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:13:26.718872 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:26.718872 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:26.718872 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:13:26.718872 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:13:26.718872 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:26.718872 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:26.719951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:13:26.719951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:13:26.719951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:26.719951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:26.719951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:13:26.719951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:13:26.719951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:13:26.719951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:13:26.719951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:13:26.719951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:13:26.719951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:13:26.719951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:13:26.719951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:13:26.719951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:13:26.719951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:13:26.719951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:13:26.719951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:13:26.720939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:13:26.720939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:13:26.720939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:13:26.720939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:13:26.720939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:13:26.720939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:13:26.720939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:13:26.720939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:13:26.720939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:13:26.720939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:13:26.720939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:13:26.720939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:13:26.720939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:13:26.720939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fe1b644a-9598-4c17-8582-9c14b9ca1756) Aug 22 17:13:26.720939 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-0a8ba0c8-1dec-493e-812d-4c056ea06228 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0a8ba0c8-1dec-493e-812d-4c056ea06228 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Request method failure captured: Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296/action HTTP/1.1 Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 97 Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7kBhyod12RGcNU-WUZ0o_o_HCRo3w1SIKSQeIrAkn8ptVXGOeWNIvLdGWp34ScIqjDtAk5KBXEORWIWnuVJgnl0iAc9rYjnPOZwuIZKQhuD_bZi8txcBfQVUECDgSFlhWAzw18DSR9vSduZw8KEym0DA7Clb9FJaAZLJ89OPzRO2qg Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 6a43513f11634ebfa97cbb1891729585 Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-LiveMigrationNegativeTest-2422917 Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:13:26.722116 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:13:26.734731 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/6a43513f11634ebfa97cbb1891729585"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_6a43513f11634ebfa97cbb1891729585", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/6a43513f11634ebfa97cbb1891729585"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/6a43513f11634ebfa97cbb1891729585"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:26.734731 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-LiveMigrationNegativeTest-2422917 Aug 22 17:13:26.734731 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 6a43513f11634ebfa97cbb1891729585 Aug 22 17:13:26.734731 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2422917 Aug 22 17:13:26.734731 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-LiveMigrationNegativeTest-2422917-project-admin Aug 22 17:13:26.734731 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:26.734731 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:26.734731 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 9525982cdc2f4dfbac525fa6e6063513 Aug 22 17:13:26.734731 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-LiveMigrationNegativeTest-2422917-project-admin Aug 22 17:13:26.734731 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:13:26.734731 n-d-854030-1 devstack@n-api.service[123015]: {"os-migrateLive": {"host": "n-h1-854030-1", "block_migration": true, "disk_over_commit": false}} Aug 22 17:13:26.734731 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:13:26.735560 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:13:26.735560 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:13:26.735560 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '818bc982-f088-43a6-930c-f998d3345296', 'body': {'os-migrateLive': {'host': 'n-h1-854030-1', 'block_migration': True, 'disk_over_commit': False}}} Aug 22 17:13:26.735560 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:26.735560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:26.735560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:26.735560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:26.735560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:26.735560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:26.735560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:26.735560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:26.735560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:26.735560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:26.735560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 22 17:13:26.735560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 22 17:13:26.735560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 22 17:13:26.735560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 22 17:13:26.735560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 22 17:13:26.735560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 22 17:13:26.736810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 22 17:13:26.736810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:13:26.736810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:13:26.736810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:13:26.736810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:13:26.736810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:13:26.736810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:13:26.736810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:26.736810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:26.736810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:13:26.736810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:13:26.736810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:26.736810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:26.736810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:13:26.736810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:13:26.736810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:26.736810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:26.736810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:13:26.737900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:13:26.737900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:26.737900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:26.737900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:13:26.737900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:13:26.737900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:13:26.737900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:13:26.737900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:13:26.737900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:13:26.737900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:13:26.737900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:13:26.737900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:13:26.737900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:13:26.737900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:13:26.737900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:13:26.737900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:13:26.737900 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:13:26.738935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:13:26.738935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:13:26.738935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:13:26.738935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:13:26.738935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:13:26.738935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:13:26.738935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:13:26.738935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:13:26.738935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:13:26.738935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:13:26.738935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:13:26.738935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:13:26.738935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fe1b644a-9598-4c17-8582-9c14b9ca1756) Aug 22 17:13:26.738935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:26.738935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:26.738935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:26.740029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:26.742214 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0a8ba0c8-1dec-493e-812d-4c056ea06228 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:13:26.742214 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:26.742214 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0a8ba0c8-1dec-493e-812d-4c056ea06228 tempest-LiveMigrationNegativeTest-2422917 tempest-LiveMigrationNegativeTest-2422917-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296/action" status: 500 len: 214 microversion: 2.1 time: 0.194899 Aug 22 17:13:26.742214 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 305/567] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:13:26 2022] POST /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296/action => generated 214 bytes in 196 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 22 17:13:26.742214 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0ae965df-a44f-457e-93c7-c7ad97bc827c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:26.742214 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0ae965df-a44f-457e-93c7-c7ad97bc827c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:26.743057 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0ae965df-a44f-457e-93c7-c7ad97bc827c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:26.743057 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0ae965df-a44f-457e-93c7-c7ad97bc827c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:26.743057 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0ae965df-a44f-457e-93c7-c7ad97bc827c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:26.743057 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0ae965df-a44f-457e-93c7-c7ad97bc827c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:26.746674 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0ae965df-a44f-457e-93c7-c7ad97bc827c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:26.746674 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0ae965df-a44f-457e-93c7-c7ad97bc827c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:26.850292 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:26.860315 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ad71544e-2917-40c9-96c1-26f3578b3968 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:26.861204 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ad71544e-2917-40c9-96c1-26f3578b3968 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:26.861870 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ad71544e-2917-40c9-96c1-26f3578b3968 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:26.863465 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ad71544e-2917-40c9-96c1-26f3578b3968 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:26.864163 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ad71544e-2917-40c9-96c1-26f3578b3968 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:26.865332 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ad71544e-2917-40c9-96c1-26f3578b3968 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:26.938719 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-0ae965df-a44f-457e-93c7-c7ad97bc827c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:26.956232 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0ae965df-a44f-457e-93c7-c7ad97bc827c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1927 microversion: 2.75 time: 0.231750 Aug 22 17:13:26.957338 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 306/568] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:26 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1927 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:26.963139 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-651fb9ad-a140-470f-9b87-552e2efe6b12 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:26.964036 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-651fb9ad-a140-470f-9b87-552e2efe6b12 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:26.971247 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-651fb9ad-a140-470f-9b87-552e2efe6b12 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:26.971854 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-651fb9ad-a140-470f-9b87-552e2efe6b12 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:26.972421 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-651fb9ad-a140-470f-9b87-552e2efe6b12 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:26.973695 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-651fb9ad-a140-470f-9b87-552e2efe6b12 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:26.974283 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-651fb9ad-a140-470f-9b87-552e2efe6b12 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:26.974775 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-651fb9ad-a140-470f-9b87-552e2efe6b12 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:27.020176 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-651fb9ad-a140-470f-9b87-552e2efe6b12 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Going to try to terminate instance {{(pid=123015) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:13:27.735728 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-651fb9ad-a140-470f-9b87-552e2efe6b12 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "DELETE /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 204 len: 0 microversion: 2.1 time: 0.774646 Aug 22 17:13:27.742283 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 307/569] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:13:26 2022] DELETE /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:13:27.755163 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-831672bd-d90c-4e2b-a13e-ddee5f34741c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:27.755875 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-831672bd-d90c-4e2b-a13e-ddee5f34741c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:27.768734 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-831672bd-d90c-4e2b-a13e-ddee5f34741c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:27.769287 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-831672bd-d90c-4e2b-a13e-ddee5f34741c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:27.769728 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-831672bd-d90c-4e2b-a13e-ddee5f34741c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:27.770435 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-831672bd-d90c-4e2b-a13e-ddee5f34741c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:27.770890 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-831672bd-d90c-4e2b-a13e-ddee5f34741c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:27.771316 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-831672bd-d90c-4e2b-a13e-ddee5f34741c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:27.933259 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-831672bd-d90c-4e2b-a13e-ddee5f34741c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:27.937170 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:27.948334 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-831672bd-d90c-4e2b-a13e-ddee5f34741c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 200 len: 1280 microversion: 2.1 time: 0.204556 Aug 22 17:13:27.962172 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 308/570] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:27 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 1280 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:27.962172 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e88d4916-78da-4d6f-b1af-eeb9263b5464 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:27.962172 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-e88d4916-78da-4d6f-b1af-eeb9263b5464 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:27.978892 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=15,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:27.984115 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e88d4916-78da-4d6f-b1af-eeb9263b5464 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:27.988839 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e88d4916-78da-4d6f-b1af-eeb9263b5464 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:27.989189 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e88d4916-78da-4d6f-b1af-eeb9263b5464 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:27.989896 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e88d4916-78da-4d6f-b1af-eeb9263b5464 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:27.990282 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e88d4916-78da-4d6f-b1af-eeb9263b5464 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:27.990707 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e88d4916-78da-4d6f-b1af-eeb9263b5464 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:28.496170 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e88d4916-78da-4d6f-b1af-eeb9263b5464 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:28.514671 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e88d4916-78da-4d6f-b1af-eeb9263b5464 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1466 microversion: 2.1 time: 0.564098 Aug 22 17:13:28.535371 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 309/571] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:27 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1466 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:28.546598 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-06582bf9-b230-4a15-8665-02d0ebcf217c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:28.551824 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-06582bf9-b230-4a15-8665-02d0ebcf217c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:28.566358 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-06582bf9-b230-4a15-8665-02d0ebcf217c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:28.570161 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-06582bf9-b230-4a15-8665-02d0ebcf217c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:28.572732 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-06582bf9-b230-4a15-8665-02d0ebcf217c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:28.576173 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-06582bf9-b230-4a15-8665-02d0ebcf217c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:28.577546 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-06582bf9-b230-4a15-8665-02d0ebcf217c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:28.578363 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-06582bf9-b230-4a15-8665-02d0ebcf217c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:28.795391 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-06582bf9-b230-4a15-8665-02d0ebcf217c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:28.848708 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-06582bf9-b230-4a15-8665-02d0ebcf217c tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1927 microversion: 2.75 time: 0.311778 Aug 22 17:13:28.862372 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 310/572] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:28 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1927 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:28.988015 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-163f84c0-846c-481c-b15e-d09627039d64 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:28.991394 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-163f84c0-846c-481c-b15e-d09627039d64 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:29.010932 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-163f84c0-846c-481c-b15e-d09627039d64 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:29.012376 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-163f84c0-846c-481c-b15e-d09627039d64 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:29.012376 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-163f84c0-846c-481c-b15e-d09627039d64 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:29.020534 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-163f84c0-846c-481c-b15e-d09627039d64 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:29.020534 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-163f84c0-846c-481c-b15e-d09627039d64 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:29.020534 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-163f84c0-846c-481c-b15e-d09627039d64 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:29.208569 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-163f84c0-846c-481c-b15e-d09627039d64 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:29.221247 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-163f84c0-846c-481c-b15e-d09627039d64 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 200 len: 1280 microversion: 2.1 time: 0.253778 Aug 22 17:13:29.235950 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 311/573] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:28 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 1280 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:29.539679 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5947782f-f4fe-4ab7-9527-aac0779f3d9f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:29.540775 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-5947782f-f4fe-4ab7-9527-aac0779f3d9f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:29.550746 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5947782f-f4fe-4ab7-9527-aac0779f3d9f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:29.551243 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5947782f-f4fe-4ab7-9527-aac0779f3d9f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:29.551769 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5947782f-f4fe-4ab7-9527-aac0779f3d9f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:29.552588 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5947782f-f4fe-4ab7-9527-aac0779f3d9f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:29.554179 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5947782f-f4fe-4ab7-9527-aac0779f3d9f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:29.554927 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5947782f-f4fe-4ab7-9527-aac0779f3d9f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:29.994185 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-5947782f-f4fe-4ab7-9527-aac0779f3d9f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:30.002104 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5947782f-f4fe-4ab7-9527-aac0779f3d9f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1466 microversion: 2.1 time: 0.468667 Aug 22 17:13:30.002674 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 312/574] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:29 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1466 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:13:30.021272 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-98337beb-118e-4cc3-b89e-c02180ef20ed tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:30.021805 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-98337beb-118e-4cc3-b89e-c02180ef20ed tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:30.040496 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98337beb-118e-4cc3-b89e-c02180ef20ed tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:30.040496 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98337beb-118e-4cc3-b89e-c02180ef20ed tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:30.040496 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98337beb-118e-4cc3-b89e-c02180ef20ed tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:30.040496 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98337beb-118e-4cc3-b89e-c02180ef20ed tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:30.040874 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98337beb-118e-4cc3-b89e-c02180ef20ed tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:30.040874 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98337beb-118e-4cc3-b89e-c02180ef20ed tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:30.189006 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-98337beb-118e-4cc3-b89e-c02180ef20ed tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:30.227307 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-98337beb-118e-4cc3-b89e-c02180ef20ed tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1927 microversion: 2.75 time: 0.216511 Aug 22 17:13:30.228152 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 313/575] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:30 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1927 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:30.243732 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ed2b8ba2-1b08-412c-8fdc-013fc37ad991 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:30.244762 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ed2b8ba2-1b08-412c-8fdc-013fc37ad991 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:30.262982 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ed2b8ba2-1b08-412c-8fdc-013fc37ad991 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:30.263934 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ed2b8ba2-1b08-412c-8fdc-013fc37ad991 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:30.264732 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ed2b8ba2-1b08-412c-8fdc-013fc37ad991 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:30.266309 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ed2b8ba2-1b08-412c-8fdc-013fc37ad991 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:30.267226 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ed2b8ba2-1b08-412c-8fdc-013fc37ad991 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:30.267956 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ed2b8ba2-1b08-412c-8fdc-013fc37ad991 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:30.821536 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ad71544e-2917-40c9-96c1-26f3578b3968 tempest-QuotasAdminTestJSON-1952431175 tempest-QuotasAdminTestJSON-1952431175-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-quota-sets/7c4f70b6c5ed4dc6885f27363c61379d" status: 200 len: 329 microversion: 2.1 time: 4.366564 Aug 22 17:13:30.830143 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 263/576] 10.222.0.96 () {60 vars in 1263 bytes} [Mon Aug 22 17:13:26 2022] PUT /compute/v2.1/os-quota-sets/7c4f70b6c5ed4dc6885f27363c61379d => generated 329 bytes in 4373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:31.030161 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fa7c958c-7730-495b-ac15-122d909a211b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:31.031008 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-fa7c958c-7730-495b-ac15-122d909a211b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:31.039681 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa7c958c-7730-495b-ac15-122d909a211b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:31.040207 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa7c958c-7730-495b-ac15-122d909a211b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:31.040688 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa7c958c-7730-495b-ac15-122d909a211b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:31.042256 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa7c958c-7730-495b-ac15-122d909a211b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:31.042938 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa7c958c-7730-495b-ac15-122d909a211b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:31.043581 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa7c958c-7730-495b-ac15-122d909a211b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:31.059229 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ed2b8ba2-1b08-412c-8fdc-013fc37ad991 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:31.068349 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ed2b8ba2-1b08-412c-8fdc-013fc37ad991 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 200 len: 1322 microversion: 2.1 time: 0.829666 Aug 22 17:13:31.068931 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 314/577] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:30 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 1322 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:31.073795 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-65b19ea0-3c06-472c-802f-359a33b6e353 req-6566fdeb-b259-47c3-a7cd-012eaee05b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818bc982-f088-43a6-930c-f998d3345296", "name": "network-vif-deleted", "tag": "ab4e3be9-90f8-44af-9b6e-35ddf22fde9e"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:31.084060 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-65b19ea0-3c06-472c-802f-359a33b6e353 req-6566fdeb-b259-47c3-a7cd-012eaee05b96 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:31.084835 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-65b19ea0-3c06-472c-802f-359a33b6e353 req-6566fdeb-b259-47c3-a7cd-012eaee05b96 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:31.085517 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-65b19ea0-3c06-472c-802f-359a33b6e353 req-6566fdeb-b259-47c3-a7cd-012eaee05b96 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:31.100488 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-65b19ea0-3c06-472c-802f-359a33b6e353 req-6566fdeb-b259-47c3-a7cd-012eaee05b96 service nova] Creating event network-vif-deleted:ab4e3be9-90f8-44af-9b6e-35ddf22fde9e for instance 818bc982-f088-43a6-930c-f998d3345296 on n-h2-854030-1 Aug 22 17:13:31.106591 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-65b19ea0-3c06-472c-802f-359a33b6e353 req-6566fdeb-b259-47c3-a7cd-012eaee05b96 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036107 Aug 22 17:13:31.107870 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 315/578] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:31.161455 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-fa7c958c-7730-495b-ac15-122d909a211b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:31.171657 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-fa7c958c-7730-495b-ac15-122d909a211b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1424 microversion: 2.1 time: 0.148567 Aug 22 17:13:31.172608 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 264/579] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:31 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1424 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:31.262528 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7621ae02-8ba0-432d-b895-3a3fbd5a85f1 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:31.263221 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-7621ae02-8ba0-432d-b895-3a3fbd5a85f1 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:31.270266 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7621ae02-8ba0-432d-b895-3a3fbd5a85f1 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:31.275118 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7621ae02-8ba0-432d-b895-3a3fbd5a85f1 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:31.275576 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7621ae02-8ba0-432d-b895-3a3fbd5a85f1 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:31.276309 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7621ae02-8ba0-432d-b895-3a3fbd5a85f1 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:31.276768 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7621ae02-8ba0-432d-b895-3a3fbd5a85f1 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:31.277222 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7621ae02-8ba0-432d-b895-3a3fbd5a85f1 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:31.409801 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-7621ae02-8ba0-432d-b895-3a3fbd5a85f1 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:31.442080 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7621ae02-8ba0-432d-b895-3a3fbd5a85f1 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1927 microversion: 2.75 time: 0.183124 Aug 22 17:13:31.444555 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 316/580] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:31 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1927 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:32.091281 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-17201088-07b4-4e78-b4d3-fe190f33b2a6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:32.092489 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-17201088-07b4-4e78-b4d3-fe190f33b2a6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:32.113374 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17201088-07b4-4e78-b4d3-fe190f33b2a6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:32.115930 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17201088-07b4-4e78-b4d3-fe190f33b2a6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:32.117272 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17201088-07b4-4e78-b4d3-fe190f33b2a6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:32.119586 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17201088-07b4-4e78-b4d3-fe190f33b2a6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:32.121613 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17201088-07b4-4e78-b4d3-fe190f33b2a6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:32.122358 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17201088-07b4-4e78-b4d3-fe190f33b2a6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:32.198644 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fd7e4061-8a0b-46b4-afbb-8bf54a8c5137 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:32.199515 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-fd7e4061-8a0b-46b4-afbb-8bf54a8c5137 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:32.211122 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd7e4061-8a0b-46b4-afbb-8bf54a8c5137 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:32.216791 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd7e4061-8a0b-46b4-afbb-8bf54a8c5137 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:32.217399 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd7e4061-8a0b-46b4-afbb-8bf54a8c5137 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:32.221450 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd7e4061-8a0b-46b4-afbb-8bf54a8c5137 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:32.222791 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd7e4061-8a0b-46b4-afbb-8bf54a8c5137 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:32.223809 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd7e4061-8a0b-46b4-afbb-8bf54a8c5137 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:32.290632 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd7e4061-8a0b-46b4-afbb-8bf54a8c5137 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:32.291479 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd7e4061-8a0b-46b4-afbb-8bf54a8c5137 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:32.292151 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd7e4061-8a0b-46b4-afbb-8bf54a8c5137 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:32.292815 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-fd7e4061-8a0b-46b4-afbb-8bf54a8c5137 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lazy-loading 'fault' on Instance uuid 818bc982-f088-43a6-930c-f998d3345296 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:32.410553 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-fd7e4061-8a0b-46b4-afbb-8bf54a8c5137 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:32.421009 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fd7e4061-8a0b-46b4-afbb-8bf54a8c5137 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 200 len: 1309 microversion: 2.1 time: 0.227179 Aug 22 17:13:32.424644 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 317/581] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:32 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 1309 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:13:32.426688 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-17201088-07b4-4e78-b4d3-fe190f33b2a6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:32.434968 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-17201088-07b4-4e78-b4d3-fe190f33b2a6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 200 len: 1322 microversion: 2.1 time: 0.348013 Aug 22 17:13:32.447913 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 265/582] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:32 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:32.483119 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ebed2b3a-4d68-4192-8d35-fff4d0e06e28 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:32.483819 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ebed2b3a-4d68-4192-8d35-fff4d0e06e28 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:32.490891 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ebed2b3a-4d68-4192-8d35-fff4d0e06e28 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:32.494743 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ebed2b3a-4d68-4192-8d35-fff4d0e06e28 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:32.497675 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ebed2b3a-4d68-4192-8d35-fff4d0e06e28 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:32.503338 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ebed2b3a-4d68-4192-8d35-fff4d0e06e28 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:32.503338 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ebed2b3a-4d68-4192-8d35-fff4d0e06e28 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:32.504497 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ebed2b3a-4d68-4192-8d35-fff4d0e06e28 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:32.686393 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-ebed2b3a-4d68-4192-8d35-fff4d0e06e28 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:32.725992 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ebed2b3a-4d68-4192-8d35-fff4d0e06e28 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1927 microversion: 2.75 time: 0.251210 Aug 22 17:13:32.728266 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 318/583] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:32 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1927 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:33.164013 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-0ef63401-a3af-4d6e-ae98-df648951eaff req-870b9cc8-0796-4d32-9baf-e60a692f1bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cde06f3-062c-470d-995f-51b1b2136a14", "tag": "89538d2b-3be7-410b-9b9a-8444ab3244a2"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:33.176610 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-0ef63401-a3af-4d6e-ae98-df648951eaff req-870b9cc8-0796-4d32-9baf-e60a692f1bc1 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:33.182995 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-0ef63401-a3af-4d6e-ae98-df648951eaff req-870b9cc8-0796-4d32-9baf-e60a692f1bc1 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:33.182995 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-0ef63401-a3af-4d6e-ae98-df648951eaff req-870b9cc8-0796-4d32-9baf-e60a692f1bc1 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:33.190968 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-0ef63401-a3af-4d6e-ae98-df648951eaff req-870b9cc8-0796-4d32-9baf-e60a692f1bc1 service nova] Creating event network-changed:89538d2b-3be7-410b-9b9a-8444ab3244a2 for instance 0cde06f3-062c-470d-995f-51b1b2136a14 on n-h1-854030-1 Aug 22 17:13:33.208428 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-0ef63401-a3af-4d6e-ae98-df648951eaff req-870b9cc8-0796-4d32-9baf-e60a692f1bc1 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042751 Aug 22 17:13:33.209325 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 266/584] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:33.444456 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7fff03f8-d395-4795-8cf0-717503345b9d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:33.445107 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-7fff03f8-d395-4795-8cf0-717503345b9d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 818bc982-f088-43a6-930c-f998d3345296] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:33.454606 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7fff03f8-d395-4795-8cf0-717503345b9d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:33.455231 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7fff03f8-d395-4795-8cf0-717503345b9d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:33.455768 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7fff03f8-d395-4795-8cf0-717503345b9d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:33.456573 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7fff03f8-d395-4795-8cf0-717503345b9d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:33.457312 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7fff03f8-d395-4795-8cf0-717503345b9d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:33.457992 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7fff03f8-d395-4795-8cf0-717503345b9d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:33.469569 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4ede5622-8a7a-4834-b707-84bb00efd414 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:33.470288 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-4ede5622-8a7a-4834-b707-84bb00efd414 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:33.484110 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4ede5622-8a7a-4834-b707-84bb00efd414 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:33.484749 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4ede5622-8a7a-4834-b707-84bb00efd414 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:33.490741 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-7fff03f8-d395-4795-8cf0-717503345b9d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] HTTP exception thrown: Instance 818bc982-f088-43a6-930c-f998d3345296 could not be found. Aug 22 17:13:33.491704 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4ede5622-8a7a-4834-b707-84bb00efd414 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:33.492464 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4ede5622-8a7a-4834-b707-84bb00efd414 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:33.493551 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4ede5622-8a7a-4834-b707-84bb00efd414 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:33.494093 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4ede5622-8a7a-4834-b707-84bb00efd414 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7fff03f8-d395-4795-8cf0-717503345b9d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Request method failure captured: Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 HTTP/1.1 Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7j-X63WR6_GgRcybzReVqP1d2SMv_UvQM4oD8ejrbYYovWKTdIA8he91OVQCrAWTYZ8KCAdFNESDWKVUtrtiKx_h_e5deQWJASGR20pHIWznITbUxBu7gbumJWS57Edhp-haQMVlf0IsZq8yO3MfaC2NFTAJqAl-vleyuYQGUNw4KE Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 10f3e01147404b6a86ef50f3d441841a Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-LiveMigrationNegativeTest-1104444746 Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:13:33.501225 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:13:33.505860 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/10f3e01147404b6a86ef50f3d441841a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_10f3e01147404b6a86ef50f3d441841a", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/10f3e01147404b6a86ef50f3d441841a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/10f3e01147404b6a86ef50f3d441841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:33.505860 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-LiveMigrationNegativeTest-1104444746 Aug 22 17:13:33.505860 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 10f3e01147404b6a86ef50f3d441841a Aug 22 17:13:33.505860 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1104444746 Aug 22 17:13:33.505860 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-LiveMigrationNegativeTest-1104444746-project Aug 22 17:13:33.505860 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:33.505860 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:33.505860 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 35652618557443a4a1dbfb3e0028f0c7 Aug 22 17:13:33.505860 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-LiveMigrationNegativeTest-1104444746-project Aug 22 17:13:33.505860 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:13:33.505860 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance 818bc982-f088-43a6-930c-f998d3345296 could not be found. Aug 22 17:13:33.505860 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '818bc982-f088-43a6-930c-f998d3345296'} Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 818bc982-f088-43a6-930c-f998d3345296 could not be found. Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:33.506899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:33.508384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:33.508384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:13:33.508384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:13:33.508384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:13:33.508384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:13:33.508384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:13:33.508384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:13:33.508384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 818bc982-f088-43a6-930c-f998d3345296 could not be found. Aug 22 17:13:33.508384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:33.508384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:33.508384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:33.508384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:33.508384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:33.508384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:33.508384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:13:33.508384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:13:33.508384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 818bc982-f088-43a6-930c-f998d3345296 could not be found. Aug 22 17:13:33.508384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:33.509646 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7fff03f8-d395-4795-8cf0-717503345b9d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Returning 404 to user: Instance 818bc982-f088-43a6-930c-f998d3345296 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:33.510705 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7fff03f8-d395-4795-8cf0-717503345b9d tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296" status: 404 len: 111 microversion: 2.1 time: 0.070899 Aug 22 17:13:33.514133 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 319/585] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:33 2022] GET /compute/v2.1/servers/818bc982-f088-43a6-930c-f998d3345296 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:33.523122 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-28afef8d-795e-4dfd-8725-23cbf2b19445 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:33.524473 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-28afef8d-795e-4dfd-8725-23cbf2b19445 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:33.536088 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-28afef8d-795e-4dfd-8725-23cbf2b19445 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:33.536575 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-28afef8d-795e-4dfd-8725-23cbf2b19445 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:33.538470 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-28afef8d-795e-4dfd-8725-23cbf2b19445 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:33.539269 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-28afef8d-795e-4dfd-8725-23cbf2b19445 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:33.539730 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-28afef8d-795e-4dfd-8725-23cbf2b19445 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:33.540154 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-28afef8d-795e-4dfd-8725-23cbf2b19445 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:33.594020 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-28afef8d-795e-4dfd-8725-23cbf2b19445 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Going to try to terminate instance {{(pid=123015) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:13:33.823075 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-4ede5622-8a7a-4834-b707-84bb00efd414 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:33.840409 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4ede5622-8a7a-4834-b707-84bb00efd414 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 200 len: 1322 microversion: 2.1 time: 0.368098 Aug 22 17:13:33.840409 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 267/586] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:33 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:33.841478 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-bfe543b0-98dd-4a57-9630-f78da44265b3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:33.842090 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-bfe543b0-98dd-4a57-9630-f78da44265b3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:33.848489 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bfe543b0-98dd-4a57-9630-f78da44265b3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:33.849024 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bfe543b0-98dd-4a57-9630-f78da44265b3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:33.849488 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bfe543b0-98dd-4a57-9630-f78da44265b3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:33.850218 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bfe543b0-98dd-4a57-9630-f78da44265b3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:33.850711 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bfe543b0-98dd-4a57-9630-f78da44265b3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:33.851134 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bfe543b0-98dd-4a57-9630-f78da44265b3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:33.987906 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-28afef8d-795e-4dfd-8725-23cbf2b19445 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "DELETE /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 204 len: 0 microversion: 2.1 time: 0.468793 Aug 22 17:13:33.988534 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 320/587] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:13:33 2022] DELETE /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:13:34.004140 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ebd7b69a-5d5b-48a0-90ff-e82e53dce3b2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:34.004140 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ebd7b69a-5d5b-48a0-90ff-e82e53dce3b2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:34.023832 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ebd7b69a-5d5b-48a0-90ff-e82e53dce3b2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:34.024264 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ebd7b69a-5d5b-48a0-90ff-e82e53dce3b2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:34.024698 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ebd7b69a-5d5b-48a0-90ff-e82e53dce3b2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:34.025449 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ebd7b69a-5d5b-48a0-90ff-e82e53dce3b2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:34.025926 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ebd7b69a-5d5b-48a0-90ff-e82e53dce3b2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:34.026334 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ebd7b69a-5d5b-48a0-90ff-e82e53dce3b2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:34.026446 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-bfe543b0-98dd-4a57-9630-f78da44265b3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:34.058127 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-bfe543b0-98dd-4a57-9630-f78da44265b3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1927 microversion: 2.75 time: 0.220784 Aug 22 17:13:34.059152 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 268/588] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:33 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1927 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:34.149411 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2497c60b-d27f-45d5-b6c9-2a862ce1eeac tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-488635398", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "4961ed3b-1757-4867-b3c5-234aece94f27"}], "block_device_mapping_v2": [{"uuid": "e20e14ef-5367-4c94-b839-18b9fb021a18", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:34.262833 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-2497c60b-d27f-45d5-b6c9-2a862ce1eeac tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] validate_networks() for [('4961ed3b-1757-4867-b3c5-234aece94f27', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:13:34.267772 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ebd7b69a-5d5b-48a0-90ff-e82e53dce3b2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:34.277643 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ebd7b69a-5d5b-48a0-90ff-e82e53dce3b2 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1473 microversion: 2.1 time: 0.283710 Aug 22 17:13:34.287269 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 321/589] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:33 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1473 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:34.679195 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-2497c60b-d27f-45d5-b6c9-2a862ce1eeac tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1a6d5ef6-776c-4578-91aa-466422de0df5) Aug 22 17:13:34.679195 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:34.679195 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:34.679195 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:34.679195 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:34.679195 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:34.679195 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:34.679195 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:34.679195 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:34.679195 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:34.679195 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:13:34.679195 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:13:34.679195 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:13:34.679195 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:13:34.679195 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:13:34.679195 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:13:34.680223 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:13:34.680223 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:13:34.680223 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:13:34.680223 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:13:34.680223 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:13:34.680223 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:13:34.680223 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:13:34.680223 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:13:34.680223 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:13:34.680223 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:13:34.680223 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:13:34.680223 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:34.680223 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:34.680223 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:13:34.680223 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:13:34.680223 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:34.680223 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:34.680223 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:13:34.681889 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:13:34.681889 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:34.681889 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:34.681889 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:13:34.681889 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:13:34.681889 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:34.681889 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:34.681889 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:13:34.681889 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:13:34.681889 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:13:34.681889 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:13:34.681889 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:13:34.681889 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:13:34.681889 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:13:34.681889 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:13:34.681889 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:13:34.681889 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:13:34.681889 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:13:34.682935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:13:34.682935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:13:34.682935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:13:34.682935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:13:34.682935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:13:34.682935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:13:34.682935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:13:34.682935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:13:34.682935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:13:34.682935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:13:34.682935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:13:34.682935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:13:34.682935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:13:34.682935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:13:34.682935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1a6d5ef6-776c-4578-91aa-466422de0df5) Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-2497c60b-d27f-45d5-b6c9-2a862ce1eeac tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2497c60b-d27f-45d5-b6c9-2a862ce1eeac tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Request method failure captured: Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 361 Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7j32YTw0hL_DuXnelgZHHX7C1Gmcw3vNcMfLG9RPRrF5VrBlcszKIkOXSraO-H71og8rmMDf7E7s2KJSPfbGwF0eGTzPlA7_SG_d_wJ73JQ3tD3bRiNgJUrN6P0arD1nYmVZXVS9qY9aHRTG3-l3Dr6eQBqvqcebviIUQkfdWgx-Ug Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: X-Openstack-Nova-Api-Version: 2.25 Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 4fbd6f26451e49e581f5dcb7689a1a3d Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1622325097 Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:13:34.683821 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:13:34.686313 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4fbd6f26451e49e581f5dcb7689a1a3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_4fbd6f26451e49e581f5dcb7689a1a3d", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4fbd6f26451e49e581f5dcb7689a1a3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/4fbd6f26451e49e581f5dcb7689a1a3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:34.686313 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1622325097 Aug 22 17:13:34.686313 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 4fbd6f26451e49e581f5dcb7689a1a3d Aug 22 17:13:34.686313 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1622325097 Aug 22 17:13:34.686313 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-LiveAutoBlockMigrationV225Test-1622325097-project Aug 22 17:13:34.686313 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:13:34.686313 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:13:34.686313 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: c5ad39ac5ea841d68b94dca20d12d00c Aug 22 17:13:34.686313 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1622325097-project Aug 22 17:13:34.686313 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:13:34.688635 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-488635398", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "4961ed3b-1757-4867-b3c5-234aece94f27"}], "block_device_mapping_v2": [{"uuid": "e20e14ef-5367-4c94-b839-18b9fb021a18", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} Aug 22 17:13:34.688635 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:13:34.688635 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:13:34.688635 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:13:34.688635 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-488635398', 'imageRef': '', 'flavorRef': '452', 'networks': [{'uuid': '4961ed3b-1757-4867-b3c5-234aece94f27'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': 'e20e14ef-5367-4c94-b839-18b9fb021a18'}]}}} Aug 22 17:13:34.688635 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:34.688635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:34.688635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:34.688635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:34.688635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:34.688635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:34.688635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:34.688635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:34.688635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:34.688635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:34.692420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:13:34.692420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:13:34.692420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:13:34.692420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:13:34.692420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:13:34.692420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:13:34.692420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:13:34.692420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:13:34.692420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:13:34.692420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:13:34.692420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:13:34.692420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:13:34.692420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:13:34.692420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:13:34.692420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:13:34.692420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:13:34.692420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:13:34.692420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:34.692420 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:34.694140 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:13:34.694140 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:13:34.694140 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:34.694140 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:34.694140 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:13:34.694140 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:13:34.694140 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:34.694140 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:34.694140 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:13:34.694140 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:13:34.694140 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:13:34.694140 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:13:34.694140 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:13:34.694140 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:13:34.694140 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:13:34.694140 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:13:34.694140 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:13:34.694140 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:13:34.695614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:13:34.695614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:13:34.695614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:13:34.695614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:13:34.695614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:13:34.695614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:13:34.695614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:13:34.695614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:13:34.695614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:13:34.695614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:13:34.695614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:13:34.695614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:13:34.695614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:13:34.695614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:13:34.695614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:13:34.695614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:13:34.696751 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:13:34.696751 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:13:34.696751 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:13:34.696751 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:13:34.696751 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1a6d5ef6-776c-4578-91aa-466422de0df5) Aug 22 17:13:34.696751 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:34.696751 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:34.696751 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:34.696751 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:34.696751 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:34.696751 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:34.696751 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:34.696751 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:34.696751 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:13:34.696751 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:13:34.696751 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:13:34.696751 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:34.696751 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:34.698555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:34.698555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:34.698555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:34.698555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:34.698555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:34.698555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:13:34.698555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:13:34.698555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:13:34.698555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:34.698555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:34.698555 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2497c60b-d27f-45d5-b6c9-2a862ce1eeac tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:13:34.698555 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:34.698555 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2497c60b-d27f-45d5-b6c9-2a862ce1eeac tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 0.539811 Aug 22 17:13:34.699503 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 269/590] 10.222.0.96 () {62 vars in 1188 bytes} [Mon Aug 22 17:13:34 2022] POST /compute/v2.1/servers => generated 214 bytes in 541 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Aug 22 17:13:34.718808 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c79a3556-dd18-411d-aa2f-784349593c42 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] Calling method '.version_select at 0x7f8009ba7670>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:34.806135 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c79a3556-dd18-411d-aa2f-784349593c42 tempest-LiveAutoBlockMigrationV225Test-1622325097 tempest-LiveAutoBlockMigrationV225Test-1622325097-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-87051449" status: 204 len: 0 microversion: 2.25 time: 0.110041 Aug 22 17:13:34.806842 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 270/591] 10.222.0.96 () {60 vars in 1256 bytes} [Mon Aug 22 17:13:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-87051449 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 17:13:34.855667 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9f808592-ce13-47ea-82b9-06acb340f053 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-21042356", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:34.856689 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-546c999b-3076-48e1-94f5-8bdadf57d9b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:34.857338 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-546c999b-3076-48e1-94f5-8bdadf57d9b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:34.865172 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-546c999b-3076-48e1-94f5-8bdadf57d9b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:34.866133 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-546c999b-3076-48e1-94f5-8bdadf57d9b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:34.867309 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-546c999b-3076-48e1-94f5-8bdadf57d9b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:34.868280 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-546c999b-3076-48e1-94f5-8bdadf57d9b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:34.869325 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-546c999b-3076-48e1-94f5-8bdadf57d9b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:34.870104 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-546c999b-3076-48e1-94f5-8bdadf57d9b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:34.953286 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-9f808592-ce13-47ea-82b9-06acb340f053 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] validate_networks() for None {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:13:35.112765 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-546c999b-3076-48e1-94f5-8bdadf57d9b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:35.120774 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-546c999b-3076-48e1-94f5-8bdadf57d9b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 200 len: 1322 microversion: 2.1 time: 0.268849 Aug 22 17:13:35.121389 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 271/592] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:34 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:13:35.126880 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-52f0f651-a0f7-49f1-84cf-acf934fd5979 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:35.127437 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-52f0f651-a0f7-49f1-84cf-acf934fd5979 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:35.133825 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-52f0f651-a0f7-49f1-84cf-acf934fd5979 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:35.134800 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-52f0f651-a0f7-49f1-84cf-acf934fd5979 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:35.135236 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-52f0f651-a0f7-49f1-84cf-acf934fd5979 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:35.135958 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-52f0f651-a0f7-49f1-84cf-acf934fd5979 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:35.136413 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-52f0f651-a0f7-49f1-84cf-acf934fd5979 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:35.136833 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-52f0f651-a0f7-49f1-84cf-acf934fd5979 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:35.308582 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-52f0f651-a0f7-49f1-84cf-acf934fd5979 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:35.340916 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-52f0f651-a0f7-49f1-84cf-acf934fd5979 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1927 microversion: 2.75 time: 0.218462 Aug 22 17:13:35.341795 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 272/593] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:35 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1927 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:35.350706 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-35c1c837-0de3-430e-a8d8-bcc67f6df5bc tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:35.351326 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-35c1c837-0de3-430e-a8d8-bcc67f6df5bc tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:35.362103 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-35c1c837-0de3-430e-a8d8-bcc67f6df5bc tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:35.362833 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-35c1c837-0de3-430e-a8d8-bcc67f6df5bc tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:35.363421 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-35c1c837-0de3-430e-a8d8-bcc67f6df5bc tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:35.371766 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-35c1c837-0de3-430e-a8d8-bcc67f6df5bc tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:35.371766 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-35c1c837-0de3-430e-a8d8-bcc67f6df5bc tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:35.371766 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-35c1c837-0de3-430e-a8d8-bcc67f6df5bc tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:35.611661 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-35c1c837-0de3-430e-a8d8-bcc67f6df5bc tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:35.621262 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-35c1c837-0de3-430e-a8d8-bcc67f6df5bc tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1473 microversion: 2.1 time: 0.278021 Aug 22 17:13:35.659559 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-9f808592-ce13-47ea-82b9-06acb340f053 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:13:35.660157 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-9f808592-ce13-47ea-82b9-06acb340f053 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:13:35.660852 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-9f808592-ce13-47ea-82b9-06acb340f053 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:13:35.661493 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-9f808592-ce13-47ea-82b9-06acb340f053 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:13:35.662093 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-9f808592-ce13-47ea-82b9-06acb340f053 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:13:35.662382 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 273/594] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:35 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1473 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:35.683000 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9f808592-ce13-47ea-82b9-06acb340f053 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:35.685434 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9f808592-ce13-47ea-82b9-06acb340f053 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:35.685434 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9f808592-ce13-47ea-82b9-06acb340f053 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:35.685434 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9f808592-ce13-47ea-82b9-06acb340f053 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:35.685434 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9f808592-ce13-47ea-82b9-06acb340f053 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:35.685803 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9f808592-ce13-47ea-82b9-06acb340f053 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:35.728102 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-9f808592-ce13-47ea-82b9-06acb340f053 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Getting quotas for project c3d5a2fb6b4440168a7e84d03007a6fb. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:13:35.734868 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-9f808592-ce13-47ea-82b9-06acb340f053 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Getting quotas for user dafa41865864461fa0e0dbc4a0188e4b and project c3d5a2fb6b4440168a7e84d03007a6fb. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:13:35.774637 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9f808592-ce13-47ea-82b9-06acb340f053 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Going to run 1 instances... {{(pid=123015) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:13:35.777942 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9f808592-ce13-47ea-82b9-06acb340f053 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:13:35.947315 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9f808592-ce13-47ea-82b9-06acb340f053 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.284097 Aug 22 17:13:35.949239 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 322/595] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:13:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 17:13:35.961788 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4f8daf92-3aaa-4670-8b52-cf9f89611d21 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:35.962889 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-4f8daf92-3aaa-4670-8b52-cf9f89611d21 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:36.143432 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-13143de9-a074-427f-8b2e-7f300db78ad0 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:36.144322 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-13143de9-a074-427f-8b2e-7f300db78ad0 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:36.161816 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-13143de9-a074-427f-8b2e-7f300db78ad0 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:36.162691 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-13143de9-a074-427f-8b2e-7f300db78ad0 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:36.165922 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-13143de9-a074-427f-8b2e-7f300db78ad0 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:36.168125 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-13143de9-a074-427f-8b2e-7f300db78ad0 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:36.171598 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-13143de9-a074-427f-8b2e-7f300db78ad0 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:36.174725 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-13143de9-a074-427f-8b2e-7f300db78ad0 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:36.349956 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-4f8daf92-3aaa-4670-8b52-cf9f89611d21 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:36.357512 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4f8daf92-3aaa-4670-8b52-cf9f89611d21 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1211 microversion: 2.1 time: 0.400976 Aug 22 17:13:36.360568 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 274/596] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:35 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1211 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:36.371273 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-cde6d7db-1952-4ca3-8030-b7bda7948e99 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:36.373166 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-cde6d7db-1952-4ca3-8030-b7bda7948e99 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:36.387012 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cde6d7db-1952-4ca3-8030-b7bda7948e99 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:36.390746 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cde6d7db-1952-4ca3-8030-b7bda7948e99 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:36.392727 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cde6d7db-1952-4ca3-8030-b7bda7948e99 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:36.396004 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cde6d7db-1952-4ca3-8030-b7bda7948e99 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:36.396573 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cde6d7db-1952-4ca3-8030-b7bda7948e99 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:36.399788 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cde6d7db-1952-4ca3-8030-b7bda7948e99 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:36.555747 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-cde6d7db-1952-4ca3-8030-b7bda7948e99 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:36.576415 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=14,nova_api:UPDATE=14,nova_api:DELETE=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:36.580570 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-cde6d7db-1952-4ca3-8030-b7bda7948e99 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1927 microversion: 2.75 time: 0.213102 Aug 22 17:13:36.581371 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 275/597] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:36 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1927 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:36.648375 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-72c31f7b-0c60-4f4f-bfe2-f784bfed4c1b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:36.649452 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-72c31f7b-0c60-4f4f-bfe2-f784bfed4c1b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:36.660320 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-72c31f7b-0c60-4f4f-bfe2-f784bfed4c1b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:36.661993 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-72c31f7b-0c60-4f4f-bfe2-f784bfed4c1b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:36.662640 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-72c31f7b-0c60-4f4f-bfe2-f784bfed4c1b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:36.665429 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-72c31f7b-0c60-4f4f-bfe2-f784bfed4c1b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:36.667885 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-72c31f7b-0c60-4f4f-bfe2-f784bfed4c1b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:36.669073 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-72c31f7b-0c60-4f4f-bfe2-f784bfed4c1b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:36.726475 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-13143de9-a074-427f-8b2e-7f300db78ad0 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:36.734828 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-13143de9-a074-427f-8b2e-7f300db78ad0 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 200 len: 1322 microversion: 2.1 time: 0.596189 Aug 22 17:13:36.735626 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 323/598] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:36 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 1322 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:13:36.878817 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:36.891940 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-72c31f7b-0c60-4f4f-bfe2-f784bfed4c1b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:36.900736 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-72c31f7b-0c60-4f4f-bfe2-f784bfed4c1b tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1473 microversion: 2.1 time: 0.260437 Aug 22 17:13:36.901706 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 276/599] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:36 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1473 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:13:37.384707 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-562b72e0-a7df-4d86-826c-b7ea345cd4d4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:37.385495 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-562b72e0-a7df-4d86-826c-b7ea345cd4d4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:37.564527 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-562b72e0-a7df-4d86-826c-b7ea345cd4d4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:37.568309 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=59 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:37.577686 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-562b72e0-a7df-4d86-826c-b7ea345cd4d4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1211 microversion: 2.1 time: 0.197162 Aug 22 17:13:37.585209 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 324/600] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:37 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1211 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:37.611888 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-93ea8a3d-fd54-4e96-9d4f-13b5a04c3265 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:37.612515 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-93ea8a3d-fd54-4e96-9d4f-13b5a04c3265 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:37.629384 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-93ea8a3d-fd54-4e96-9d4f-13b5a04c3265 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:37.629935 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-93ea8a3d-fd54-4e96-9d4f-13b5a04c3265 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:37.630450 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-93ea8a3d-fd54-4e96-9d4f-13b5a04c3265 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:37.631190 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-93ea8a3d-fd54-4e96-9d4f-13b5a04c3265 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:37.631643 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-93ea8a3d-fd54-4e96-9d4f-13b5a04c3265 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:37.632062 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-93ea8a3d-fd54-4e96-9d4f-13b5a04c3265 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:37.650878 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=100 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:37.756815 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-433c74d9-a467-4580-8a73-199e43ed4d8c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:37.757459 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-433c74d9-a467-4580-8a73-199e43ed4d8c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:37.768026 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-433c74d9-a467-4580-8a73-199e43ed4d8c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:37.768854 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-433c74d9-a467-4580-8a73-199e43ed4d8c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:37.779607 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-433c74d9-a467-4580-8a73-199e43ed4d8c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:37.779607 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-433c74d9-a467-4580-8a73-199e43ed4d8c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:37.779607 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-433c74d9-a467-4580-8a73-199e43ed4d8c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:37.779607 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-433c74d9-a467-4580-8a73-199e43ed4d8c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:37.831890 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:37.846709 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-93ea8a3d-fd54-4e96-9d4f-13b5a04c3265 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:37.874680 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-93ea8a3d-fd54-4e96-9d4f-13b5a04c3265 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1927 microversion: 2.75 time: 0.267602 Aug 22 17:13:37.889963 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 277/601] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:37 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1927 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:37.924241 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-40202853-9c38-43f0-b978-89d795c1ea7f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:37.925059 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-40202853-9c38-43f0-b978-89d795c1ea7f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:37.937779 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-40202853-9c38-43f0-b978-89d795c1ea7f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:37.938710 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-40202853-9c38-43f0-b978-89d795c1ea7f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:37.939313 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-40202853-9c38-43f0-b978-89d795c1ea7f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:37.940182 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-40202853-9c38-43f0-b978-89d795c1ea7f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:37.948715 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-40202853-9c38-43f0-b978-89d795c1ea7f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:37.949364 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-40202853-9c38-43f0-b978-89d795c1ea7f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:38.378412 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-40202853-9c38-43f0-b978-89d795c1ea7f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:38.390385 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-40202853-9c38-43f0-b978-89d795c1ea7f tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1473 microversion: 2.1 time: 0.467812 Aug 22 17:13:38.390385 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 278/602] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:37 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1473 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:13:38.601484 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b83c783c-e408-4433-8600-3e5d27780e7c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:38.602099 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b83c783c-e408-4433-8600-3e5d27780e7c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:38.619089 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b83c783c-e408-4433-8600-3e5d27780e7c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:38.620028 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b83c783c-e408-4433-8600-3e5d27780e7c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:38.620496 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b83c783c-e408-4433-8600-3e5d27780e7c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:38.621267 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b83c783c-e408-4433-8600-3e5d27780e7c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:38.624632 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b83c783c-e408-4433-8600-3e5d27780e7c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:38.626985 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b83c783c-e408-4433-8600-3e5d27780e7c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:38.766741 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b83c783c-e408-4433-8600-3e5d27780e7c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:38.783048 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b83c783c-e408-4433-8600-3e5d27780e7c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1263 microversion: 2.1 time: 0.183442 Aug 22 17:13:38.783765 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 279/603] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:38 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1263 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:38.867848 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-433c74d9-a467-4580-8a73-199e43ed4d8c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:38.884025 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-433c74d9-a467-4580-8a73-199e43ed4d8c tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 200 len: 1322 microversion: 2.1 time: 1.130879 Aug 22 17:13:38.884889 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 325/604] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:37 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 1322 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:13:38.902883 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-bb47efcc-65e1-4a29-a74b-ff2e92ffe2bc tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:38.903517 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-bb47efcc-65e1-4a29-a74b-ff2e92ffe2bc tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:38.914867 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb47efcc-65e1-4a29-a74b-ff2e92ffe2bc tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:38.915373 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb47efcc-65e1-4a29-a74b-ff2e92ffe2bc tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:38.915815 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb47efcc-65e1-4a29-a74b-ff2e92ffe2bc tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:38.916600 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb47efcc-65e1-4a29-a74b-ff2e92ffe2bc tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:38.917070 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb47efcc-65e1-4a29-a74b-ff2e92ffe2bc tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:38.917534 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb47efcc-65e1-4a29-a74b-ff2e92ffe2bc tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:39.223030 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-bb47efcc-65e1-4a29-a74b-ff2e92ffe2bc tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:39.267143 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-bb47efcc-65e1-4a29-a74b-ff2e92ffe2bc tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1927 microversion: 2.75 time: 0.370699 Aug 22 17:13:39.268057 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 280/605] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:38 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1927 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:39.288409 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-7cf79db7-22ab-485e-a2b8-9f0fc1227a36 req-1f790978-ab16-432d-9e06-953033735f62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95ed8662-ad0c-43f6-9800-8db34e26243d", "name": "network-vif-deleted", "tag": "53926e96-e4b6-4b18-aa5b-faf6e595f345"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:39.319219 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-7cf79db7-22ab-485e-a2b8-9f0fc1227a36 req-1f790978-ab16-432d-9e06-953033735f62 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:39.319814 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-7cf79db7-22ab-485e-a2b8-9f0fc1227a36 req-1f790978-ab16-432d-9e06-953033735f62 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:39.320264 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-7cf79db7-22ab-485e-a2b8-9f0fc1227a36 req-1f790978-ab16-432d-9e06-953033735f62 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:39.334261 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-7cf79db7-22ab-485e-a2b8-9f0fc1227a36 req-1f790978-ab16-432d-9e06-953033735f62 service nova] Creating event network-vif-deleted:53926e96-e4b6-4b18-aa5b-faf6e595f345 for instance 95ed8662-ad0c-43f6-9800-8db34e26243d on n-h1-854030-1 Aug 22 17:13:39.342174 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-7cf79db7-22ab-485e-a2b8-9f0fc1227a36 req-1f790978-ab16-432d-9e06-953033735f62 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056030 Aug 22 17:13:39.345325 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 326/606] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:39.418185 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-dc9928fc-1bea-455e-bdac-e0272d42683c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:39.425041 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-dc9928fc-1bea-455e-bdac-e0272d42683c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:39.433696 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dc9928fc-1bea-455e-bdac-e0272d42683c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:39.437851 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dc9928fc-1bea-455e-bdac-e0272d42683c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:39.438607 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dc9928fc-1bea-455e-bdac-e0272d42683c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:39.439568 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dc9928fc-1bea-455e-bdac-e0272d42683c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:39.441125 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dc9928fc-1bea-455e-bdac-e0272d42683c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:39.445483 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dc9928fc-1bea-455e-bdac-e0272d42683c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:39.577318 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-dc9928fc-1bea-455e-bdac-e0272d42683c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:39.591785 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-dc9928fc-1bea-455e-bdac-e0272d42683c tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1431 microversion: 2.1 time: 0.177426 Aug 22 17:13:39.592378 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 281/607] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:39 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1431 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:39.758774 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1631c518-7a57-4c89-87e4-88fdd2c85b1a tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:39.762403 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:39.762403 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:13:39.763655 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1631c518-7a57-4c89-87e4-88fdd2c85b1a tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:39.764142 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1631c518-7a57-4c89-87e4-88fdd2c85b1a tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:39.768647 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1631c518-7a57-4c89-87e4-88fdd2c85b1a tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:39.778894 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1631c518-7a57-4c89-87e4-88fdd2c85b1a tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:39.781513 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1631c518-7a57-4c89-87e4-88fdd2c85b1a tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:39.782276 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1631c518-7a57-4c89-87e4-88fdd2c85b1a tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:39.792592 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=9 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:39.805761 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c481c14c-ac79-4908-9897-c0d247495c74 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:39.808456 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c481c14c-ac79-4908-9897-c0d247495c74 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:39.819549 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c481c14c-ac79-4908-9897-c0d247495c74 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:39.821938 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c481c14c-ac79-4908-9897-c0d247495c74 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:39.831391 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c481c14c-ac79-4908-9897-c0d247495c74 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:39.835010 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c481c14c-ac79-4908-9897-c0d247495c74 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:39.835561 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c481c14c-ac79-4908-9897-c0d247495c74 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:39.836085 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c481c14c-ac79-4908-9897-c0d247495c74 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:39.885523 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1631c518-7a57-4c89-87e4-88fdd2c85b1a tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.396297 Aug 22 17:13:39.886140 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 327/608] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:13:39 2022] GET /compute/v2.1/os-services => generated 944 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:13:39.904287 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b5ab1a92-3c71-4ec1-988f-efbaeae48f92 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:39.929359 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:39.929359 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:13:39.930620 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b5ab1a92-3c71-4ec1-988f-efbaeae48f92 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:39.931064 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b5ab1a92-3c71-4ec1-988f-efbaeae48f92 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:39.931509 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b5ab1a92-3c71-4ec1-988f-efbaeae48f92 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:39.932458 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b5ab1a92-3c71-4ec1-988f-efbaeae48f92 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:39.932769 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b5ab1a92-3c71-4ec1-988f-efbaeae48f92 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:39.933226 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b5ab1a92-3c71-4ec1-988f-efbaeae48f92 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:40.016541 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b5ab1a92-3c71-4ec1-988f-efbaeae48f92 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.115676 Aug 22 17:13:40.018797 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 328/609] 10.222.0.96 () {58 vars in 1170 bytes} [Mon Aug 22 17:13:39 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:13:40.038964 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6fb1af07-ae70-4fc6-ab37-e18aac36dcbe tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:40.039731 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-6fb1af07-ae70-4fc6-ab37-e18aac36dcbe tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:40.064340 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6fb1af07-ae70-4fc6-ab37-e18aac36dcbe tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:40.064860 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6fb1af07-ae70-4fc6-ab37-e18aac36dcbe tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:40.065519 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6fb1af07-ae70-4fc6-ab37-e18aac36dcbe tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:40.066397 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6fb1af07-ae70-4fc6-ab37-e18aac36dcbe tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:40.066521 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c481c14c-ac79-4908-9897-c0d247495c74 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:40.075982 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6fb1af07-ae70-4fc6-ab37-e18aac36dcbe tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:40.076712 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6fb1af07-ae70-4fc6-ab37-e18aac36dcbe tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:40.079486 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c481c14c-ac79-4908-9897-c0d247495c74 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1271 microversion: 2.1 time: 0.277665 Aug 22 17:13:40.081830 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 282/610] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:39 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1271 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:40.097883 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6afdc112-5b99-4cb6-b75a-f872ab6d2a98 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:40.113407 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:40.113407 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:13:40.116887 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6afdc112-5b99-4cb6-b75a-f872ab6d2a98 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:40.119370 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6afdc112-5b99-4cb6-b75a-f872ab6d2a98 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:40.119826 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6afdc112-5b99-4cb6-b75a-f872ab6d2a98 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:40.120612 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6afdc112-5b99-4cb6-b75a-f872ab6d2a98 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:40.121711 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6afdc112-5b99-4cb6-b75a-f872ab6d2a98 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:40.121711 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6afdc112-5b99-4cb6-b75a-f872ab6d2a98 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:40.176168 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-6afdc112-5b99-4cb6-b75a-f872ab6d2a98 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.091506 Aug 22 17:13:40.187017 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 283/611] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:13:40 2022] GET /compute/v2.1/os-services => generated 944 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:40.191487 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0b732761-11be-4ed5-b610-8fd0b683575e tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:40.200671 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:40.200671 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:13:40.202128 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0b732761-11be-4ed5-b610-8fd0b683575e tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:40.203377 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0b732761-11be-4ed5-b610-8fd0b683575e tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:40.203981 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0b732761-11be-4ed5-b610-8fd0b683575e tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:40.204733 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0b732761-11be-4ed5-b610-8fd0b683575e tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:40.211561 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0b732761-11be-4ed5-b610-8fd0b683575e tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:40.212170 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0b732761-11be-4ed5-b610-8fd0b683575e tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:40.283452 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0b732761-11be-4ed5-b610-8fd0b683575e tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] 10.222.0.96 "GET /compute/v2.1/os-services?host=n-d-854030-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.097809 Aug 22 17:13:40.290244 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 284/612] 10.222.0.96 () {58 vars in 1194 bytes} [Mon Aug 22 17:13:40 2022] GET /compute/v2.1/os-services?host=n-d-854030-1&binary=xxx => generated 16 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:13:40.297351 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-cc0888f2-35fd-4d53-bafd-5fa5cb15f745 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:40.299854 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:40.299854 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:13:40.301002 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cc0888f2-35fd-4d53-bafd-5fa5cb15f745 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:40.317063 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cc0888f2-35fd-4d53-bafd-5fa5cb15f745 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:40.317937 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cc0888f2-35fd-4d53-bafd-5fa5cb15f745 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:40.318811 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cc0888f2-35fd-4d53-bafd-5fa5cb15f745 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:40.325323 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cc0888f2-35fd-4d53-bafd-5fa5cb15f745 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:40.325323 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cc0888f2-35fd-4d53-bafd-5fa5cb15f745 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:40.404713 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-cc0888f2-35fd-4d53-bafd-5fa5cb15f745 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.111418 Aug 22 17:13:40.416351 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 285/613] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:13:40 2022] GET /compute/v2.1/os-services => generated 944 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:40.421826 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8691151c-56f4-4287-a94f-9eb45d657720 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:40.427272 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-8691151c-56f4-4287-a94f-9eb45d657720 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:40.440351 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8691151c-56f4-4287-a94f-9eb45d657720 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:40.441022 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8691151c-56f4-4287-a94f-9eb45d657720 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:40.441684 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8691151c-56f4-4287-a94f-9eb45d657720 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:40.443123 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8691151c-56f4-4287-a94f-9eb45d657720 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:40.443123 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8691151c-56f4-4287-a94f-9eb45d657720 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:40.443123 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8691151c-56f4-4287-a94f-9eb45d657720 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:40.572382 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-8691151c-56f4-4287-a94f-9eb45d657720 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:40.596248 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8691151c-56f4-4287-a94f-9eb45d657720 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1927 microversion: 2.75 time: 0.178310 Aug 22 17:13:40.613519 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 286/614] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:40 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1927 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:40.628378 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8958237b-03a0-45dc-bdbf-06aebcaf87a4 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:40.632162 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:40.632162 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:13:40.634190 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8958237b-03a0-45dc-bdbf-06aebcaf87a4 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:40.634843 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8958237b-03a0-45dc-bdbf-06aebcaf87a4 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:40.635644 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8958237b-03a0-45dc-bdbf-06aebcaf87a4 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:40.638537 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8958237b-03a0-45dc-bdbf-06aebcaf87a4 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:40.638537 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8958237b-03a0-45dc-bdbf-06aebcaf87a4 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:40.640630 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8958237b-03a0-45dc-bdbf-06aebcaf87a4 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:40.722932 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8958237b-03a0-45dc-bdbf-06aebcaf87a4 tempest-ServicesAdminNegativeTestJSON-2010130269 tempest-ServicesAdminNegativeTestJSON-2010130269-project-admin] 10.222.0.96 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.107905 Aug 22 17:13:40.729861 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 287/615] 10.222.0.96 () {58 vars in 1198 bytes} [Mon Aug 22 17:13:40 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:13:40.753131 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-934e80d7-f0dc-44f3-9d93-c7c938374cae tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:40.755737 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-934e80d7-f0dc-44f3-9d93-c7c938374cae tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:40.769820 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-934e80d7-f0dc-44f3-9d93-c7c938374cae tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:40.769820 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-934e80d7-f0dc-44f3-9d93-c7c938374cae tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:40.770921 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-934e80d7-f0dc-44f3-9d93-c7c938374cae tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:40.771912 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-934e80d7-f0dc-44f3-9d93-c7c938374cae tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:40.775089 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-934e80d7-f0dc-44f3-9d93-c7c938374cae tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:40.778350 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-934e80d7-f0dc-44f3-9d93-c7c938374cae tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:40.856808 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-934e80d7-f0dc-44f3-9d93-c7c938374cae tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:40.858067 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-934e80d7-f0dc-44f3-9d93-c7c938374cae tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:40.859441 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-934e80d7-f0dc-44f3-9d93-c7c938374cae tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:40.860797 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-934e80d7-f0dc-44f3-9d93-c7c938374cae tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lazy-loading 'fault' on Instance uuid 95ed8662-ad0c-43f6-9800-8db34e26243d {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:40.950046 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6fb1af07-ae70-4fc6-ab37-e18aac36dcbe tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:40.976646 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6fb1af07-ae70-4fc6-ab37-e18aac36dcbe tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 200 len: 1322 microversion: 2.1 time: 0.956312 Aug 22 17:13:40.977696 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 329/616] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:40 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 1322 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:40.989703 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-934e80d7-f0dc-44f3-9d93-c7c938374cae tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35652618557443a4a1dbfb3e0028f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3e01147404b6a86ef50f3d441841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:41.002071 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-934e80d7-f0dc-44f3-9d93-c7c938374cae tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 200 len: 1307 microversion: 2.1 time: 0.270688 Aug 22 17:13:41.003238 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 288/617] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:40 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 1307 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:41.106036 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-87ca0c2b-0c44-473c-86f1-07ebfa236e9a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:41.106975 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-87ca0c2b-0c44-473c-86f1-07ebfa236e9a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:41.119414 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-87ca0c2b-0c44-473c-86f1-07ebfa236e9a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:41.120157 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-87ca0c2b-0c44-473c-86f1-07ebfa236e9a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:41.122452 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-87ca0c2b-0c44-473c-86f1-07ebfa236e9a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:41.123550 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-87ca0c2b-0c44-473c-86f1-07ebfa236e9a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:41.128715 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-87ca0c2b-0c44-473c-86f1-07ebfa236e9a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:41.129450 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-87ca0c2b-0c44-473c-86f1-07ebfa236e9a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:41.156899 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2a3c2c37-42ca-42b7-83f7-eb2a895e398f tempest-ServicesAdminNegativeTestJSON-322194192 tempest-ServicesAdminNegativeTestJSON-322194192-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:41.159636 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:13:41.159636 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:13:41.160989 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-2a3c2c37-42ca-42b7-83f7-eb2a895e398f tempest-ServicesAdminNegativeTestJSON-322194192 tempest-ServicesAdminNegativeTestJSON-322194192-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '241f09954e334e55b0be2d21ea90e785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ec3c29df15b4a49b41edb3f6d386e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2a3c2c37-42ca-42b7-83f7-eb2a895e398f tempest-ServicesAdminNegativeTestJSON-322194192 tempest-ServicesAdminNegativeTestJSON-322194192-project] Request method failure captured: Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7lBTYbquSZ4Tas2h_HkisYITzmaOxJxXuhlSnj5Az7dbkP5vNCKOX-AsGPHjpxnjbVPUn6W8uO-HPMPQppOUAmiw-zwWDzaRDyxmNvvY8kwKTPTXo9PEB06ffY8GAEoG9kc8G97YzpTE1i4LtqBNKNgP2pXILT7ebrWWHW6bol7yi8 Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 7ec3c29df15b4a49b41edb3f6d386e0b Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-322194192 Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:13:41.169166 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:13:41.170548 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7ec3c29df15b4a49b41edb3f6d386e0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7ec3c29df15b4a49b41edb3f6d386e0b", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7ec3c29df15b4a49b41edb3f6d386e0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7ec3c29df15b4a49b41edb3f6d386e0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:41.170548 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-322194192 Aug 22 17:13:41.170548 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 7ec3c29df15b4a49b41edb3f6d386e0b Aug 22 17:13:41.170548 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-322194192 Aug 22 17:13:41.170548 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServicesAdminNegativeTestJSON-322194192-project Aug 22 17:13:41.170548 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:41.170548 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:41.170548 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 241f09954e334e55b0be2d21ea90e785 Aug 22 17:13:41.170548 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-322194192-project Aug 22 17:13:41.170548 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:13:41.170548 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 22 17:13:41.170548 n-d-854030-1 devstack@n-api.service[123015]: action_args: {} Aug 22 17:13:41.172156 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:41.172156 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:41.172156 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:41.172156 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:41.172156 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:41.172156 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:41.172156 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 17:13:41.172156 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:41.172156 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 17:13:41.172156 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:41.172156 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:41.172156 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:41.172156 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 22 17:13:41.172156 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 22 17:13:41.172156 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:13:41.172156 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:13:41.172156 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:13:41.172156 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:13:41.172156 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 22 17:13:41.180042 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:41.181451 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2a3c2c37-42ca-42b7-83f7-eb2a895e398f tempest-ServicesAdminNegativeTestJSON-322194192 tempest-ServicesAdminNegativeTestJSON-322194192-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:41.181451 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2a3c2c37-42ca-42b7-83f7-eb2a895e398f tempest-ServicesAdminNegativeTestJSON-322194192 tempest-ServicesAdminNegativeTestJSON-322194192-project] 10.222.0.96 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.191871 Aug 22 17:13:41.181451 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 330/618] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:13:40 2022] GET /compute/v2.1/os-services => generated 112 bytes in 193 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:41.228872 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-87ca0c2b-0c44-473c-86f1-07ebfa236e9a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:41.255613 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-87ca0c2b-0c44-473c-86f1-07ebfa236e9a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1269 microversion: 2.1 time: 0.149549 Aug 22 17:13:41.273354 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 289/619] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:41 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1269 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:41.637520 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ee309813-7e81-4e3b-ae29-14add13e2c30 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:41.638494 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ee309813-7e81-4e3b-ae29-14add13e2c30 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:41.660349 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ee309813-7e81-4e3b-ae29-14add13e2c30 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:41.662292 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ee309813-7e81-4e3b-ae29-14add13e2c30 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:41.662980 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ee309813-7e81-4e3b-ae29-14add13e2c30 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:41.663900 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ee309813-7e81-4e3b-ae29-14add13e2c30 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:41.664529 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ee309813-7e81-4e3b-ae29-14add13e2c30 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:41.665880 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ee309813-7e81-4e3b-ae29-14add13e2c30 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:42.009045 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-af2a1ab9-0766-499e-bca8-f75523ccb947 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:42.013852 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-af2a1ab9-0766-499e-bca8-f75523ccb947 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:42.040720 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af2a1ab9-0766-499e-bca8-f75523ccb947 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:42.045006 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af2a1ab9-0766-499e-bca8-f75523ccb947 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:42.047919 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af2a1ab9-0766-499e-bca8-f75523ccb947 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:42.049494 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af2a1ab9-0766-499e-bca8-f75523ccb947 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:42.050477 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af2a1ab9-0766-499e-bca8-f75523ccb947 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:42.057428 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-af2a1ab9-0766-499e-bca8-f75523ccb947 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:42.398995 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-ee309813-7e81-4e3b-ae29-14add13e2c30 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:42.443476 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ee309813-7e81-4e3b-ae29-14add13e2c30 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1927 microversion: 2.75 time: 0.819992 Aug 22 17:13:42.445941 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 331/620] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:41 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1927 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:42.469649 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-07b8c0d9-77c3-40e1-9045-bf995fc405c3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:42.470507 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-07b8c0d9-77c3-40e1-9045-bf995fc405c3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] [instance: 95ed8662-ad0c-43f6-9800-8db34e26243d] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:42.478378 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-07b8c0d9-77c3-40e1-9045-bf995fc405c3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:42.479154 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-07b8c0d9-77c3-40e1-9045-bf995fc405c3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:42.479763 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-07b8c0d9-77c3-40e1-9045-bf995fc405c3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:42.480664 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-07b8c0d9-77c3-40e1-9045-bf995fc405c3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:42.481326 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-07b8c0d9-77c3-40e1-9045-bf995fc405c3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:42.481949 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-07b8c0d9-77c3-40e1-9045-bf995fc405c3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:42.508588 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-07b8c0d9-77c3-40e1-9045-bf995fc405c3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] HTTP exception thrown: Instance 95ed8662-ad0c-43f6-9800-8db34e26243d could not be found. Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-07b8c0d9-77c3-40e1-9045-bf995fc405c3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Request method failure captured: Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d HTTP/1.1 Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7j-X63WR6_GgRcybzReVqP1d2SMv_UvQM4oD8ejrbYYovWKTdIA8he91OVQCrAWTYZ8KCAdFNESDWKVUtrtiKx_h_e5deQWJASGR20pHIWznITbUxBu7gbumJWS57Edhp-haQMVlf0IsZq8yO3MfaC2NFTAJqAl-vleyuYQGUNw4KE Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 10f3e01147404b6a86ef50f3d441841a Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-LiveMigrationNegativeTest-1104444746 Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:13:42.510820 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:13:42.512527 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/10f3e01147404b6a86ef50f3d441841a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_10f3e01147404b6a86ef50f3d441841a", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/10f3e01147404b6a86ef50f3d441841a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/10f3e01147404b6a86ef50f3d441841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:42.512527 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-LiveMigrationNegativeTest-1104444746 Aug 22 17:13:42.512527 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 10f3e01147404b6a86ef50f3d441841a Aug 22 17:13:42.512527 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1104444746 Aug 22 17:13:42.512527 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-LiveMigrationNegativeTest-1104444746-project Aug 22 17:13:42.512527 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:42.512527 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:42.512527 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 35652618557443a4a1dbfb3e0028f0c7 Aug 22 17:13:42.512527 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-LiveMigrationNegativeTest-1104444746-project Aug 22 17:13:42.512527 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:13:42.512527 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance 95ed8662-ad0c-43f6-9800-8db34e26243d could not be found. Aug 22 17:13:42.512527 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '95ed8662-ad0c-43f6-9800-8db34e26243d'} Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95ed8662-ad0c-43f6-9800-8db34e26243d could not be found. Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:42.513450 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:42.516247 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:42.516247 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:13:42.516247 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:13:42.516247 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:13:42.516247 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:13:42.516247 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:13:42.516247 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:13:42.516247 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95ed8662-ad0c-43f6-9800-8db34e26243d could not be found. Aug 22 17:13:42.516247 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:42.516247 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:42.516247 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:42.516247 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:42.516247 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:42.516247 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:42.516247 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:13:42.516247 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:13:42.516247 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95ed8662-ad0c-43f6-9800-8db34e26243d could not be found. Aug 22 17:13:42.516247 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:42.519535 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-07b8c0d9-77c3-40e1-9045-bf995fc405c3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] Returning 404 to user: Instance 95ed8662-ad0c-43f6-9800-8db34e26243d could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:42.520844 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-07b8c0d9-77c3-40e1-9045-bf995fc405c3 tempest-LiveMigrationNegativeTest-1104444746 tempest-LiveMigrationNegativeTest-1104444746-project] 10.222.0.96 "GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d" status: 404 len: 111 microversion: 2.1 time: 0.073439 Aug 22 17:13:42.521941 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 332/621] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:42 2022] GET /compute/v2.1/servers/95ed8662-ad0c-43f6-9800-8db34e26243d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:42.535593 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9991c559-3fcc-4a35-ac33-dae527f5d160 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:42.542047 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9991c559-3fcc-4a35-ac33-dae527f5d160 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:42.559734 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9991c559-3fcc-4a35-ac33-dae527f5d160 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:42.563200 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9991c559-3fcc-4a35-ac33-dae527f5d160 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:42.563200 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9991c559-3fcc-4a35-ac33-dae527f5d160 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:42.563200 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9991c559-3fcc-4a35-ac33-dae527f5d160 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:42.563200 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9991c559-3fcc-4a35-ac33-dae527f5d160 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:42.563818 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9991c559-3fcc-4a35-ac33-dae527f5d160 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:42.894324 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-af2a1ab9-0766-499e-bca8-f75523ccb947 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:42.906998 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-af2a1ab9-0766-499e-bca8-f75523ccb947 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 200 len: 1322 microversion: 2.1 time: 0.906219 Aug 22 17:13:42.909511 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 290/622] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:41 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 1322 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:42.927666 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-3c6ddb0b-3062-489a-9ff9-b994f7742c5b req-40764a6f-ee0f-48d3-89d3-fb553fedbab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cde06f3-062c-470d-995f-51b1b2136a14", "name": "network-vif-plugged", "status": "completed", "tag": "89538d2b-3be7-410b-9b9a-8444ab3244a2"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:42.942712 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-3c6ddb0b-3062-489a-9ff9-b994f7742c5b req-40764a6f-ee0f-48d3-89d3-fb553fedbab9 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:42.949999 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-3c6ddb0b-3062-489a-9ff9-b994f7742c5b req-40764a6f-ee0f-48d3-89d3-fb553fedbab9 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:42.949999 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-3c6ddb0b-3062-489a-9ff9-b994f7742c5b req-40764a6f-ee0f-48d3-89d3-fb553fedbab9 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:42.957709 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-3c6ddb0b-3062-489a-9ff9-b994f7742c5b req-40764a6f-ee0f-48d3-89d3-fb553fedbab9 service nova] Creating event network-vif-plugged:89538d2b-3be7-410b-9b9a-8444ab3244a2 for instance 0cde06f3-062c-470d-995f-51b1b2136a14 on n-h1-854030-1 Aug 22 17:13:42.966008 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-3c6ddb0b-3062-489a-9ff9-b994f7742c5b req-40764a6f-ee0f-48d3-89d3-fb553fedbab9 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056168 Aug 22 17:13:42.966836 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 291/623] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:43.102370 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9991c559-3fcc-4a35-ac33-dae527f5d160 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:43.119532 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9991c559-3fcc-4a35-ac33-dae527f5d160 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1269 microversion: 2.1 time: 0.596245 Aug 22 17:13:43.120113 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 333/624] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:42 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1269 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:43.485050 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0696edd7-b847-4d63-9724-1a3217223a9d tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:43.491060 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-0696edd7-b847-4d63-9724-1a3217223a9d tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:43.526500 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0696edd7-b847-4d63-9724-1a3217223a9d tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:43.532674 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0696edd7-b847-4d63-9724-1a3217223a9d tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:43.534325 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0696edd7-b847-4d63-9724-1a3217223a9d tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:43.538540 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0696edd7-b847-4d63-9724-1a3217223a9d tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:43.543904 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0696edd7-b847-4d63-9724-1a3217223a9d tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:43.550217 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0696edd7-b847-4d63-9724-1a3217223a9d tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:43.824126 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-0696edd7-b847-4d63-9724-1a3217223a9d tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:43.911053 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0696edd7-b847-4d63-9724-1a3217223a9d tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1927 microversion: 2.75 time: 0.443446 Aug 22 17:13:43.912214 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 292/625] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:43 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1927 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:43.940156 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-74d08244-9e38-4510-93ca-a7de69d7ee96 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:43.942584 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-74d08244-9e38-4510-93ca-a7de69d7ee96 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:43.955080 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-74d08244-9e38-4510-93ca-a7de69d7ee96 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:43.956317 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-74d08244-9e38-4510-93ca-a7de69d7ee96 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:43.957392 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-74d08244-9e38-4510-93ca-a7de69d7ee96 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:43.959059 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-74d08244-9e38-4510-93ca-a7de69d7ee96 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:43.960121 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-74d08244-9e38-4510-93ca-a7de69d7ee96 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:43.961333 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-74d08244-9e38-4510-93ca-a7de69d7ee96 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:44.169371 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-679164e6-b7b7-467f-8e1f-39eb5a5cc48b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:44.170467 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-679164e6-b7b7-467f-8e1f-39eb5a5cc48b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:44.198271 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-679164e6-b7b7-467f-8e1f-39eb5a5cc48b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:44.199101 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-679164e6-b7b7-467f-8e1f-39eb5a5cc48b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:44.211913 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-679164e6-b7b7-467f-8e1f-39eb5a5cc48b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:44.213593 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-679164e6-b7b7-467f-8e1f-39eb5a5cc48b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:44.216528 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-679164e6-b7b7-467f-8e1f-39eb5a5cc48b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:44.218142 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-679164e6-b7b7-467f-8e1f-39eb5a5cc48b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:44.422312 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-679164e6-b7b7-467f-8e1f-39eb5a5cc48b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:44.453320 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-679164e6-b7b7-467f-8e1f-39eb5a5cc48b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1269 microversion: 2.1 time: 0.293144 Aug 22 17:13:44.454440 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 293/626] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:44 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1269 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:44.521769 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-74d08244-9e38-4510-93ca-a7de69d7ee96 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:44.537849 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-74d08244-9e38-4510-93ca-a7de69d7ee96 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 200 len: 1322 microversion: 2.1 time: 0.605222 Aug 22 17:13:44.538762 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 334/627] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:43 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 1322 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:13:44.941116 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c500a500-ac50-40d8-b60d-f5e37e08caa3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:44.943299 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c500a500-ac50-40d8-b60d-f5e37e08caa3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:44.962970 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c500a500-ac50-40d8-b60d-f5e37e08caa3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:44.964420 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c500a500-ac50-40d8-b60d-f5e37e08caa3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:44.968382 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c500a500-ac50-40d8-b60d-f5e37e08caa3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:44.972544 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c500a500-ac50-40d8-b60d-f5e37e08caa3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:44.972544 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c500a500-ac50-40d8-b60d-f5e37e08caa3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:44.972544 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c500a500-ac50-40d8-b60d-f5e37e08caa3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:45.278982 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-c500a500-ac50-40d8-b60d-f5e37e08caa3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:45.382569 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c500a500-ac50-40d8-b60d-f5e37e08caa3 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1927 microversion: 2.75 time: 0.440413 Aug 22 17:13:45.386568 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 294/628] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:44 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1927 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:45.496587 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-588d4a8b-9329-4fb2-a571-1bcb86bc0a87 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:45.498924 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-588d4a8b-9329-4fb2-a571-1bcb86bc0a87 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:45.520890 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-588d4a8b-9329-4fb2-a571-1bcb86bc0a87 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:45.522907 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-588d4a8b-9329-4fb2-a571-1bcb86bc0a87 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:45.526127 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-588d4a8b-9329-4fb2-a571-1bcb86bc0a87 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:45.539905 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-588d4a8b-9329-4fb2-a571-1bcb86bc0a87 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:45.541260 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-588d4a8b-9329-4fb2-a571-1bcb86bc0a87 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:45.543436 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-588d4a8b-9329-4fb2-a571-1bcb86bc0a87 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:45.580627 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6cd95a20-baa6-481b-9120-e93399212fba tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:45.581583 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-6cd95a20-baa6-481b-9120-e93399212fba tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:45.606988 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6cd95a20-baa6-481b-9120-e93399212fba tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:45.607349 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6cd95a20-baa6-481b-9120-e93399212fba tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:45.611671 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6cd95a20-baa6-481b-9120-e93399212fba tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:45.613787 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6cd95a20-baa6-481b-9120-e93399212fba tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:45.615663 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6cd95a20-baa6-481b-9120-e93399212fba tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:45.616314 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6cd95a20-baa6-481b-9120-e93399212fba tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:45.649273 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=100 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:46.205521 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-6cd95a20-baa6-481b-9120-e93399212fba tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:46.221142 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-6cd95a20-baa6-481b-9120-e93399212fba tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 200 len: 1472 microversion: 2.1 time: 0.642417 Aug 22 17:13:46.222067 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 295/629] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:45 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 1472 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:46.354996 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=64 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:46.738296 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-708e84e7-30e2-4605-8788-d6849bcb5811 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:46.741306 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-708e84e7-30e2-4605-8788-d6849bcb5811 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] [instance: 9737899d-a22f-42f0-925a-6a06bfc599d8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:46.753215 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-708e84e7-30e2-4605-8788-d6849bcb5811 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] HTTP exception thrown: Instance 9737899d-a22f-42f0-925a-6a06bfc599d8 could not be found. Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-708e84e7-30e2-4605-8788-d6849bcb5811 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Request method failure captured: Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers/9737899d-a22f-42f0-925a-6a06bfc599d8/action HTTP/1.1 Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 15 Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7kwS5fTDXijSbcaGZOVoKd1Ycg_XTAWlVIViX5X9Xcd62h-mq5g4Sn3S17RwZuWWpvTEOnVL3xHfd8N7K4FQNJYgzVpDLmN7bBs_AZSI0mDEFe6xFaf2aAvwbD1niUCbp4rKq-_5RzfyCAlOyDSTjVqqkjGlNuueFiCfXozldN6MxM Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 67d79fd58c8740a78b9a8395fd05475f Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-126741515 Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:13:46.755371 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:13:46.756830 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/67d79fd58c8740a78b9a8395fd05475f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_67d79fd58c8740a78b9a8395fd05475f", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/67d79fd58c8740a78b9a8395fd05475f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/67d79fd58c8740a78b9a8395fd05475f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:46.756830 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServersAdminNegativeTestJSON-126741515 Aug 22 17:13:46.756830 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 67d79fd58c8740a78b9a8395fd05475f Aug 22 17:13:46.756830 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-126741515 Aug 22 17:13:46.756830 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServersAdminNegativeTestJSON-126741515-project-admin Aug 22 17:13:46.756830 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:13:46.756830 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:13:46.756830 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 33ef6c5c41d64d1eac6e6f1290110bff Aug 22 17:13:46.756830 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServersAdminNegativeTestJSON-126741515-project-admin Aug 22 17:13:46.756830 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:13:46.756830 n-d-854030-1 devstack@n-api.service[123016]: {"migrate": {}} Aug 22 17:13:46.756830 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:13:46.756830 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance 9737899d-a22f-42f0-925a-6a06bfc599d8 could not be found. Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '9737899d-a22f-42f0-925a-6a06bfc599d8', 'body': {'migrate': {}}} Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9737899d-a22f-42f0-925a-6a06bfc599d8 could not be found. Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:46.757759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:46.758967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:46.758967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:46.758967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 22 17:13:46.758967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 22 17:13:46.758967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:13:46.758967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:13:46.758967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9737899d-a22f-42f0-925a-6a06bfc599d8 could not be found. Aug 22 17:13:46.758967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:46.758967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:46.758967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:46.758967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:46.758967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:46.758967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:46.758967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:13:46.758967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:13:46.758967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9737899d-a22f-42f0-925a-6a06bfc599d8 could not be found. Aug 22 17:13:46.758967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:46.761938 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-708e84e7-30e2-4605-8788-d6849bcb5811 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Returning 404 to user: Instance 9737899d-a22f-42f0-925a-6a06bfc599d8 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:46.764915 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-708e84e7-30e2-4605-8788-d6849bcb5811 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/9737899d-a22f-42f0-925a-6a06bfc599d8/action" status: 404 len: 111 microversion: 2.1 time: 0.519205 Aug 22 17:13:46.765683 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 296/630] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:13:46 2022] POST /compute/v2.1/servers/9737899d-a22f-42f0-925a-6a06bfc599d8/action => generated 111 bytes in 522 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:13:46.798602 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-71757a97-aa5c-409a-88a6-9b63ade6b8b8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:46.800426 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-71757a97-aa5c-409a-88a6-9b63ade6b8b8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:46.837715 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-71757a97-aa5c-409a-88a6-9b63ade6b8b8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:46.838254 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-71757a97-aa5c-409a-88a6-9b63ade6b8b8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:46.838708 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-71757a97-aa5c-409a-88a6-9b63ade6b8b8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:46.841644 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-71757a97-aa5c-409a-88a6-9b63ade6b8b8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:46.848960 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-71757a97-aa5c-409a-88a6-9b63ade6b8b8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:46.851809 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-71757a97-aa5c-409a-88a6-9b63ade6b8b8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:47.079402 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-71757a97-aa5c-409a-88a6-9b63ade6b8b8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:47.111786 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-71757a97-aa5c-409a-88a6-9b63ade6b8b8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1927 microversion: 2.75 time: 0.344726 Aug 22 17:13:47.112921 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 297/631] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:46 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1927 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:47.118192 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2ae0de33-3b48-4e25-892a-7214bbfb36aa tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-240430281", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:47.268445 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-2ae0de33-3b48-4e25-892a-7214bbfb36aa tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] validate_networks() for None {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:13:47.699965 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-588d4a8b-9329-4fb2-a571-1bcb86bc0a87 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:47.709480 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-588d4a8b-9329-4fb2-a571-1bcb86bc0a87 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1311 microversion: 2.1 time: 2.217878 Aug 22 17:13:47.744937 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 335/632] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:45 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1311 bytes in 2254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:48.032057 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-2ae0de33-3b48-4e25-892a-7214bbfb36aa tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:13:48.032845 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-2ae0de33-3b48-4e25-892a-7214bbfb36aa tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:13:48.033578 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-2ae0de33-3b48-4e25-892a-7214bbfb36aa tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:13:48.034197 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-2ae0de33-3b48-4e25-892a-7214bbfb36aa tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:13:48.034830 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-2ae0de33-3b48-4e25-892a-7214bbfb36aa tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:13:48.056139 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2ae0de33-3b48-4e25-892a-7214bbfb36aa tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:48.056894 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2ae0de33-3b48-4e25-892a-7214bbfb36aa tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:48.057681 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2ae0de33-3b48-4e25-892a-7214bbfb36aa tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:48.058957 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2ae0de33-3b48-4e25-892a-7214bbfb36aa tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:48.061401 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2ae0de33-3b48-4e25-892a-7214bbfb36aa tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:48.063291 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2ae0de33-3b48-4e25-892a-7214bbfb36aa tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:48.106869 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-2ae0de33-3b48-4e25-892a-7214bbfb36aa tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Getting quotas for project ffdd27bb05144d16aac5c3e39bc05a65. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:13:48.119697 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-2ae0de33-3b48-4e25-892a-7214bbfb36aa tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Getting quotas for user 9fd8e9807c9b44e1b83ac7bacbaf8599 and project ffdd27bb05144d16aac5c3e39bc05a65. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:13:48.147277 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-64d6de7e-e499-4413-a827-65b5ea9451ee tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:48.147943 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-64d6de7e-e499-4413-a827-65b5ea9451ee tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:48.159438 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-64d6de7e-e499-4413-a827-65b5ea9451ee tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:48.159935 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-64d6de7e-e499-4413-a827-65b5ea9451ee tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:48.164602 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-2ae0de33-3b48-4e25-892a-7214bbfb36aa tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Going to run 1 instances... {{(pid=123016) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:13:48.166237 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-64d6de7e-e499-4413-a827-65b5ea9451ee tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:48.167110 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-2ae0de33-3b48-4e25-892a-7214bbfb36aa tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:13:48.167866 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-64d6de7e-e499-4413-a827-65b5ea9451ee tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:48.174996 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-64d6de7e-e499-4413-a827-65b5ea9451ee tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:48.174996 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-64d6de7e-e499-4413-a827-65b5ea9451ee tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:48.345967 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2ae0de33-3b48-4e25-892a-7214bbfb36aa tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.231701 Aug 22 17:13:48.347221 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 298/633] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:13:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:13:48.363932 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b058be69-9620-4afb-bf93-0e74b69288d1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:48.369956 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b058be69-9620-4afb-bf93-0e74b69288d1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:48.469035 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-64d6de7e-e499-4413-a827-65b5ea9451ee tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:48.488916 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-64d6de7e-e499-4413-a827-65b5ea9451ee tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1927 microversion: 2.75 time: 0.345373 Aug 22 17:13:48.490213 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 336/634] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:48 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1927 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:13:48.546058 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b058be69-9620-4afb-bf93-0e74b69288d1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:48.558902 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b058be69-9620-4afb-bf93-0e74b69288d1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 200 len: 1221 microversion: 2.1 time: 0.194330 Aug 22 17:13:48.559820 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 299/635] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:48 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 1221 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:48.731687 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ae261765-26ce-4941-8a96-9be1c3180fc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:48.733450 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ae261765-26ce-4941-8a96-9be1c3180fc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:48.737573 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:48.745826 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ae261765-26ce-4941-8a96-9be1c3180fc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:48.749571 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ae261765-26ce-4941-8a96-9be1c3180fc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:48.750337 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ae261765-26ce-4941-8a96-9be1c3180fc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:48.751935 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ae261765-26ce-4941-8a96-9be1c3180fc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:48.752616 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ae261765-26ce-4941-8a96-9be1c3180fc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:48.753435 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ae261765-26ce-4941-8a96-9be1c3180fc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:49.716374 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b3d2940d-bbc6-492b-8239-d095fb5b27f5 tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] Action: 'create', calling method: .version_select at 0x7f8009b48550>, body: {"pool": null} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:49.798605 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ae261765-26ce-4941-8a96-9be1c3180fc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:49.807654 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ae261765-26ce-4941-8a96-9be1c3180fc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1311 microversion: 2.1 time: 1.080489 Aug 22 17:13:49.816777 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 337/636] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:48 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1311 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:49.826231 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b12c3dd7-8c01-426c-8878-5ee622ef61e2 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:49.829999 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b12c3dd7-8c01-426c-8878-5ee622ef61e2 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:49.843409 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b12c3dd7-8c01-426c-8878-5ee622ef61e2 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:49.844180 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b12c3dd7-8c01-426c-8878-5ee622ef61e2 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:49.844822 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b12c3dd7-8c01-426c-8878-5ee622ef61e2 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:49.845812 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b12c3dd7-8c01-426c-8878-5ee622ef61e2 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:49.846560 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b12c3dd7-8c01-426c-8878-5ee622ef61e2 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:49.849860 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b12c3dd7-8c01-426c-8878-5ee622ef61e2 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:50.052891 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-b12c3dd7-8c01-426c-8878-5ee622ef61e2 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:50.107019 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b12c3dd7-8c01-426c-8878-5ee622ef61e2 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1933 microversion: 2.75 time: 0.289979 Aug 22 17:13:50.108749 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 338/637] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:49 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1933 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:50.120994 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d5e60b64-e835-49ff-a341-01a56799e1fd tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:50.123181 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d5e60b64-e835-49ff-a341-01a56799e1fd tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:50.127440 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:50.142521 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d5e60b64-e835-49ff-a341-01a56799e1fd tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:50.146311 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d5e60b64-e835-49ff-a341-01a56799e1fd tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:50.146919 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d5e60b64-e835-49ff-a341-01a56799e1fd tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:50.147809 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d5e60b64-e835-49ff-a341-01a56799e1fd tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:50.152658 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d5e60b64-e835-49ff-a341-01a56799e1fd tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:50.153321 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d5e60b64-e835-49ff-a341-01a56799e1fd tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:50.267817 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d5e60b64-e835-49ff-a341-01a56799e1fd tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:50.279619 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d5e60b64-e835-49ff-a341-01a56799e1fd tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 200 len: 1225 microversion: 2.1 time: 0.169369 Aug 22 17:13:50.280882 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 339/638] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:50 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 1225 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:50.369341 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-fc49282e-07ed-498f-9d93-d3f5f8b83cc7 req-43b45297-6bd5-4585-b97b-728a64166230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd420da2-ec4b-4d15-82d1-0f09c4072a7f", "tag": "369ba085-ae5d-43b8-9cdb-93f3e47cedd5"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:50.380889 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-fc49282e-07ed-498f-9d93-d3f5f8b83cc7 req-43b45297-6bd5-4585-b97b-728a64166230 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:50.381400 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-fc49282e-07ed-498f-9d93-d3f5f8b83cc7 req-43b45297-6bd5-4585-b97b-728a64166230 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:50.381836 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-fc49282e-07ed-498f-9d93-d3f5f8b83cc7 req-43b45297-6bd5-4585-b97b-728a64166230 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:50.411534 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-fc49282e-07ed-498f-9d93-d3f5f8b83cc7 req-43b45297-6bd5-4585-b97b-728a64166230 service nova] Creating event network-changed:369ba085-ae5d-43b8-9cdb-93f3e47cedd5 for instance fd420da2-ec4b-4d15-82d1-0f09c4072a7f on n-h2-854030-1 Aug 22 17:13:50.430564 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-fc49282e-07ed-498f-9d93-d3f5f8b83cc7 req-43b45297-6bd5-4585-b97b-728a64166230 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071371 Aug 22 17:13:50.435030 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 340/639] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:50.828055 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=3 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:50.832402 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-bd3b4e25-9060-4bdb-ac1e-2391d4bf26fa tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:50.833214 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-bd3b4e25-9060-4bdb-ac1e-2391d4bf26fa tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:50.847344 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bd3b4e25-9060-4bdb-ac1e-2391d4bf26fa tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:50.847840 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bd3b4e25-9060-4bdb-ac1e-2391d4bf26fa tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:50.848277 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bd3b4e25-9060-4bdb-ac1e-2391d4bf26fa tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:50.848992 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bd3b4e25-9060-4bdb-ac1e-2391d4bf26fa tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:50.849489 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bd3b4e25-9060-4bdb-ac1e-2391d4bf26fa tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:50.849912 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bd3b4e25-9060-4bdb-ac1e-2391d4bf26fa tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:51.312730 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-bd3b4e25-9060-4bdb-ac1e-2391d4bf26fa tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:51.326401 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-bd3b4e25-9060-4bdb-ac1e-2391d4bf26fa tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1311 microversion: 2.1 time: 0.498686 Aug 22 17:13:51.328457 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 341/640] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:50 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1311 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:13:51.334568 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f8e5127d-d40b-4b2b-ace4-4420a10223a4 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:51.335316 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f8e5127d-d40b-4b2b-ace4-4420a10223a4 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:51.350273 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f8e5127d-d40b-4b2b-ace4-4420a10223a4 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:51.351116 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f8e5127d-d40b-4b2b-ace4-4420a10223a4 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:51.351775 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f8e5127d-d40b-4b2b-ace4-4420a10223a4 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:51.352989 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f8e5127d-d40b-4b2b-ace4-4420a10223a4 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:51.353519 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f8e5127d-d40b-4b2b-ace4-4420a10223a4 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:51.358592 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f8e5127d-d40b-4b2b-ace4-4420a10223a4 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:51.504567 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-f8e5127d-d40b-4b2b-ace4-4420a10223a4 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:51.537930 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f8e5127d-d40b-4b2b-ace4-4420a10223a4 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1933 microversion: 2.75 time: 0.206872 Aug 22 17:13:51.547454 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 342/641] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:51 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1933 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:51.564632 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3788316d-5a56-488c-9f79-af9df1d893e6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:51.566098 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-3788316d-5a56-488c-9f79-af9df1d893e6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:51.573027 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3788316d-5a56-488c-9f79-af9df1d893e6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:51.577658 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3788316d-5a56-488c-9f79-af9df1d893e6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:51.578382 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3788316d-5a56-488c-9f79-af9df1d893e6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:51.579375 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3788316d-5a56-488c-9f79-af9df1d893e6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:51.584425 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3788316d-5a56-488c-9f79-af9df1d893e6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:51.585280 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3788316d-5a56-488c-9f79-af9df1d893e6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:51.735938 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-3788316d-5a56-488c-9f79-af9df1d893e6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:51.754737 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3788316d-5a56-488c-9f79-af9df1d893e6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 200 len: 1273 microversion: 2.1 time: 0.205695 Aug 22 17:13:51.784621 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 343/642] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:51 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 1273 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:52.352284 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4b9a36d6-289f-4366-9678-3495e3995f92 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:52.352912 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-4b9a36d6-289f-4366-9678-3495e3995f92 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:52.363051 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b9a36d6-289f-4366-9678-3495e3995f92 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:52.363551 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b9a36d6-289f-4366-9678-3495e3995f92 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:52.363995 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b9a36d6-289f-4366-9678-3495e3995f92 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:52.364700 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b9a36d6-289f-4366-9678-3495e3995f92 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:52.365203 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b9a36d6-289f-4366-9678-3495e3995f92 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:52.369673 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b9a36d6-289f-4366-9678-3495e3995f92 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:52.706297 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-4b9a36d6-289f-4366-9678-3495e3995f92 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:52.710090 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=100 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:52.715517 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-4b9a36d6-289f-4366-9678-3495e3995f92 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1311 microversion: 2.1 time: 0.367250 Aug 22 17:13:52.717881 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 344/643] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:52 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1311 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:13:52.959568 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d1e973e3-d3e5-47b4-90be-3ef1667d019e tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Calling method '.version_select at 0x7f8009d2baf0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:53.037247 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d1e973e3-d3e5-47b4-90be-3ef1667d019e tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d" status: 200 len: 371 microversion: 2.1 time: 0.317855 Aug 22 17:13:53.038394 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 345/644] 10.222.0.96 () {58 vars in 1242 bytes} [Mon Aug 22 17:13:52 2022] GET /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d => generated 371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:53.049521 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1a71380b-90c5-430d-880b-475725e692e8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:53.050417 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-1a71380b-90c5-430d-880b-475725e692e8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:53.058874 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1a71380b-90c5-430d-880b-475725e692e8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:53.059769 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1a71380b-90c5-430d-880b-475725e692e8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:53.060552 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1a71380b-90c5-430d-880b-475725e692e8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:53.062711 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1a71380b-90c5-430d-880b-475725e692e8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:53.063368 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1a71380b-90c5-430d-880b-475725e692e8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:53.063985 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1a71380b-90c5-430d-880b-475725e692e8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:53.188454 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-1a71380b-90c5-430d-880b-475725e692e8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] Lazy-loading 'services' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:53.224633 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1a71380b-90c5-430d-880b-475725e692e8 tempest-ServersAdmin275Test-304901026 tempest-ServersAdmin275Test-304901026-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1918 microversion: 2.75 time: 0.184998 Aug 22 17:13:53.225618 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 346/645] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:53 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1918 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:53.230718 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-78d00ec7-6244-411d-80b0-534df9a10068 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:53.231540 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-78d00ec7-6244-411d-80b0-534df9a10068 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:53.240385 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78d00ec7-6244-411d-80b0-534df9a10068 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:53.241589 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78d00ec7-6244-411d-80b0-534df9a10068 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:53.242206 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78d00ec7-6244-411d-80b0-534df9a10068 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:53.243082 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78d00ec7-6244-411d-80b0-534df9a10068 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:53.243720 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78d00ec7-6244-411d-80b0-534df9a10068 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:53.244565 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78d00ec7-6244-411d-80b0-534df9a10068 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:53.345800 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-78d00ec7-6244-411d-80b0-534df9a10068 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:53.355938 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-78d00ec7-6244-411d-80b0-534df9a10068 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 200 len: 1279 microversion: 2.1 time: 0.128725 Aug 22 17:13:53.370533 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 347/646] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:53 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 1279 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:53.370533 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-41a64ec6-6854-46fe-955d-e08931de4fd3 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Action: 'update', calling method: .version_select at 0x7f8009d1df70>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:53.469225 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-41a64ec6-6854-46fe-955d-e08931de4fd3 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:53.469225 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-41a64ec6-6854-46fe-955d-e08931de4fd3 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:53.469225 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-41a64ec6-6854-46fe-955d-e08931de4fd3 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:53.469225 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-41a64ec6-6854-46fe-955d-e08931de4fd3 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:53.469777 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-41a64ec6-6854-46fe-955d-e08931de4fd3 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:53.469777 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-41a64ec6-6854-46fe-955d-e08931de4fd3 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:53.622470 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-41a64ec6-6854-46fe-955d-e08931de4fd3 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d" status: 200 len: 328 microversion: 2.1 time: 0.263576 Aug 22 17:13:53.625436 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 348/647] 10.222.0.96 () {60 vars in 1262 bytes} [Mon Aug 22 17:13:53 2022] PUT /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d => generated 328 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:53.642165 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3f93c88b-6d3a-4ab2-bb24-55b0fcf26e75 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:53.642922 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-3f93c88b-6d3a-4ab2-bb24-55b0fcf26e75 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:53.653956 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3f93c88b-6d3a-4ab2-bb24-55b0fcf26e75 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:53.659367 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3f93c88b-6d3a-4ab2-bb24-55b0fcf26e75 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:53.659367 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3f93c88b-6d3a-4ab2-bb24-55b0fcf26e75 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:53.659367 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3f93c88b-6d3a-4ab2-bb24-55b0fcf26e75 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:53.659367 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3f93c88b-6d3a-4ab2-bb24-55b0fcf26e75 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:53.659711 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3f93c88b-6d3a-4ab2-bb24-55b0fcf26e75 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:53.692592 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-3f93c88b-6d3a-4ab2-bb24-55b0fcf26e75 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Going to try to terminate instance {{(pid=123015) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:13:54.168967 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3f93c88b-6d3a-4ab2-bb24-55b0fcf26e75 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "DELETE /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 204 len: 0 microversion: 2.75 time: 0.541745 Aug 22 17:13:54.170773 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 349/648] 10.222.0.96 () {60 vars in 1280 bytes} [Mon Aug 22 17:13:53 2022] DELETE /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 17:13:54.178373 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-327dc67c-038d-4510-820c-ef92e22a77e5 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:54.179986 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-327dc67c-038d-4510-820c-ef92e22a77e5 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:54.190689 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-327dc67c-038d-4510-820c-ef92e22a77e5 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:54.191932 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-327dc67c-038d-4510-820c-ef92e22a77e5 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:54.192607 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-327dc67c-038d-4510-820c-ef92e22a77e5 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:54.199844 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-327dc67c-038d-4510-820c-ef92e22a77e5 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:54.200423 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-327dc67c-038d-4510-820c-ef92e22a77e5 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:54.201221 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-327dc67c-038d-4510-820c-ef92e22a77e5 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:54.717828 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-327dc67c-038d-4510-820c-ef92e22a77e5 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:54.726677 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-327dc67c-038d-4510-820c-ef92e22a77e5 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1311 microversion: 2.1 time: 0.554255 Aug 22 17:13:54.727615 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 350/649] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:54 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1311 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:54.828128 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1466918057", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:54.925437 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] validate_networks() for None {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:13:55.446175 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:13:55.446598 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:13:55.447077 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:13:55.447488 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:13:55.448151 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:13:55.458634 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:55.459544 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:55.460173 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:55.461106 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:55.461724 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:55.462557 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:55.487072 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Getting quotas for project 0810ab9220ab4a80b3a9ad6acdc15d5d. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:13:55.493502 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Getting quotas for user a30e01bd016644b4a9e68f42e7fcc8fb and project 0810ab9220ab4a80b3a9ad6acdc15d5d. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:13:55.507569 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.utils [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] cores quota exceeded for 0810ab9220ab4a80b3a9ad6acdc15d5d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123015) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 22 17:13:55.508448 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Request method failure captured: Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 145 Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7lOKmmO0XipoC5Gt-YaUxLW-IvUjeL29i9eWTV29jWsg5eRPDUzQNEAFvZ0gIyP4Qrad5Uz1fmswTzcHjrn7aqP9TXubcnqGNf_KKTcoEl32IlDQEcxmih92veVus3u18GGinCBJFRJgC0UQ4JMho51J3CT_4NzFeGgAT4NxMZgB60 Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 0810ab9220ab4a80b3a9ad6acdc15d5d Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-QuotasAdminNegativeTest-601123037 Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:13:55.512136 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:13:55.514380 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/0810ab9220ab4a80b3a9ad6acdc15d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_0810ab9220ab4a80b3a9ad6acdc15d5d", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/0810ab9220ab4a80b3a9ad6acdc15d5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/0810ab9220ab4a80b3a9ad6acdc15d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:55.514380 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-QuotasAdminNegativeTest-601123037 Aug 22 17:13:55.514380 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 0810ab9220ab4a80b3a9ad6acdc15d5d Aug 22 17:13:55.514380 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-601123037 Aug 22 17:13:55.514380 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-QuotasAdminNegativeTest-601123037-project Aug 22 17:13:55.514380 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:13:55.514380 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:13:55.514380 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: a30e01bd016644b4a9e68f42e7fcc8fb Aug 22 17:13:55.514380 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-QuotasAdminNegativeTest-601123037-project Aug 22 17:13:55.514380 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:13:55.514380 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1466918057", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} Aug 22 17:13:55.514380 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:13:55.515762 n-d-854030-1 devstack@n-api.service[123015]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 22 17:13:55.515762 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1466918057', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452'}}} Aug 22 17:13:55.515762 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:55.515762 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:55.515762 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 22 17:13:55.515762 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 22 17:13:55.515762 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:13:55.515762 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:13:55.515762 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 22 17:13:55.515762 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc Aug 22 17:13:55.515762 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 22 17:13:55.515762 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 22 17:13:55.515762 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:13:55.515762 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:13:55.515762 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 22 17:13:55.515762 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 22 17:13:55.515762 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 22 17:13:55.515762 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:55.517011 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:55.518560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:55.520088 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:55.520088 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:55.520088 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:13:55.520088 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:13:55.520088 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 22 17:13:55.520088 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:13:55.520088 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:55.520088 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d3e6728e-fab8-4909-8945-a376139fafff tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.785021 Aug 22 17:13:55.520088 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 351/650] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:13:54 2022] POST /compute/v2.1/servers => generated 111 bytes in 787 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:55.523678 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-09f6d7a7-99f0-49b5-8f7c-bbb5d29ff3d0 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:55.524429 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-09f6d7a7-99f0-49b5-8f7c-bbb5d29ff3d0 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:55.533346 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-09f6d7a7-99f0-49b5-8f7c-bbb5d29ff3d0 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:55.533981 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-09f6d7a7-99f0-49b5-8f7c-bbb5d29ff3d0 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:55.534615 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-09f6d7a7-99f0-49b5-8f7c-bbb5d29ff3d0 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:55.535431 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-09f6d7a7-99f0-49b5-8f7c-bbb5d29ff3d0 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:55.535995 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-09f6d7a7-99f0-49b5-8f7c-bbb5d29ff3d0 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:55.536526 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-09f6d7a7-99f0-49b5-8f7c-bbb5d29ff3d0 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:55.606376 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-09f6d7a7-99f0-49b5-8f7c-bbb5d29ff3d0 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:55.616068 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-09f6d7a7-99f0-49b5-8f7c-bbb5d29ff3d0 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:55.620648 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-09f6d7a7-99f0-49b5-8f7c-bbb5d29ff3d0 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:55.628168 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-09f6d7a7-99f0-49b5-8f7c-bbb5d29ff3d0 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1443 microversion: 2.75 time: 0.112141 Aug 22 17:13:55.629855 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 352/651] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:55 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1443 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:55.647210 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0d03dcc8-2bdf-45cd-816b-40dba259f9d1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:55.647997 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0d03dcc8-2bdf-45cd-816b-40dba259f9d1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:55.657421 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0d03dcc8-2bdf-45cd-816b-40dba259f9d1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:55.658295 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0d03dcc8-2bdf-45cd-816b-40dba259f9d1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:55.658994 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0d03dcc8-2bdf-45cd-816b-40dba259f9d1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:55.660129 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0d03dcc8-2bdf-45cd-816b-40dba259f9d1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:55.660827 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0d03dcc8-2bdf-45cd-816b-40dba259f9d1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:55.661931 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0d03dcc8-2bdf-45cd-816b-40dba259f9d1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:56.231054 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0d03dcc8-2bdf-45cd-816b-40dba259f9d1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:56.279347 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0d03dcc8-2bdf-45cd-816b-40dba259f9d1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 200 len: 1321 microversion: 2.1 time: 0.645688 Aug 22 17:13:56.285743 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 353/652] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:55 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 1321 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:56.300084 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-61aaaaf8-ad97-4f28-8fd8-71e1b2efcba7 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Action: 'update', calling method: .version_select at 0x7f8009b318b0>, body: {"quota_set": {"cores": 20}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:56.408590 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-61aaaaf8-ad97-4f28-8fd8-71e1b2efcba7 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:56.409496 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-61aaaaf8-ad97-4f28-8fd8-71e1b2efcba7 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:56.410117 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-61aaaaf8-ad97-4f28-8fd8-71e1b2efcba7 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:56.411295 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-61aaaaf8-ad97-4f28-8fd8-71e1b2efcba7 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:56.411937 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-61aaaaf8-ad97-4f28-8fd8-71e1b2efcba7 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:56.412521 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-61aaaaf8-ad97-4f28-8fd8-71e1b2efcba7 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:56.528122 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b3d2940d-bbc6-492b-8239-d095fb5b27f5 tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] 10.222.0.96 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.243862 Aug 22 17:13:56.529271 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 300/653] 10.222.0.96 () {60 vars in 1170 bytes} [Mon Aug 22 17:13:49 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:13:56.535514 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-733f9a36-dbdb-4066-acaf-b720c020ab14 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:56.536395 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-733f9a36-dbdb-4066-acaf-b720c020ab14 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:56.553498 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-733f9a36-dbdb-4066-acaf-b720c020ab14 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:56.555596 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-733f9a36-dbdb-4066-acaf-b720c020ab14 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:56.558884 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-733f9a36-dbdb-4066-acaf-b720c020ab14 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:56.566129 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-733f9a36-dbdb-4066-acaf-b720c020ab14 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:56.570813 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-733f9a36-dbdb-4066-acaf-b720c020ab14 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:56.571876 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-733f9a36-dbdb-4066-acaf-b720c020ab14 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:56.665401 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-61aaaaf8-ad97-4f28-8fd8-71e1b2efcba7 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d" status: 200 len: 329 microversion: 2.1 time: 0.375426 Aug 22 17:13:56.666061 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 354/654] 10.222.0.96 () {60 vars in 1262 bytes} [Mon Aug 22 17:13:56 2022] PUT /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d => generated 329 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:56.691124 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b2ff07ec-9528-4904-a718-0b235b8496cf tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] Action: 'create', calling method: .version_select at 0x7f8009a86430>, body: {"pool": null} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:56.872022 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-733f9a36-dbdb-4066-acaf-b720c020ab14 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:56.900804 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-733f9a36-dbdb-4066-acaf-b720c020ab14 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1311 microversion: 2.1 time: 0.368636 Aug 22 17:13:56.901375 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 301/655] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:56 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1311 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:56.916652 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-867a4d3d-3481-4547-a888-1627dc8127fc tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:56.919248 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-867a4d3d-3481-4547-a888-1627dc8127fc tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:56.934734 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-867a4d3d-3481-4547-a888-1627dc8127fc tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:56.936006 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-867a4d3d-3481-4547-a888-1627dc8127fc tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:56.936463 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-867a4d3d-3481-4547-a888-1627dc8127fc tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:56.938573 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-867a4d3d-3481-4547-a888-1627dc8127fc tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:56.939082 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-867a4d3d-3481-4547-a888-1627dc8127fc tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:56.939700 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-867a4d3d-3481-4547-a888-1627dc8127fc tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:56.983104 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-867a4d3d-3481-4547-a888-1627dc8127fc tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:56.983730 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-867a4d3d-3481-4547-a888-1627dc8127fc tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:56.984275 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-867a4d3d-3481-4547-a888-1627dc8127fc tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:56.984829 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-867a4d3d-3481-4547-a888-1627dc8127fc tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lazy-loading 'fault' on Instance uuid ea25a012-3b8a-4892-b6f1-13132f792c18 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:13:57.034076 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-867a4d3d-3481-4547-a888-1627dc8127fc tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:57.043437 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-867a4d3d-3481-4547-a888-1627dc8127fc tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:57.048932 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-867a4d3d-3481-4547-a888-1627dc8127fc tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b0c24dd25ba4c02b473ca1054dc09ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801c0f4556624bd3aade30d393ea55a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:57.062494 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-867a4d3d-3481-4547-a888-1627dc8127fc tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 200 len: 1448 microversion: 2.75 time: 0.151633 Aug 22 17:13:57.062494 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 302/656] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:56 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 1448 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:13:57.089557 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ee6a30cf-75fa-4e5f-a07a-92bfdf4ef564 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Calling method '.version_select at 0x7f8009cbaca0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:57.244842 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ee6a30cf-75fa-4e5f-a07a-92bfdf4ef564 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d" status: 200 len: 371 microversion: 2.1 time: 0.186440 Aug 22 17:13:57.246043 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 303/657] 10.222.0.96 () {58 vars in 1242 bytes} [Mon Aug 22 17:13:57 2022] GET /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d => generated 371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:57.258452 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-a6da305c-9649-4549-b823-cc6781eeaa63 req-efc78e13-03f7-4cfc-b362-4bfcc768aa10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2320d5b-5a26-4a82-810e-8f00c00486f5", "tag": "ccdc9250-f83e-4d21-ac2f-ed4e207f94f7"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:57.273519 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:13:57.275930 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-a6da305c-9649-4549-b823-cc6781eeaa63 req-efc78e13-03f7-4cfc-b362-4bfcc768aa10 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:57.278053 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-a6da305c-9649-4549-b823-cc6781eeaa63 req-efc78e13-03f7-4cfc-b362-4bfcc768aa10 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:57.280234 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-a6da305c-9649-4549-b823-cc6781eeaa63 req-efc78e13-03f7-4cfc-b362-4bfcc768aa10 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:57.295686 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-a6da305c-9649-4549-b823-cc6781eeaa63 req-efc78e13-03f7-4cfc-b362-4bfcc768aa10 service nova] Creating event network-changed:ccdc9250-f83e-4d21-ac2f-ed4e207f94f7 for instance a2320d5b-5a26-4a82-810e-8f00c00486f5 on n-h1-854030-1 Aug 22 17:13:57.319506 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-a6da305c-9649-4549-b823-cc6781eeaa63 req-efc78e13-03f7-4cfc-b362-4bfcc768aa10 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072015 Aug 22 17:13:57.320721 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 304/658] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:57.330348 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-701eae7c-21c4-4a5b-a49c-bb76a20da1d8 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Action: 'update', calling method: .version_select at 0x7f8009b488b0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:57.505501 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-701eae7c-21c4-4a5b-a49c-bb76a20da1d8 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:57.506332 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-701eae7c-21c4-4a5b-a49c-bb76a20da1d8 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:57.508150 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-701eae7c-21c4-4a5b-a49c-bb76a20da1d8 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:57.517508 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-701eae7c-21c4-4a5b-a49c-bb76a20da1d8 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:57.518564 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-701eae7c-21c4-4a5b-a49c-bb76a20da1d8 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:57.520117 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-701eae7c-21c4-4a5b-a49c-bb76a20da1d8 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:57.762372 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-701eae7c-21c4-4a5b-a49c-bb76a20da1d8 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d" status: 200 len: 328 microversion: 2.1 time: 0.439917 Aug 22 17:13:57.769787 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 305/659] 10.222.0.96 () {60 vars in 1262 bytes} [Mon Aug 22 17:13:57 2022] PUT /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d => generated 328 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:57.788636 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-47cdb64c-dc99-4eca-94d7-b482d89a5c49 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:57.791158 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-47cdb64c-dc99-4eca-94d7-b482d89a5c49 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:57.809521 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-47cdb64c-dc99-4eca-94d7-b482d89a5c49 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:57.810086 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-47cdb64c-dc99-4eca-94d7-b482d89a5c49 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:57.811191 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-47cdb64c-dc99-4eca-94d7-b482d89a5c49 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:57.824891 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-47cdb64c-dc99-4eca-94d7-b482d89a5c49 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:57.829031 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-47cdb64c-dc99-4eca-94d7-b482d89a5c49 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:57.829836 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-47cdb64c-dc99-4eca-94d7-b482d89a5c49 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:58.107228 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-47cdb64c-dc99-4eca-94d7-b482d89a5c49 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:58.123935 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-47cdb64c-dc99-4eca-94d7-b482d89a5c49 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 200 len: 1321 microversion: 2.1 time: 0.347903 Aug 22 17:13:58.125013 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 306/660] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:57 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 1321 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:58.130824 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-607866193", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:58.215586 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] validate_networks() for None {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:13:58.498592 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:13:58.498694 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:13:58.499120 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:13:58.499612 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:13:58.500211 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:13:58.512418 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:58.513733 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:58.514370 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:58.515418 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:58.516006 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:58.516620 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:58.538617 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Getting quotas for project 0810ab9220ab4a80b3a9ad6acdc15d5d. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:13:58.545187 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Getting quotas for user a30e01bd016644b4a9e68f42e7fcc8fb and project 0810ab9220ab4a80b3a9ad6acdc15d5d. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:13:58.561156 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.utils [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] instances quota exceeded for 0810ab9220ab4a80b3a9ad6acdc15d5d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123016) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 22 17:13:58.563187 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Request method failure captured: Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 144 Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7lOKmmO0XipoC5Gt-YaUxLW-IvUjeL29i9eWTV29jWsg5eRPDUzQNEAFvZ0gIyP4Qrad5Uz1fmswTzcHjrn7aqP9TXubcnqGNf_KKTcoEl32IlDQEcxmih92veVus3u18GGinCBJFRJgC0UQ4JMho51J3CT_4NzFeGgAT4NxMZgB60 Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 0810ab9220ab4a80b3a9ad6acdc15d5d Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-QuotasAdminNegativeTest-601123037 Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:13:58.567155 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:13:58.568518 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/0810ab9220ab4a80b3a9ad6acdc15d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_0810ab9220ab4a80b3a9ad6acdc15d5d", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/0810ab9220ab4a80b3a9ad6acdc15d5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/0810ab9220ab4a80b3a9ad6acdc15d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:58.568518 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-QuotasAdminNegativeTest-601123037 Aug 22 17:13:58.568518 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 0810ab9220ab4a80b3a9ad6acdc15d5d Aug 22 17:13:58.568518 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-601123037 Aug 22 17:13:58.568518 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-QuotasAdminNegativeTest-601123037-project Aug 22 17:13:58.568518 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:13:58.568518 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:13:58.568518 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: a30e01bd016644b4a9e68f42e7fcc8fb Aug 22 17:13:58.568518 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-QuotasAdminNegativeTest-601123037-project Aug 22 17:13:58.568518 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:13:58.568518 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-607866193", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} Aug 22 17:13:58.568518 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:13:58.579864 n-d-854030-1 devstack@n-api.service[123016]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 22 17:13:58.579864 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-607866193', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452'}}} Aug 22 17:13:58.579864 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:58.579864 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:58.579864 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 22 17:13:58.579864 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 22 17:13:58.579864 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:13:58.579864 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:13:58.579864 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 22 17:13:58.579864 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc Aug 22 17:13:58.579864 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 22 17:13:58.579864 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 22 17:13:58.579864 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:13:58.579864 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:13:58.579864 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 22 17:13:58.579864 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 22 17:13:58.579864 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 22 17:13:58.579864 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:58.581240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:58.582678 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:58.584355 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:58.584355 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:58.584355 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:13:58.584355 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:13:58.584355 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 22 17:13:58.584355 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:58.584355 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:58.584355 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4d560282-9a3c-4374-8f85-2c86bfff88b8 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.444720 Aug 22 17:13:58.584355 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 307/661] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:13:58 2022] POST /compute/v2.1/servers => generated 119 bytes in 446 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:13:58.586198 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-40737f34-b10e-42a0-b682-b3cd62426cc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:58.587419 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-40737f34-b10e-42a0-b682-b3cd62426cc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:58.594414 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-40737f34-b10e-42a0-b682-b3cd62426cc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:58.595113 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-40737f34-b10e-42a0-b682-b3cd62426cc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:58.595520 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-40737f34-b10e-42a0-b682-b3cd62426cc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:58.596620 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-40737f34-b10e-42a0-b682-b3cd62426cc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:58.597355 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-40737f34-b10e-42a0-b682-b3cd62426cc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:58.597972 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-40737f34-b10e-42a0-b682-b3cd62426cc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:58.756617 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-40737f34-b10e-42a0-b682-b3cd62426cc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:58.765644 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-40737f34-b10e-42a0-b682-b3cd62426cc0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1311 microversion: 2.1 time: 0.192356 Aug 22 17:13:58.767047 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 308/662] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:58 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1311 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:58.773038 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-888be577-1664-438c-b74a-5f29b57abf11 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:58.774426 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-888be577-1664-438c-b74a-5f29b57abf11 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] [instance: ea25a012-3b8a-4892-b6f1-13132f792c18] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:58.781248 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-888be577-1664-438c-b74a-5f29b57abf11 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:58.782056 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-888be577-1664-438c-b74a-5f29b57abf11 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:58.782821 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-888be577-1664-438c-b74a-5f29b57abf11 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:58.783743 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-888be577-1664-438c-b74a-5f29b57abf11 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:58.784419 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-888be577-1664-438c-b74a-5f29b57abf11 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:58.784940 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-888be577-1664-438c-b74a-5f29b57abf11 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:58.801595 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-888be577-1664-438c-b74a-5f29b57abf11 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] HTTP exception thrown: Instance ea25a012-3b8a-4892-b6f1-13132f792c18 could not be found. Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-888be577-1664-438c-b74a-5f29b57abf11 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Request method failure captured: Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 HTTP/1.1 Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7kFYHybMNb3qWxo_Dle-xjI4SfULPz3Z4S4srb9d4jExd2K-nR_6Bhdo_5TYylJcpw8hmfmuGfFQG85PyeKxunj8VStX2sY3ZlHbqY4m4fW_UmoU3rF1l6uph9ib7AdQscmxAR9IX1wsELmpOCAYcVNWsEIkHOwmdKBd-62S4vFvXk Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: X-Openstack-Nova-Api-Version: 2.75 Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 801c0f4556624bd3aade30d393ea55a7 Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServersAdmin275Test-1124996486 Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:13:58.803760 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:13:58.805330 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/801c0f4556624bd3aade30d393ea55a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_801c0f4556624bd3aade30d393ea55a7", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/801c0f4556624bd3aade30d393ea55a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/801c0f4556624bd3aade30d393ea55a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:13:58.805330 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServersAdmin275Test-1124996486 Aug 22 17:13:58.805330 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 801c0f4556624bd3aade30d393ea55a7 Aug 22 17:13:58.805330 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServersAdmin275Test-1124996486 Aug 22 17:13:58.805330 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServersAdmin275Test-1124996486-project Aug 22 17:13:58.805330 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:13:58.805330 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:13:58.805330 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 6b0c24dd25ba4c02b473ca1054dc09ed Aug 22 17:13:58.805330 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServersAdmin275Test-1124996486-project Aug 22 17:13:58.805330 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:13:58.805330 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance ea25a012-3b8a-4892-b6f1-13132f792c18 could not be found. Aug 22 17:13:58.805330 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'ea25a012-3b8a-4892-b6f1-13132f792c18'} Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea25a012-3b8a-4892-b6f1-13132f792c18 could not be found. Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:13:58.806077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:13:58.807233 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:13:58.807233 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:13:58.807233 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:13:58.807233 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:13:58.807233 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:13:58.807233 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:13:58.807233 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:13:58.807233 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea25a012-3b8a-4892-b6f1-13132f792c18 could not be found. Aug 22 17:13:58.807233 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:58.807233 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:13:58.807233 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:58.807233 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:13:58.807233 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:13:58.807233 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:13:58.807233 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:13:58.807233 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:13:58.807233 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea25a012-3b8a-4892-b6f1-13132f792c18 could not be found. Aug 22 17:13:58.807233 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:13:58.808649 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-888be577-1664-438c-b74a-5f29b57abf11 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] Returning 404 to user: Instance ea25a012-3b8a-4892-b6f1-13132f792c18 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:13:58.810486 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-888be577-1664-438c-b74a-5f29b57abf11 tempest-ServersAdmin275Test-1124996486 tempest-ServersAdmin275Test-1124996486-project] 10.222.0.96 "GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18" status: 404 len: 111 microversion: 2.75 time: 0.040820 Aug 22 17:13:58.811500 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 309/663] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:13:58 2022] GET /compute/v2.1/servers/ea25a012-3b8a-4892-b6f1-13132f792c18 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:13:58.825219 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-3da88afe-b0ec-40c5-a371-fce618c21dcb tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Action: 'update', calling method: .version_select at 0x7f8009b48a60>, body: {"quota_set": {"instances": 10}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:13:58.956932 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3da88afe-b0ec-40c5-a371-fce618c21dcb tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:58.957971 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3da88afe-b0ec-40c5-a371-fce618c21dcb tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:58.958948 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3da88afe-b0ec-40c5-a371-fce618c21dcb tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:58.960135 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3da88afe-b0ec-40c5-a371-fce618c21dcb tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:58.963690 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3da88afe-b0ec-40c5-a371-fce618c21dcb tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:58.964884 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3da88afe-b0ec-40c5-a371-fce618c21dcb tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:59.190490 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-3da88afe-b0ec-40c5-a371-fce618c21dcb tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d" status: 200 len: 329 microversion: 2.1 time: 0.371053 Aug 22 17:13:59.190490 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 310/664] 10.222.0.96 () {60 vars in 1262 bytes} [Mon Aug 22 17:13:58 2022] PUT /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d => generated 329 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:59.203660 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fc411eef-1016-43da-93e6-1f447810f4c8 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:59.204217 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-fc411eef-1016-43da-93e6-1f447810f4c8 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:13:59.212292 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fc411eef-1016-43da-93e6-1f447810f4c8 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:59.217454 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fc411eef-1016-43da-93e6-1f447810f4c8 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:59.221097 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fc411eef-1016-43da-93e6-1f447810f4c8 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:59.223099 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fc411eef-1016-43da-93e6-1f447810f4c8 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:13:59.223639 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fc411eef-1016-43da-93e6-1f447810f4c8 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:13:59.224118 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fc411eef-1016-43da-93e6-1f447810f4c8 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:13:59.628192 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-fc411eef-1016-43da-93e6-1f447810f4c8 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:13:59.642360 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-fc411eef-1016-43da-93e6-1f447810f4c8 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 200 len: 1321 microversion: 2.1 time: 0.443219 Aug 22 17:13:59.644388 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 311/665] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:59 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 1321 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:13:59.650956 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9db2611f-c287-450a-b3c9-c334def23892 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Calling method '.version_select at 0x7f8009be8c10>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:59.988510 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9db2611f-c287-450a-b3c9-c334def23892 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d" status: 200 len: 371 microversion: 2.1 time: 0.342803 Aug 22 17:13:59.990121 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 312/666] 10.222.0.96 () {58 vars in 1242 bytes} [Mon Aug 22 17:13:59 2022] GET /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d => generated 371 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:13:59.996058 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9301f0ab-1434-4173-bd7b-2b34122d1c15 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:13:59.998072 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-9301f0ab-1434-4173-bd7b-2b34122d1c15 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:00.016644 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9301f0ab-1434-4173-bd7b-2b34122d1c15 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:00.017469 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9301f0ab-1434-4173-bd7b-2b34122d1c15 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:00.018099 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9301f0ab-1434-4173-bd7b-2b34122d1c15 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:00.019392 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9301f0ab-1434-4173-bd7b-2b34122d1c15 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:00.020064 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9301f0ab-1434-4173-bd7b-2b34122d1c15 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:00.020894 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9301f0ab-1434-4173-bd7b-2b34122d1c15 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:00.346864 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9301f0ab-1434-4173-bd7b-2b34122d1c15 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:00.368798 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9301f0ab-1434-4173-bd7b-2b34122d1c15 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1311 microversion: 2.1 time: 0.377304 Aug 22 17:14:00.373732 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 313/667] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:13:59 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1311 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:00.380352 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-b12eda39-9df8-4987-a1c8-fd5b32ae4af0 req-90e34f9a-0235-4651-9f76-b3188ef83238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd420da2-ec4b-4d15-82d1-0f09c4072a7f", "name": "network-vif-plugged", "status": "completed", "tag": "369ba085-ae5d-43b8-9cdb-93f3e47cedd5"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:00.402351 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-b12eda39-9df8-4987-a1c8-fd5b32ae4af0 req-90e34f9a-0235-4651-9f76-b3188ef83238 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:00.402839 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-b12eda39-9df8-4987-a1c8-fd5b32ae4af0 req-90e34f9a-0235-4651-9f76-b3188ef83238 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:00.403270 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-b12eda39-9df8-4987-a1c8-fd5b32ae4af0 req-90e34f9a-0235-4651-9f76-b3188ef83238 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:00.423941 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-b12eda39-9df8-4987-a1c8-fd5b32ae4af0 req-90e34f9a-0235-4651-9f76-b3188ef83238 service nova] Creating event network-vif-plugged:369ba085-ae5d-43b8-9cdb-93f3e47cedd5 for instance fd420da2-ec4b-4d15-82d1-0f09c4072a7f on n-h2-854030-1 Aug 22 17:14:00.429817 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-b12eda39-9df8-4987-a1c8-fd5b32ae4af0 req-90e34f9a-0235-4651-9f76-b3188ef83238 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054649 Aug 22 17:14:00.430455 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 314/668] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:00.436631 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b341b300-25cd-4d4a-baac-0b8bc8363f98 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Action: 'update', calling method: .version_select at 0x7f8009be8670>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:00.548307 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b341b300-25cd-4d4a-baac-0b8bc8363f98 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:00.548911 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b341b300-25cd-4d4a-baac-0b8bc8363f98 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:00.549400 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b341b300-25cd-4d4a-baac-0b8bc8363f98 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:00.552574 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b341b300-25cd-4d4a-baac-0b8bc8363f98 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:00.554190 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b341b300-25cd-4d4a-baac-0b8bc8363f98 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:00.554827 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b341b300-25cd-4d4a-baac-0b8bc8363f98 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:00.757222 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b341b300-25cd-4d4a-baac-0b8bc8363f98 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d" status: 200 len: 325 microversion: 2.1 time: 0.325264 Aug 22 17:14:00.758931 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 315/669] 10.222.0.96 () {60 vars in 1262 bytes} [Mon Aug 22 17:14:00 2022] PUT /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d => generated 325 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:00.765664 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a27774ae-d3f3-4ae4-8ef7-fcb5cac5baac tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:00.766685 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-a27774ae-d3f3-4ae4-8ef7-fcb5cac5baac tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:00.781406 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a27774ae-d3f3-4ae4-8ef7-fcb5cac5baac tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:00.783001 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a27774ae-d3f3-4ae4-8ef7-fcb5cac5baac tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:00.783465 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a27774ae-d3f3-4ae4-8ef7-fcb5cac5baac tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:00.784607 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a27774ae-d3f3-4ae4-8ef7-fcb5cac5baac tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:00.785292 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a27774ae-d3f3-4ae4-8ef7-fcb5cac5baac tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:00.785645 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a27774ae-d3f3-4ae4-8ef7-fcb5cac5baac tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:01.237433 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a27774ae-d3f3-4ae4-8ef7-fcb5cac5baac tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:01.245956 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a27774ae-d3f3-4ae4-8ef7-fcb5cac5baac tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 200 len: 1321 microversion: 2.1 time: 0.484843 Aug 22 17:14:01.257068 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 316/670] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:00 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 1321 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:01.264613 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-826292292", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:01.369948 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] validate_networks() for None {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:14:02.066742 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:14:02.067537 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:14:02.068251 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:14:02.069541 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:14:02.070299 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:14:02.085453 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:02.100009 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:02.100821 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:02.104106 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:02.108732 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:02.109581 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:02.160465 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Getting quotas for project 0810ab9220ab4a80b3a9ad6acdc15d5d. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:14:02.172098 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Getting quotas for user a30e01bd016644b4a9e68f42e7fcc8fb and project 0810ab9220ab4a80b3a9ad6acdc15d5d. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:14:02.214906 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.utils [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] ram quota exceeded for 0810ab9220ab4a80b3a9ad6acdc15d5d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123016) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 22 17:14:02.215445 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Request method failure captured: Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 144 Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7lOKmmO0XipoC5Gt-YaUxLW-IvUjeL29i9eWTV29jWsg5eRPDUzQNEAFvZ0gIyP4Qrad5Uz1fmswTzcHjrn7aqP9TXubcnqGNf_KKTcoEl32IlDQEcxmih92veVus3u18GGinCBJFRJgC0UQ4JMho51J3CT_4NzFeGgAT4NxMZgB60 Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 0810ab9220ab4a80b3a9ad6acdc15d5d Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-QuotasAdminNegativeTest-601123037 Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:14:02.217710 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:14:02.219319 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/0810ab9220ab4a80b3a9ad6acdc15d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_0810ab9220ab4a80b3a9ad6acdc15d5d", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/0810ab9220ab4a80b3a9ad6acdc15d5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/0810ab9220ab4a80b3a9ad6acdc15d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:14:02.219319 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-QuotasAdminNegativeTest-601123037 Aug 22 17:14:02.219319 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 0810ab9220ab4a80b3a9ad6acdc15d5d Aug 22 17:14:02.219319 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-601123037 Aug 22 17:14:02.219319 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-QuotasAdminNegativeTest-601123037-project Aug 22 17:14:02.219319 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:14:02.219319 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:14:02.219319 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: a30e01bd016644b4a9e68f42e7fcc8fb Aug 22 17:14:02.219319 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-QuotasAdminNegativeTest-601123037-project Aug 22 17:14:02.219319 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:14:02.219319 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-826292292", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} Aug 22 17:14:02.219319 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:14:02.220193 n-d-854030-1 devstack@n-api.service[123016]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 22 17:14:02.220193 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-826292292', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452'}}} Aug 22 17:14:02.220193 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:14:02.220193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:02.220193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 22 17:14:02.220193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 22 17:14:02.220193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:14:02.220193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:14:02.220193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 22 17:14:02.220193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc Aug 22 17:14:02.220193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 22 17:14:02.220193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 22 17:14:02.220193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:14:02.220193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:14:02.220193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 22 17:14:02.220193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 22 17:14:02.220193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 22 17:14:02.220193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:02.221510 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:02.223037 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:02.224589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:02.224589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:02.224589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:14:02.224589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:14:02.224589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 22 17:14:02.224589 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:02.226424 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:14:02.227490 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ea368321-be9a-4907-84c7-f7cdcd300250 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.976997 Aug 22 17:14:02.228297 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 317/671] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:14:01 2022] POST /compute/v2.1/servers => generated 110 bytes in 978 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:14:02.233751 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b5d70d56-f30d-4a06-96bd-d832863ef37a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:02.234594 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b5d70d56-f30d-4a06-96bd-d832863ef37a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:02.241281 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b5d70d56-f30d-4a06-96bd-d832863ef37a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:02.242387 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b5d70d56-f30d-4a06-96bd-d832863ef37a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:02.242991 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b5d70d56-f30d-4a06-96bd-d832863ef37a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:02.243871 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b5d70d56-f30d-4a06-96bd-d832863ef37a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:02.244492 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b5d70d56-f30d-4a06-96bd-d832863ef37a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:02.245118 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b5d70d56-f30d-4a06-96bd-d832863ef37a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:02.502247 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b5d70d56-f30d-4a06-96bd-d832863ef37a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:02.514045 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b2ff07ec-9528-4904-a718-0b235b8496cf tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] 10.222.0.96 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.837134 Aug 22 17:14:02.514664 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 355/672] 10.222.0.96 () {60 vars in 1170 bytes} [Mon Aug 22 17:13:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:02.519376 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a07860f8-daef-48aa-ac2f-e6ac455bdbb8 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Action: 'update', calling method: .version_select at 0x7f8009a9e9d0>, body: {"quota_set": {"ram": 51200}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:02.526392 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b5d70d56-f30d-4a06-96bd-d832863ef37a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1311 microversion: 2.1 time: 0.285504 Aug 22 17:14:02.528147 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 318/673] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:02 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1311 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:02.534005 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c3bbb635-2cfc-4d87-88f2-c3ceafd647d2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:02.534931 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c3bbb635-2cfc-4d87-88f2-c3ceafd647d2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:02.548863 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c3bbb635-2cfc-4d87-88f2-c3ceafd647d2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:02.549929 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c3bbb635-2cfc-4d87-88f2-c3ceafd647d2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:02.549929 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c3bbb635-2cfc-4d87-88f2-c3ceafd647d2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:02.551371 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c3bbb635-2cfc-4d87-88f2-c3ceafd647d2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:02.551920 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c3bbb635-2cfc-4d87-88f2-c3ceafd647d2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:02.560140 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c3bbb635-2cfc-4d87-88f2-c3ceafd647d2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:02.756285 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c3bbb635-2cfc-4d87-88f2-c3ceafd647d2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:02.771502 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c3bbb635-2cfc-4d87-88f2-c3ceafd647d2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 200 len: 1321 microversion: 2.1 time: 0.241945 Aug 22 17:14:02.774623 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 319/674] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:02 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:02.801964 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-145376b1-bd0a-478b-9e32-b467763c2343 tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] Action: 'create', calling method: .version_select at 0x7f8009b11820>, body: {"pool": null} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:02.808899 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a07860f8-daef-48aa-ac2f-e6ac455bdbb8 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:02.810315 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a07860f8-daef-48aa-ac2f-e6ac455bdbb8 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:02.827618 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a07860f8-daef-48aa-ac2f-e6ac455bdbb8 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:02.831922 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a07860f8-daef-48aa-ac2f-e6ac455bdbb8 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:02.833655 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a07860f8-daef-48aa-ac2f-e6ac455bdbb8 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:02.834354 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a07860f8-daef-48aa-ac2f-e6ac455bdbb8 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:03.060084 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a07860f8-daef-48aa-ac2f-e6ac455bdbb8 tempest-QuotasAdminNegativeTest-770941128 tempest-QuotasAdminNegativeTest-770941128-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d" status: 200 len: 329 microversion: 2.1 time: 0.541955 Aug 22 17:14:03.062450 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 356/675] 10.222.0.96 () {60 vars in 1262 bytes} [Mon Aug 22 17:14:02 2022] PUT /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d => generated 329 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:03.082306 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0681c75a-affb-4c9b-a771-d8917f9060b6 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Action: 'update', calling method: .version_select at 0x7f8009a9ef70>, body: {"quota_set": {"ram": 0}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:03.087713 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0681c75a-affb-4c9b-a771-d8917f9060b6 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'a30e01bd016644b4a9e68f42e7fcc8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0810ab9220ab4a80b3a9ad6acdc15d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0681c75a-affb-4c9b-a771-d8917f9060b6 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Request method failure captured: Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: request: PUT /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d HTTP/1.1 Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 25 Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7lOKmmO0XipoC5Gt-YaUxLW-IvUjeL29i9eWTV29jWsg5eRPDUzQNEAFvZ0gIyP4Qrad5Uz1fmswTzcHjrn7aqP9TXubcnqGNf_KKTcoEl32IlDQEcxmih92veVus3u18GGinCBJFRJgC0UQ4JMho51J3CT_4NzFeGgAT4NxMZgB60 Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 0810ab9220ab4a80b3a9ad6acdc15d5d Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-QuotasAdminNegativeTest-601123037 Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:14:03.090844 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:14:03.093283 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/0810ab9220ab4a80b3a9ad6acdc15d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_0810ab9220ab4a80b3a9ad6acdc15d5d", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/0810ab9220ab4a80b3a9ad6acdc15d5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/0810ab9220ab4a80b3a9ad6acdc15d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:14:03.093283 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-QuotasAdminNegativeTest-601123037 Aug 22 17:14:03.093283 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 0810ab9220ab4a80b3a9ad6acdc15d5d Aug 22 17:14:03.093283 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-601123037 Aug 22 17:14:03.093283 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-QuotasAdminNegativeTest-601123037-project Aug 22 17:14:03.093283 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:14:03.093283 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:14:03.093283 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: a30e01bd016644b4a9e68f42e7fcc8fb Aug 22 17:14:03.093283 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-QuotasAdminNegativeTest-601123037-project Aug 22 17:14:03.093283 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:14:03.093283 n-d-854030-1 devstack@n-api.service[123015]: {"quota_set": {"ram": 0}} Aug 22 17:14:03.093283 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:14:03.093283 n-d-854030-1 devstack@n-api.service[123015]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 22 17:14:03.093283 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '0810ab9220ab4a80b3a9ad6acdc15d5d', 'body': {'quota_set': {'ram': 0}}} Aug 22 17:14:03.094571 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:14:03.094571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:03.094571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:03.094571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:03.094571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:14:03.094571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:14:03.094571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:14:03.094571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:14:03.094571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:03.094571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:03.094571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:03.094571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:03.094571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 22 17:14:03.094571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 22 17:14:03.094571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 17:14:03.094571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:03.094571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 17:14:03.094571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:03.094571 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:03.096726 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:03.098209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:03.098209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:03.098209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:14:03.098209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:14:03.098209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 22 17:14:03.098209 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:03.098209 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0681c75a-affb-4c9b-a771-d8917f9060b6 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:14:03.098209 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0681c75a-affb-4c9b-a771-d8917f9060b6 tempest-QuotasAdminNegativeTest-601123037 tempest-QuotasAdminNegativeTest-601123037-project] 10.222.0.96 "PUT /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d" status: 403 len: 116 microversion: 2.1 time: 0.014530 Aug 22 17:14:03.098209 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 357/676] 10.222.0.96 () {60 vars in 1262 bytes} [Mon Aug 22 17:14:03 2022] PUT /compute/v2.1/os-quota-sets/0810ab9220ab4a80b3a9ad6acdc15d5d => generated 116 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:14:03.550397 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6e654090-0dd3-4616-b4cf-19492b0b750a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:03.552051 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-6e654090-0dd3-4616-b4cf-19492b0b750a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:03.559454 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6e654090-0dd3-4616-b4cf-19492b0b750a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:03.560848 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6e654090-0dd3-4616-b4cf-19492b0b750a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:03.561481 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6e654090-0dd3-4616-b4cf-19492b0b750a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:03.562203 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6e654090-0dd3-4616-b4cf-19492b0b750a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:03.562824 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6e654090-0dd3-4616-b4cf-19492b0b750a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:03.563435 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6e654090-0dd3-4616-b4cf-19492b0b750a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:03.772433 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6e654090-0dd3-4616-b4cf-19492b0b750a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:03.791948 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6e654090-0dd3-4616-b4cf-19492b0b750a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1460 microversion: 2.1 time: 0.247200 Aug 22 17:14:03.792843 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 358/677] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:03 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1460 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:03.801446 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-181371c4-7cfd-4ac8-bfdc-cf15371a5a70 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:03.802284 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-181371c4-7cfd-4ac8-bfdc-cf15371a5a70 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:03.805636 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:03.813462 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-181371c4-7cfd-4ac8-bfdc-cf15371a5a70 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:03.814347 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-181371c4-7cfd-4ac8-bfdc-cf15371a5a70 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:03.814990 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-181371c4-7cfd-4ac8-bfdc-cf15371a5a70 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:03.817800 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-181371c4-7cfd-4ac8-bfdc-cf15371a5a70 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:03.817800 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-181371c4-7cfd-4ac8-bfdc-cf15371a5a70 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:03.817800 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-181371c4-7cfd-4ac8-bfdc-cf15371a5a70 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:04.302847 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-181371c4-7cfd-4ac8-bfdc-cf15371a5a70 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:04.322111 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-181371c4-7cfd-4ac8-bfdc-cf15371a5a70 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 200 len: 1321 microversion: 2.1 time: 0.523836 Aug 22 17:14:04.323347 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 359/678] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:03 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 1321 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:04.884394 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fa7f8c77-62ef-46af-a004-58269ee81243 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:04.884394 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-fa7f8c77-62ef-46af-a004-58269ee81243 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:04.900236 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fa7f8c77-62ef-46af-a004-58269ee81243 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:04.902212 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fa7f8c77-62ef-46af-a004-58269ee81243 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:04.908688 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fa7f8c77-62ef-46af-a004-58269ee81243 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:04.909884 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fa7f8c77-62ef-46af-a004-58269ee81243 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:04.910891 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fa7f8c77-62ef-46af-a004-58269ee81243 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:04.913930 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fa7f8c77-62ef-46af-a004-58269ee81243 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:05.544506 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-145376b1-bd0a-478b-9e32-b467763c2343 tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] 10.222.0.96 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.768452 Aug 22 17:14:05.545632 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 320/679] 10.222.0.96 () {60 vars in 1170 bytes} [Mon Aug 22 17:14:02 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:05.552856 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c42f4f9c-d8ce-48ee-a812-35e638bdb21e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:05.553634 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c42f4f9c-d8ce-48ee-a812-35e638bdb21e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:05.563490 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c42f4f9c-d8ce-48ee-a812-35e638bdb21e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:05.564112 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c42f4f9c-d8ce-48ee-a812-35e638bdb21e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:05.565470 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c42f4f9c-d8ce-48ee-a812-35e638bdb21e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:05.570482 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c42f4f9c-d8ce-48ee-a812-35e638bdb21e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:05.570482 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c42f4f9c-d8ce-48ee-a812-35e638bdb21e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:05.570482 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c42f4f9c-d8ce-48ee-a812-35e638bdb21e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:05.673247 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fa7f8c77-62ef-46af-a004-58269ee81243 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1611 microversion: 2.1 time: 1.348530 Aug 22 17:14:05.686597 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 360/680] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:04 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1611 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:05.702092 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f6e3220f-0102-43d0-b000-29016de64481 tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] Action: 'create', calling method: .version_select at 0x7f8009cf60d0>, body: {"pool": null} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:05.797218 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c42f4f9c-d8ce-48ee-a812-35e638bdb21e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:05.805599 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c42f4f9c-d8ce-48ee-a812-35e638bdb21e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 200 len: 1321 microversion: 2.1 time: 0.258522 Aug 22 17:14:05.806460 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 321/681] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:05 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:05.812980 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-82bdefc6-df9b-4f52-885f-5f753ad10c97 req-cac71fb6-57aa-4574-b3d6-d77eeffcacf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2320d5b-5a26-4a82-810e-8f00c00486f5", "name": "network-vif-plugged", "status": "completed", "tag": "ccdc9250-f83e-4d21-ac2f-ed4e207f94f7"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:05.822460 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-82bdefc6-df9b-4f52-885f-5f753ad10c97 req-cac71fb6-57aa-4574-b3d6-d77eeffcacf8 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:05.822942 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-82bdefc6-df9b-4f52-885f-5f753ad10c97 req-cac71fb6-57aa-4574-b3d6-d77eeffcacf8 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:05.823371 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-82bdefc6-df9b-4f52-885f-5f753ad10c97 req-cac71fb6-57aa-4574-b3d6-d77eeffcacf8 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:05.845353 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-82bdefc6-df9b-4f52-885f-5f753ad10c97 req-cac71fb6-57aa-4574-b3d6-d77eeffcacf8 service nova] Creating event network-vif-plugged:ccdc9250-f83e-4d21-ac2f-ed4e207f94f7 for instance a2320d5b-5a26-4a82-810e-8f00c00486f5 on n-h1-854030-1 Aug 22 17:14:05.851060 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-82bdefc6-df9b-4f52-885f-5f753ad10c97 req-cac71fb6-57aa-4574-b3d6-d77eeffcacf8 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042307 Aug 22 17:14:05.852542 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 322/682] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:05.860795 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-21ae5999-cffc-46fe-8b95-d2b89c7ce9a2 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:05.862367 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-21ae5999-cffc-46fe-8b95-d2b89c7ce9a2 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:05.869814 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21ae5999-cffc-46fe-8b95-d2b89c7ce9a2 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:05.870498 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21ae5999-cffc-46fe-8b95-d2b89c7ce9a2 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:05.871096 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21ae5999-cffc-46fe-8b95-d2b89c7ce9a2 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:05.872732 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21ae5999-cffc-46fe-8b95-d2b89c7ce9a2 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:05.874124 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21ae5999-cffc-46fe-8b95-d2b89c7ce9a2 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:05.874829 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21ae5999-cffc-46fe-8b95-d2b89c7ce9a2 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:06.337047 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-21ae5999-cffc-46fe-8b95-d2b89c7ce9a2 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-873d4225-1c2d-4fe3-87de-c461f48f36b3) Aug 22 17:14:06.337047 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:06.337047 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:06.337047 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:06.337047 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:06.337047 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:06.337047 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 22 17:14:06.337047 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 22 17:14:06.337047 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 22 17:14:06.337047 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 22 17:14:06.337047 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 22 17:14:06.337047 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 22 17:14:06.337047 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:14:06.337047 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:14:06.338188 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:14:06.338188 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:14:06.338188 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:14:06.338188 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:14:06.338188 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:06.338188 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:06.338188 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:14:06.338188 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:14:06.338188 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:06.338188 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:06.338188 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:14:06.338188 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:14:06.338188 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:06.338188 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:06.338188 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:14:06.338188 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:14:06.338188 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:06.338188 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:06.339621 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:14:06.339621 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:14:06.339621 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:14:06.339621 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:14:06.339621 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:14:06.339621 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:14:06.339621 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:14:06.339621 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:14:06.339621 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:14:06.339621 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:14:06.339621 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:14:06.339621 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:14:06.339621 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:14:06.339621 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:14:06.339621 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:14:06.339621 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:14:06.341593 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:14:06.341593 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:14:06.341593 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:14:06.341593 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:14:06.341593 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:14:06.341593 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:14:06.341593 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:14:06.341593 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:14:06.341593 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:14:06.341593 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:14:06.341593 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-873d4225-1c2d-4fe3-87de-c461f48f36b3) Aug 22 17:14:06.341593 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:06.341593 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-21ae5999-cffc-46fe-8b95-d2b89c7ce9a2 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:06.341593 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-21ae5999-cffc-46fe-8b95-d2b89c7ce9a2 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Request method failure captured: Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f/action HTTP/1.1 Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 15 Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7k-eHTtoh8JT4OY7na4sDNAiFpsEfe3go2M3ox3vL3Yg5jQTcSDGN-bzPc4Jufq2zgz9ZPHyYEAVU5s1JQKere2Lktt-O13MKVepTActz5JqD52chtrFMEg_x4sXfzRrT7GJ8gfG8GlcMClKndtLRBnqjMEy6nL-RMY5jQDVKfFX1s Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 21ea51a81af14b2592a2e0f46be6b778 Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-MigrationsAdminTest-1307498773 Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:14:06.343006 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:14:06.344622 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/21ea51a81af14b2592a2e0f46be6b778"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_21ea51a81af14b2592a2e0f46be6b778", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/21ea51a81af14b2592a2e0f46be6b778"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/21ea51a81af14b2592a2e0f46be6b778"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:14:06.344622 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-MigrationsAdminTest-1307498773 Aug 22 17:14:06.344622 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 21ea51a81af14b2592a2e0f46be6b778 Aug 22 17:14:06.344622 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-MigrationsAdminTest-1307498773 Aug 22 17:14:06.344622 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-MigrationsAdminTest-1307498773-project-admin Aug 22 17:14:06.344622 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:14:06.344622 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:14:06.344622 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: f0b166e7b8d74473a3a4db88436f284f Aug 22 17:14:06.344622 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-MigrationsAdminTest-1307498773-project-admin Aug 22 17:14:06.344622 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:14:06.344622 n-d-854030-1 devstack@n-api.service[123016]: {"migrate": {}} Aug 22 17:14:06.344622 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:14:06.344622 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:06.347250 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:14:06.347250 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'fd420da2-ec4b-4d15-82d1-0f09c4072a7f', 'body': {'migrate': {}}} Aug 22 17:14:06.347250 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:14:06.347250 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:06.347250 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:06.347250 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:06.347250 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:06.347250 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:06.347250 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 22 17:14:06.347250 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 22 17:14:06.347250 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 22 17:14:06.347250 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 22 17:14:06.347250 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 22 17:14:06.347250 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 22 17:14:06.347250 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:14:06.347250 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:14:06.347250 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:14:06.347250 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:14:06.347250 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:14:06.348603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:14:06.348603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:06.348603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:06.348603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:14:06.348603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:14:06.348603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:06.348603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:06.348603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:14:06.348603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:14:06.348603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:06.348603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:06.348603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:14:06.348603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:14:06.348603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:06.348603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:06.348603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:14:06.348603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:14:06.348603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:14:06.349982 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:14:06.349982 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:14:06.349982 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:14:06.349982 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:14:06.349982 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:14:06.349982 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:14:06.349982 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:14:06.349982 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:14:06.349982 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:14:06.349982 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:14:06.349982 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:14:06.349982 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:14:06.349982 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:14:06.349982 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:14:06.349982 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:14:06.349982 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:14:06.349982 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:14:06.351200 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:14:06.351200 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:14:06.351200 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:14:06.351200 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:14:06.351200 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:14:06.351200 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:14:06.351200 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-873d4225-1c2d-4fe3-87de-c461f48f36b3) Aug 22 17:14:06.351200 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:06.351200 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:06.351200 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:06.351200 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:06.351200 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:06.351200 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:06.351200 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:14:06.351200 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:14:06.351200 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:14:06.351200 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:14:06.353865 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:06.353865 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:06.353865 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:06.353865 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:06.353865 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:06.353865 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:06.353865 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:06.353865 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:06.353865 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:14:06.353865 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:14:06.353865 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:06.353865 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:06.353865 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:06.353865 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-21ae5999-cffc-46fe-8b95-d2b89c7ce9a2 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:06.353865 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:14:06.355172 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-21ae5999-cffc-46fe-8b95-d2b89c7ce9a2 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f/action" status: 500 len: 214 microversion: 2.1 time: 0.482146 Aug 22 17:14:06.355172 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 323/683] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:14:05 2022] POST /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f/action => generated 214 bytes in 488 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:14:06.722441 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c048cd33-5816-4e94-bb60-134a1378dc35 tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-588033916", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "50e0f8bf-d397-4656-8385-bce3fcb867eb"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:06.834416 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-c048cd33-5816-4e94-bb60-134a1378dc35 tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] validate_networks() for [('50e0f8bf-d397-4656-8385-bce3fcb867eb', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:14:07.331563 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-c048cd33-5816-4e94-bb60-134a1378dc35 tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8f0f1113-09a6-4218-b9f6-4b70e8f991db) Aug 22 17:14:07.331563 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:07.331563 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:07.331563 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:07.331563 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:07.331563 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:07.331563 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:07.331563 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:07.331563 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:07.331563 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:07.331563 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:14:07.331563 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:14:07.331563 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:14:07.331563 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:14:07.331563 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:14:07.331563 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:14:07.332703 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:14:07.332703 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:14:07.332703 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:14:07.332703 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:14:07.332703 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:14:07.332703 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:14:07.332703 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:14:07.332703 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:14:07.332703 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:14:07.332703 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:14:07.332703 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:14:07.332703 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:07.332703 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:07.332703 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:14:07.332703 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:14:07.332703 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:07.332703 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:07.332703 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:14:07.333877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:14:07.333877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:07.333877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:07.333877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:14:07.333877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:14:07.333877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:07.333877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:07.333877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:14:07.333877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:14:07.333877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:14:07.333877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:14:07.333877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:14:07.333877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:14:07.333877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:14:07.333877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:14:07.333877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:14:07.333877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:14:07.333877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:14:07.335943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:14:07.335943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:14:07.335943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:14:07.335943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:14:07.335943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:14:07.335943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:14:07.335943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:14:07.335943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:14:07.335943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:14:07.335943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:14:07.335943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:14:07.335943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:14:07.335943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:14:07.335943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:14:07.335943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8f0f1113-09a6-4218-b9f6-4b70e8f991db) Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-c048cd33-5816-4e94-bb60-134a1378dc35 tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c048cd33-5816-4e94-bb60-134a1378dc35 tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] Request method failure captured: Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 207 Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7ldz0h_snlSnuZnfoT2Ppc8LLTojcT4T2Z34ukyFFoYPGfBRDbFgy_t6WzxwIOSTyLJaiBYGCwzmjXvnGqLHg-ds0gilaL1E9Qfc13HgUkbGl7PDp8bjgZYpCrNaE2b9QQzEbfFT-tI7tKmH0y7w1W5Nwlcgqt54PN_PfJWAre2p1o Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 81a44991adb24593a1c68b41a0903d81 Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ImagesNegativeTestJSON-1312595066 Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:14:07.337376 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:14:07.341639 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/81a44991adb24593a1c68b41a0903d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_81a44991adb24593a1c68b41a0903d81", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/81a44991adb24593a1c68b41a0903d81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/81a44991adb24593a1c68b41a0903d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:14:07.341639 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ImagesNegativeTestJSON-1312595066 Aug 22 17:14:07.341639 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 81a44991adb24593a1c68b41a0903d81 Aug 22 17:14:07.341639 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1312595066 Aug 22 17:14:07.341639 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ImagesNegativeTestJSON-1312595066-project Aug 22 17:14:07.341639 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:14:07.341639 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:14:07.341639 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 1239db6f66d94bb5ae0419ddfe4e2aff Aug 22 17:14:07.341639 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ImagesNegativeTestJSON-1312595066-project Aug 22 17:14:07.341639 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:14:07.341639 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-588033916", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "50e0f8bf-d397-4656-8385-bce3fcb867eb"}]}} Aug 22 17:14:07.350035 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:14:07.350035 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:07.350035 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:14:07.350035 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-ImagesNegativeTestJSON-server-588033916', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '50e0f8bf-d397-4656-8385-bce3fcb867eb'}]}}} Aug 22 17:14:07.350035 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:14:07.350035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:07.350035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:07.350035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:07.350035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:07.350035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:07.350035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:07.350035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:07.350035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:07.350035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:07.350035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:14:07.350035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:14:07.350035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:14:07.350035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:14:07.350035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:14:07.352852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:14:07.352852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:14:07.352852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:14:07.352852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:14:07.352852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:14:07.352852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:14:07.352852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:14:07.352852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:14:07.352852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:14:07.352852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:14:07.352852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:14:07.352852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:14:07.352852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:07.352852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:07.352852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:14:07.352852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:14:07.352852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:07.352852 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:07.355405 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:14:07.355405 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:14:07.355405 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:07.355405 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:07.355405 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:14:07.355405 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:14:07.355405 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:07.355405 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:07.355405 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:14:07.355405 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:14:07.355405 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:14:07.355405 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:14:07.355405 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:14:07.355405 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:14:07.355405 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:14:07.355405 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:14:07.355405 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:14:07.355405 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:14:07.359317 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:14:07.359317 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:14:07.359317 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:14:07.359317 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:14:07.359317 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:14:07.359317 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:14:07.359317 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:14:07.359317 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:14:07.359317 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:14:07.359317 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:14:07.359317 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:14:07.359317 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:14:07.359317 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:14:07.359317 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:14:07.359317 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:14:07.359317 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:14:07.361724 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8f0f1113-09a6-4218-b9f6-4b70e8f991db) Aug 22 17:14:07.361724 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:07.361724 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:07.361724 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:07.361724 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:07.361724 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:07.361724 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:07.361724 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:14:07.361724 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:14:07.361724 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:14:07.361724 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:14:07.361724 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:07.361724 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:07.361724 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:07.361724 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:07.361724 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:07.361724 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:07.361724 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:07.361724 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:07.365173 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:14:07.365173 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:14:07.365173 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:07.365173 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:07.365173 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:07.365173 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c048cd33-5816-4e94-bb60-134a1378dc35 tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:07.365173 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:14:07.365173 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c048cd33-5816-4e94-bb60-134a1378dc35 tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.992728 Aug 22 17:14:07.365173 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 324/684] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:14:06 2022] POST /compute/v2.1/servers => generated 214 bytes in 997 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:14:07.365173 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-995ce182-4e47-4ba0-84f1-47f05c04f65b tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Calling method '.version_select at 0x7f8009a7c700>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:07.373704 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-995ce182-4e47-4ba0-84f1-47f05c04f65b tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:07.374252 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-995ce182-4e47-4ba0-84f1-47f05c04f65b tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:07.376662 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-995ce182-4e47-4ba0-84f1-47f05c04f65b tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:07.380201 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=100 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:07.409953 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-995ce182-4e47-4ba0-84f1-47f05c04f65b tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] 10.222.0.96 "GET /compute/v2.1/os-migrations" status: 200 len: 18 microversion: 2.1 time: 0.069734 Aug 22 17:14:07.410854 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 325/685] 10.222.0.96 () {58 vars in 1143 bytes} [Mon Aug 22 17:14:07 2022] GET /compute/v2.1/os-migrations => generated 18 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:14:07.424312 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-86a4f259-8ae2-42c4-a820-cd8bd6fe45b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:07.427437 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-86a4f259-8ae2-42c4-a820-cd8bd6fe45b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:07.435599 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:07.440300 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86a4f259-8ae2-42c4-a820-cd8bd6fe45b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:07.443760 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86a4f259-8ae2-42c4-a820-cd8bd6fe45b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:07.446672 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86a4f259-8ae2-42c4-a820-cd8bd6fe45b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:07.450792 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86a4f259-8ae2-42c4-a820-cd8bd6fe45b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:07.453392 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86a4f259-8ae2-42c4-a820-cd8bd6fe45b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:07.454247 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86a4f259-8ae2-42c4-a820-cd8bd6fe45b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:07.708850 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-86a4f259-8ae2-42c4-a820-cd8bd6fe45b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:07.721973 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-86a4f259-8ae2-42c4-a820-cd8bd6fe45b6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 200 len: 1321 microversion: 2.1 time: 0.308759 Aug 22 17:14:07.722735 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 326/686] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:07 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 1321 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:07.734082 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-41c81c2e-3444-4809-a731-2bba65ce729b tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1342758013", "metadata": {"image_type": "test"}}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:07.738511 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-41c81c2e-3444-4809-a731-2bba65ce729b tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] Failed to fetch instance by id tempest-invalid-1107705198 {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 22 17:14:07.741192 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-41c81c2e-3444-4809-a731-2bba65ce729b tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] HTTP exception thrown: Instance tempest-invalid-1107705198 could not be found. Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-41c81c2e-3444-4809-a731-2bba65ce729b tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] Request method failure captured: Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers/tempest-invalid-1107705198/action HTTP/1.1 Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 112 Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7ldz0h_snlSnuZnfoT2Ppc8LLTojcT4T2Z34ukyFFoYPGfBRDbFgy_t6WzxwIOSTyLJaiBYGCwzmjXvnGqLHg-ds0gilaL1E9Qfc13HgUkbGl7PDp8bjgZYpCrNaE2b9QQzEbfFT-tI7tKmH0y7w1W5Nwlcgqt54PN_PfJWAre2p1o Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 81a44991adb24593a1c68b41a0903d81 Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ImagesNegativeTestJSON-1312595066 Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:14:07.748540 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:14:07.749939 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/81a44991adb24593a1c68b41a0903d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_81a44991adb24593a1c68b41a0903d81", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/81a44991adb24593a1c68b41a0903d81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/81a44991adb24593a1c68b41a0903d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:14:07.749939 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ImagesNegativeTestJSON-1312595066 Aug 22 17:14:07.749939 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 81a44991adb24593a1c68b41a0903d81 Aug 22 17:14:07.749939 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1312595066 Aug 22 17:14:07.749939 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ImagesNegativeTestJSON-1312595066-project Aug 22 17:14:07.749939 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:14:07.749939 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:14:07.749939 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 1239db6f66d94bb5ae0419ddfe4e2aff Aug 22 17:14:07.749939 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ImagesNegativeTestJSON-1312595066-project Aug 22 17:14:07.749939 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:14:07.749939 n-d-854030-1 devstack@n-api.service[123016]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1342758013", "metadata": {"image_type": "test"}}} Aug 22 17:14:07.749939 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance tempest-invalid-1107705198 could not be found. Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'tempest-invalid-1107705198', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1342758013', 'metadata': {'image_type': 'test'}}}} Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1107705198 could not be found. Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:07.750694 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1107705198 could not be found. Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1107705198 could not be found. Aug 22 17:14:07.751964 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:07.753394 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-41c81c2e-3444-4809-a731-2bba65ce729b tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] Returning 404 to user: Instance tempest-invalid-1107705198 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:14:07.753394 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-41c81c2e-3444-4809-a731-2bba65ce729b tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] 10.222.0.96 "POST /compute/v2.1/servers/tempest-invalid-1107705198/action" status: 404 len: 101 microversion: 2.1 time: 0.018480 Aug 22 17:14:07.753394 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 327/687] 10.222.0.96 () {60 vars in 1249 bytes} [Mon Aug 22 17:14:07 2022] POST /compute/v2.1/servers/tempest-invalid-1107705198/action => generated 101 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:14:07.763658 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f6b6a07e-f62c-432a-a482-bf9601eed421 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1622495650", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:07.858681 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-f6b6a07e-f62c-432a-a482-bf9601eed421 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] validate_networks() for None {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:14:08.351224 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-f6b6a07e-f62c-432a-a482-bf9601eed421 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:14:08.351808 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-f6b6a07e-f62c-432a-a482-bf9601eed421 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:14:08.352303 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-f6b6a07e-f62c-432a-a482-bf9601eed421 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:14:08.353188 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-f6b6a07e-f62c-432a-a482-bf9601eed421 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:14:08.353823 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-f6b6a07e-f62c-432a-a482-bf9601eed421 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:14:08.364515 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6b6a07e-f62c-432a-a482-bf9601eed421 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:08.365353 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6b6a07e-f62c-432a-a482-bf9601eed421 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:08.366046 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6b6a07e-f62c-432a-a482-bf9601eed421 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:08.367581 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6b6a07e-f62c-432a-a482-bf9601eed421 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:08.370129 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6b6a07e-f62c-432a-a482-bf9601eed421 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:08.370853 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6b6a07e-f62c-432a-a482-bf9601eed421 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:08.385367 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=21 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:08.416434 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-f6b6a07e-f62c-432a-a482-bf9601eed421 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Getting quotas for project c3d5a2fb6b4440168a7e84d03007a6fb. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:14:08.426687 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-f6b6a07e-f62c-432a-a482-bf9601eed421 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Getting quotas for user dafa41865864461fa0e0dbc4a0188e4b and project c3d5a2fb6b4440168a7e84d03007a6fb. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:14:08.436910 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f6e3220f-0102-43d0-b000-29016de64481 tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] 10.222.0.96 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.743817 Aug 22 17:14:08.437588 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 361/688] 10.222.0.96 () {60 vars in 1170 bytes} [Mon Aug 22 17:14:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:08.444525 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cccc596c-baee-4f93-81d4-5fcae98696c3 tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1224153704"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:08.448386 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-cccc596c-baee-4f93-81d4-5fcae98696c3 tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 22 17:14:08.453382 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-cccc596c-baee-4f93-81d4-5fcae98696c3 tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cccc596c-baee-4f93-81d4-5fcae98696c3 tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] Request method failure captured: Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 57 Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7ldz0h_snlSnuZnfoT2Ppc8LLTojcT4T2Z34ukyFFoYPGfBRDbFgy_t6WzxwIOSTyLJaiBYGCwzmjXvnGqLHg-ds0gilaL1E9Qfc13HgUkbGl7PDp8bjgZYpCrNaE2b9QQzEbfFT-tI7tKmH0y7w1W5Nwlcgqt54PN_PfJWAre2p1o Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 81a44991adb24593a1c68b41a0903d81 Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ImagesNegativeTestJSON-1312595066 Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:14:08.462465 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:14:08.463877 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/81a44991adb24593a1c68b41a0903d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_81a44991adb24593a1c68b41a0903d81", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/81a44991adb24593a1c68b41a0903d81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/81a44991adb24593a1c68b41a0903d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:14:08.463877 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ImagesNegativeTestJSON-1312595066 Aug 22 17:14:08.463877 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 81a44991adb24593a1c68b41a0903d81 Aug 22 17:14:08.463877 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1312595066 Aug 22 17:14:08.463877 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ImagesNegativeTestJSON-1312595066-project Aug 22 17:14:08.463877 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:14:08.463877 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:14:08.463877 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 1239db6f66d94bb5ae0419ddfe4e2aff Aug 22 17:14:08.463877 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ImagesNegativeTestJSON-1312595066-project Aug 22 17:14:08.463877 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:14:08.463877 n-d-854030-1 devstack@n-api.service[123015]: {"createImage": {"name": "tempest-test-snap-1224153704"}} Aug 22 17:14:08.463877 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:14:08.463877 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1224153704'}}} Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:08.464638 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:08.466339 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:08.466339 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:08.466339 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 22 17:14:08.466339 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 22 17:14:08.466339 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:14:08.466339 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:14:08.466339 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:14:08.466339 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:14:08.466339 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 22 17:14:08.466339 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:08.466339 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:08.466339 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:08.466339 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:08.466339 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:08.466339 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:08.466339 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:14:08.466339 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:14:08.466339 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 22 17:14:08.466339 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:08.467453 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cccc596c-baee-4f93-81d4-5fcae98696c3 tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:14:08.467453 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-cccc596c-baee-4f93-81d4-5fcae98696c3 tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] 10.222.0.96 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.024640 Aug 22 17:14:08.474523 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 362/689] 10.222.0.96 () {60 vars in 1275 bytes} [Mon Aug 22 17:14:08 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:14:08.489533 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cbe31012-399f-46fe-8f69-f93811e20677 tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] Calling method '.version_select at 0x7f8009982040>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:08.494425 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-f6b6a07e-f62c-432a-a482-bf9601eed421 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Going to run 1 instances... {{(pid=123016) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:14:08.502209 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-f6b6a07e-f62c-432a-a482-bf9601eed421 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:14:08.705557 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f6b6a07e-f62c-432a-a482-bf9601eed421 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.957485 Aug 22 17:14:08.706821 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 328/690] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:14:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:14:08.712831 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-45a1f021-673b-4ffe-b3ab-3eeda1f228ac tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-619608377"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:08.727514 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-45a1f021-673b-4ffe-b3ab-3eeda1f228ac tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 22 17:14:08.728746 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-45a1f021-673b-4ffe-b3ab-3eeda1f228ac tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-45a1f021-673b-4ffe-b3ab-3eeda1f228ac tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] Request method failure captured: Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 56 Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7ldz0h_snlSnuZnfoT2Ppc8LLTojcT4T2Z34ukyFFoYPGfBRDbFgy_t6WzxwIOSTyLJaiBYGCwzmjXvnGqLHg-ds0gilaL1E9Qfc13HgUkbGl7PDp8bjgZYpCrNaE2b9QQzEbfFT-tI7tKmH0y7w1W5Nwlcgqt54PN_PfJWAre2p1o Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 81a44991adb24593a1c68b41a0903d81 Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ImagesNegativeTestJSON-1312595066 Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:14:08.730889 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:14:08.733238 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/81a44991adb24593a1c68b41a0903d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_81a44991adb24593a1c68b41a0903d81", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/81a44991adb24593a1c68b41a0903d81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/81a44991adb24593a1c68b41a0903d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:14:08.733238 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ImagesNegativeTestJSON-1312595066 Aug 22 17:14:08.733238 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 81a44991adb24593a1c68b41a0903d81 Aug 22 17:14:08.733238 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1312595066 Aug 22 17:14:08.733238 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ImagesNegativeTestJSON-1312595066-project Aug 22 17:14:08.733238 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:14:08.733238 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:14:08.733238 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 1239db6f66d94bb5ae0419ddfe4e2aff Aug 22 17:14:08.733238 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ImagesNegativeTestJSON-1312595066-project Aug 22 17:14:08.733238 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:14:08.733238 n-d-854030-1 devstack@n-api.service[123016]: {"createImage": {"name": "tempest-test-snap-619608377"}} Aug 22 17:14:08.733238 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:14:08.733238 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-619608377'}}} Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:08.734193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:08.735415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:08.735415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:08.735415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 22 17:14:08.735415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 22 17:14:08.735415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:14:08.735415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:14:08.735415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:14:08.735415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:14:08.735415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 22 17:14:08.735415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:08.735415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:08.735415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:08.735415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:08.735415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:08.735415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:08.735415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:14:08.735415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:14:08.735415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 22 17:14:08.735415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:08.758847 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-45a1f021-673b-4ffe-b3ab-3eeda1f228ac tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:14:08.767048 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-45a1f021-673b-4ffe-b3ab-3eeda1f228ac tempest-ImagesNegativeTestJSON-1312595066 tempest-ImagesNegativeTestJSON-1312595066-project] 10.222.0.96 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.057589 Aug 22 17:14:08.769965 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 329/691] 10.222.0.96 () {60 vars in 1281 bytes} [Mon Aug 22 17:14:08 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:14:08.784943 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f81160d9-9d60-4014-b121-3d4904953c55 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:08.788157 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-f81160d9-9d60-4014-b121-3d4904953c55 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:09.047455 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-cbe31012-399f-46fe-8f69-f93811e20677 tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] 10.222.0.96 "GET /compute/v2.1/os-floating-ips/b7fb153e-12d9-4814-b292-5c3c3debc8a4" status: 200 len: 142 microversion: 2.1 time: 0.571490 Aug 22 17:14:09.049256 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 363/692] 10.222.0.96 () {58 vars in 1260 bytes} [Mon Aug 22 17:14:08 2022] GET /compute/v2.1/os-floating-ips/b7fb153e-12d9-4814-b292-5c3c3debc8a4 => generated 142 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:09.060652 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-bb6cc45d-9e9b-49e4-9d67-6a4a5856b6f9 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:09.064190 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-bb6cc45d-9e9b-49e4-9d67-6a4a5856b6f9 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:09.080154 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-f81160d9-9d60-4014-b121-3d4904953c55 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:09.087637 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bb6cc45d-9e9b-49e4-9d67-6a4a5856b6f9 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:09.092102 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bb6cc45d-9e9b-49e4-9d67-6a4a5856b6f9 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:09.094816 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bb6cc45d-9e9b-49e4-9d67-6a4a5856b6f9 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:09.095809 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bb6cc45d-9e9b-49e4-9d67-6a4a5856b6f9 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:09.100895 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f81160d9-9d60-4014-b121-3d4904953c55 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 200 len: 1213 microversion: 2.1 time: 0.327393 Aug 22 17:14:09.101654 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 330/693] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:08 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 1213 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:09.107843 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bb6cc45d-9e9b-49e4-9d67-6a4a5856b6f9 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:09.107994 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5dff17ff-13c0-461f-8e41-083a580ebdf6 tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] Calling method '.version_select at 0x7f8009a3f430>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:09.118332 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bb6cc45d-9e9b-49e4-9d67-6a4a5856b6f9 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:09.458260 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-bb6cc45d-9e9b-49e4-9d67-6a4a5856b6f9 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:09.478038 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-bb6cc45d-9e9b-49e4-9d67-6a4a5856b6f9 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 200 len: 1471 microversion: 2.1 time: 0.426773 Aug 22 17:14:09.482092 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 364/694] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:09 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 1471 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:09.506036 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fcee93a6-b199-40f4-99bb-92e084e09b40 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:09.506868 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-fcee93a6-b199-40f4-99bb-92e084e09b40 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:09.528499 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fcee93a6-b199-40f4-99bb-92e084e09b40 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:09.528499 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fcee93a6-b199-40f4-99bb-92e084e09b40 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:09.528499 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fcee93a6-b199-40f4-99bb-92e084e09b40 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:09.528499 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fcee93a6-b199-40f4-99bb-92e084e09b40 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:09.528808 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fcee93a6-b199-40f4-99bb-92e084e09b40 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:09.528808 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fcee93a6-b199-40f4-99bb-92e084e09b40 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:09.588744 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-fcee93a6-b199-40f4-99bb-92e084e09b40 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Lazy-loading 'flavor' on Instance uuid a2320d5b-5a26-4a82-810e-8f00c00486f5 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:14:10.021557 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fcee93a6-b199-40f4-99bb-92e084e09b40 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5/action" status: 202 len: 0 microversion: 2.1 time: 0.519205 Aug 22 17:14:10.022989 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 365/695] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:14:09 2022] POST /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:14:10.038289 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-121f49fc-db73-4a11-83da-dbc61457c3df tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:10.040430 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-121f49fc-db73-4a11-83da-dbc61457c3df tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:10.056228 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-121f49fc-db73-4a11-83da-dbc61457c3df tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:10.058605 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-121f49fc-db73-4a11-83da-dbc61457c3df tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:10.062651 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-121f49fc-db73-4a11-83da-dbc61457c3df tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:10.063565 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-121f49fc-db73-4a11-83da-dbc61457c3df tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:10.064975 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-121f49fc-db73-4a11-83da-dbc61457c3df tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:10.065474 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-121f49fc-db73-4a11-83da-dbc61457c3df tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:10.114001 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:10.605312 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-121f49fc-db73-4a11-83da-dbc61457c3df tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 200 len: 1630 microversion: 2.1 time: 0.577794 Aug 22 17:14:10.609696 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 366/696] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:10 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 1630 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:10.617031 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-170de979-c6d2-405b-8634-58308a92f27e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:10.618876 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-170de979-c6d2-405b-8634-58308a92f27e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:10.634146 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-170de979-c6d2-405b-8634-58308a92f27e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:10.640204 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-170de979-c6d2-405b-8634-58308a92f27e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:10.640204 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-170de979-c6d2-405b-8634-58308a92f27e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:10.640204 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-170de979-c6d2-405b-8634-58308a92f27e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:10.640204 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-170de979-c6d2-405b-8634-58308a92f27e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:10.640924 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-170de979-c6d2-405b-8634-58308a92f27e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:10.711953 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-170de979-c6d2-405b-8634-58308a92f27e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:10.721818 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-170de979-c6d2-405b-8634-58308a92f27e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 200 len: 1217 microversion: 2.1 time: 0.110795 Aug 22 17:14:10.723251 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 367/697] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:10 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:11.377811 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a218d7c2-b2c3-4536-b1d3-dd05402b0ca9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1457480881", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:11.470937 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-a218d7c2-b2c3-4536-b1d3-dd05402b0ca9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] validate_networks() for None {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:14:11.784056 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-a218d7c2-b2c3-4536-b1d3-dd05402b0ca9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:14:11.786506 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-a218d7c2-b2c3-4536-b1d3-dd05402b0ca9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:14:11.787461 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-a218d7c2-b2c3-4536-b1d3-dd05402b0ca9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:14:11.788083 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-a218d7c2-b2c3-4536-b1d3-dd05402b0ca9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:14:11.797556 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-a218d7c2-b2c3-4536-b1d3-dd05402b0ca9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:14:11.822813 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a218d7c2-b2c3-4536-b1d3-dd05402b0ca9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:11.825523 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a218d7c2-b2c3-4536-b1d3-dd05402b0ca9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:11.827099 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a218d7c2-b2c3-4536-b1d3-dd05402b0ca9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:11.828101 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a218d7c2-b2c3-4536-b1d3-dd05402b0ca9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:11.831062 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a218d7c2-b2c3-4536-b1d3-dd05402b0ca9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:11.834131 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a218d7c2-b2c3-4536-b1d3-dd05402b0ca9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:11.890975 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-a218d7c2-b2c3-4536-b1d3-dd05402b0ca9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for project d789047469894e1fbe5af3a109a95b4c. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:14:11.896523 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-a218d7c2-b2c3-4536-b1d3-dd05402b0ca9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for user 43188026fda44118ad642b7065108966 and project d789047469894e1fbe5af3a109a95b4c. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:14:11.950721 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a218d7c2-b2c3-4536-b1d3-dd05402b0ca9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Going to run 1 instances... {{(pid=123015) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:14:11.958209 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a218d7c2-b2c3-4536-b1d3-dd05402b0ca9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:14:12.176944 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a218d7c2-b2c3-4536-b1d3-dd05402b0ca9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.091067 Aug 22 17:14:12.177692 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 368/698] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:14:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 17:14:12.183523 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b6023876-5e38-49a2-a41c-88fc7e994a4d tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:12.184944 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b6023876-5e38-49a2-a41c-88fc7e994a4d tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:12.191263 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6023876-5e38-49a2-a41c-88fc7e994a4d tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:12.191741 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6023876-5e38-49a2-a41c-88fc7e994a4d tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:12.192169 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6023876-5e38-49a2-a41c-88fc7e994a4d tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:12.192864 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6023876-5e38-49a2-a41c-88fc7e994a4d tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:12.193345 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6023876-5e38-49a2-a41c-88fc7e994a4d tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:12.193756 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6023876-5e38-49a2-a41c-88fc7e994a4d tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:12.433740 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5dff17ff-13c0-461f-8e41-083a580ebdf6 tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] 10.222.0.96 "DELETE /compute/v2.1/os-floating-ips/b7fb153e-12d9-4814-b292-5c3c3debc8a4" status: 202 len: 0 microversion: 2.1 time: 3.330800 Aug 22 17:14:12.436337 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 331/699] 10.222.0.96 () {58 vars in 1263 bytes} [Mon Aug 22 17:14:09 2022] DELETE /compute/v2.1/os-floating-ips/b7fb153e-12d9-4814-b292-5c3c3debc8a4 => generated 0 bytes in 3334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:14:12.441976 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-010c003f-1a24-4f11-af62-0ca38f4cd06f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:12.442923 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-010c003f-1a24-4f11-af62-0ca38f4cd06f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:12.459235 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-010c003f-1a24-4f11-af62-0ca38f4cd06f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:12.459738 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-010c003f-1a24-4f11-af62-0ca38f4cd06f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:12.460172 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-010c003f-1a24-4f11-af62-0ca38f4cd06f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:12.467690 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-010c003f-1a24-4f11-af62-0ca38f4cd06f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:12.468627 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-010c003f-1a24-4f11-af62-0ca38f4cd06f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:12.469491 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-010c003f-1a24-4f11-af62-0ca38f4cd06f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:12.490713 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b6023876-5e38-49a2-a41c-88fc7e994a4d tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 200 len: 1613 microversion: 2.1 time: 0.311674 Aug 22 17:14:12.495093 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 369/700] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:12 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 1613 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:12.504048 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e3d3825b-fbee-4229-a71e-98d3028d7045 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:12.504670 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-e3d3825b-fbee-4229-a71e-98d3028d7045 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:12.597048 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-010c003f-1a24-4f11-af62-0ca38f4cd06f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:12.601180 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e3d3825b-fbee-4229-a71e-98d3028d7045 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:12.607866 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-010c003f-1a24-4f11-af62-0ca38f4cd06f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 200 len: 1283 microversion: 2.1 time: 0.170252 Aug 22 17:14:12.608704 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 332/701] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:12 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 1283 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:12.611179 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e3d3825b-fbee-4229-a71e-98d3028d7045 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1217 microversion: 2.1 time: 0.115130 Aug 22 17:14:12.621240 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 370/702] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:12 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1217 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:12.621615 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-cda28bf5-15c6-4543-9ce3-e7969b97d4d1 tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] Calling method '.version_select at 0x7f8009be8940>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:12.621855 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7f9ef2cd-b582-4a7a-a10b-e1e0fe7aeea1 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:12.621855 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-7f9ef2cd-b582-4a7a-a10b-e1e0fe7aeea1 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:12.627331 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7f9ef2cd-b582-4a7a-a10b-e1e0fe7aeea1 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:12.627818 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7f9ef2cd-b582-4a7a-a10b-e1e0fe7aeea1 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:12.628247 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7f9ef2cd-b582-4a7a-a10b-e1e0fe7aeea1 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:12.628944 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7f9ef2cd-b582-4a7a-a10b-e1e0fe7aeea1 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:12.629424 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7f9ef2cd-b582-4a7a-a10b-e1e0fe7aeea1 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:12.630393 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7f9ef2cd-b582-4a7a-a10b-e1e0fe7aeea1 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:12.741385 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-7f9ef2cd-b582-4a7a-a10b-e1e0fe7aeea1 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a1f467d9-00a1-4c17-9540-d8d9cd66517a) Aug 22 17:14:12.741385 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:12.741385 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:12.741385 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:12.741385 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:12.741385 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:12.741385 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 22 17:14:12.741385 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 22 17:14:12.741385 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 22 17:14:12.741385 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 22 17:14:12.741385 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 22 17:14:12.741385 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 22 17:14:12.741385 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:14:12.741385 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:14:12.742408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:14:12.742408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:14:12.742408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:14:12.742408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:14:12.742408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:12.742408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:12.742408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:14:12.742408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:14:12.742408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:12.742408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:12.742408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:14:12.742408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:14:12.742408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:12.742408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:12.742408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:14:12.742408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:14:12.742408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:12.742408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:12.743543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:14:12.743543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:14:12.743543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:14:12.743543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:14:12.743543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:14:12.743543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:14:12.743543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:14:12.743543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:14:12.743543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:14:12.743543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:14:12.743543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:14:12.743543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:14:12.743543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:14:12.743543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:14:12.743543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:14:12.743543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:14:12.744514 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:14:12.744514 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:14:12.744514 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:14:12.744514 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:14:12.744514 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:14:12.744514 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:14:12.744514 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:14:12.744514 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:14:12.744514 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:14:12.744514 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:14:12.744514 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a1f467d9-00a1-4c17-9540-d8d9cd66517a) Aug 22 17:14:12.744514 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.744514 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-7f9ef2cd-b582-4a7a-a10b-e1e0fe7aeea1 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:12.744514 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7f9ef2cd-b582-4a7a-a10b-e1e0fe7aeea1 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Request method failure captured: Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5/action HTTP/1.1 Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 15 Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7kwS5fTDXijSbcaGZOVoKd1Ycg_XTAWlVIViX5X9Xcd62h-mq5g4Sn3S17RwZuWWpvTEOnVL3xHfd8N7K4FQNJYgzVpDLmN7bBs_AZSI0mDEFe6xFaf2aAvwbD1niUCbp4rKq-_5RzfyCAlOyDSTjVqqkjGlNuueFiCfXozldN6MxM Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 67d79fd58c8740a78b9a8395fd05475f Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-126741515 Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:14:12.745428 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:14:12.747390 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/67d79fd58c8740a78b9a8395fd05475f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_67d79fd58c8740a78b9a8395fd05475f", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/67d79fd58c8740a78b9a8395fd05475f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/67d79fd58c8740a78b9a8395fd05475f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:14:12.747390 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersAdminNegativeTestJSON-126741515 Aug 22 17:14:12.747390 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 67d79fd58c8740a78b9a8395fd05475f Aug 22 17:14:12.747390 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-126741515 Aug 22 17:14:12.747390 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersAdminNegativeTestJSON-126741515-project-admin Aug 22 17:14:12.747390 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:14:12.747390 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:14:12.747390 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 33ef6c5c41d64d1eac6e6f1290110bff Aug 22 17:14:12.747390 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersAdminNegativeTestJSON-126741515-project-admin Aug 22 17:14:12.747390 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:14:12.747390 n-d-854030-1 devstack@n-api.service[123015]: {"migrate": {}} Aug 22 17:14:12.747390 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:14:12.748517 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:12.748517 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:14:12.748517 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'a2320d5b-5a26-4a82-810e-8f00c00486f5', 'body': {'migrate': {}}} Aug 22 17:14:12.748517 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:14:12.748517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:12.748517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:12.748517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:12.748517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:12.748517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:12.748517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 22 17:14:12.748517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 22 17:14:12.748517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 22 17:14:12.748517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 22 17:14:12.748517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 22 17:14:12.748517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 22 17:14:12.748517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:14:12.748517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:14:12.748517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:14:12.748517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:14:12.751541 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:14:12.751541 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:14:12.751541 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:12.751541 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:12.751541 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:14:12.751541 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:14:12.751541 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:12.751541 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:12.751541 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:14:12.751541 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:14:12.751541 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:12.751541 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:12.751541 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:14:12.751541 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:14:12.751541 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:12.751541 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:12.751541 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:14:12.751541 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:14:12.753129 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:14:12.753129 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:14:12.753129 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:14:12.753129 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:14:12.753129 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:14:12.753129 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:14:12.753129 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:14:12.753129 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:14:12.753129 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:14:12.753129 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:14:12.753129 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:14:12.753129 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:14:12.753129 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:14:12.753129 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:14:12.753129 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:14:12.753129 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:14:12.753129 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:14:12.754922 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:14:12.754922 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:14:12.754922 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:14:12.754922 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:14:12.754922 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:14:12.754922 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:14:12.754922 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:14:12.754922 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a1f467d9-00a1-4c17-9540-d8d9cd66517a) Aug 22 17:14:12.754922 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.754922 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:12.754922 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.754922 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:12.754922 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:12.754922 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:12.754922 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:14:12.754922 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:14:12.754922 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:14:12.755975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:14:12.755975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:12.755975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.755975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.755975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:12.755975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.755975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:12.755975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:12.755975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:12.755975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:14:12.755975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:14:12.755975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:12.755975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.755975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.755975 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7f9ef2cd-b582-4a7a-a10b-e1e0fe7aeea1 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:12.755975 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:14:12.757074 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7f9ef2cd-b582-4a7a-a10b-e1e0fe7aeea1 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5/action" status: 500 len: 214 microversion: 2.1 time: 0.131747 Aug 22 17:14:12.757074 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 371/703] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:14:12 2022] POST /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5/action => generated 214 bytes in 133 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:14:12.765234 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-415e2af7-0725-42bd-a883-cbb859695070 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-415e2af7-0725-42bd-a883-cbb859695070 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Request method failure captured: Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14/action HTTP/1.1 Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 39 Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7kwS5fTDXijSbcaGZOVoKd1Ycg_XTAWlVIViX5X9Xcd62h-mq5g4Sn3S17RwZuWWpvTEOnVL3xHfd8N7K4FQNJYgzVpDLmN7bBs_AZSI0mDEFe6xFaf2aAvwbD1niUCbp4rKq-_5RzfyCAlOyDSTjVqqkjGlNuueFiCfXozldN6MxM Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 67d79fd58c8740a78b9a8395fd05475f Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-126741515 Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:14:12.769718 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:14:12.771060 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/67d79fd58c8740a78b9a8395fd05475f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_67d79fd58c8740a78b9a8395fd05475f", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/67d79fd58c8740a78b9a8395fd05475f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/67d79fd58c8740a78b9a8395fd05475f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:14:12.771060 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersAdminNegativeTestJSON-126741515 Aug 22 17:14:12.771060 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 67d79fd58c8740a78b9a8395fd05475f Aug 22 17:14:12.771060 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-126741515 Aug 22 17:14:12.771060 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersAdminNegativeTestJSON-126741515-project-admin Aug 22 17:14:12.771060 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:14:12.771060 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:14:12.771060 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 33ef6c5c41d64d1eac6e6f1290110bff Aug 22 17:14:12.771060 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersAdminNegativeTestJSON-126741515-project-admin Aug 22 17:14:12.771060 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:14:12.771060 n-d-854030-1 devstack@n-api.service[123015]: {"os-resetState": {"state": "invalid"}} Aug 22 17:14:12.771060 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '0cde06f3-062c-470d-995f-51b1b2136a14', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'invalid' Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:12.771931 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:14:12.773701 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:14:12.773701 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:12.773701 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:12.773701 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:14:12.773701 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:14:12.773701 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:14:12.773701 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:14:12.773701 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:14:12.773701 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:14:12.773701 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 22 17:14:12.773701 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.773701 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:12.773701 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.773701 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:12.773701 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:12.773701 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:12.773701 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:14:12.773701 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:14:12.773701 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 22 17:14:12.776650 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.776650 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-415e2af7-0725-42bd-a883-cbb859695070 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:14:12.776650 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-415e2af7-0725-42bd-a883-cbb859695070 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14/action" status: 400 len: 144 microversion: 2.1 time: 0.010305 Aug 22 17:14:12.778384 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 372/704] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:14:12 2022] POST /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14/action => generated 144 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:14:12.782918 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0df5a136-7eba-41dc-822d-f2f93b2216fa tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0df5a136-7eba-41dc-822d-f2f93b2216fa tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Request method failure captured: Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14/action HTTP/1.1 Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 31 Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7kwS5fTDXijSbcaGZOVoKd1Ycg_XTAWlVIViX5X9Xcd62h-mq5g4Sn3S17RwZuWWpvTEOnVL3xHfd8N7K4FQNJYgzVpDLmN7bBs_AZSI0mDEFe6xFaf2aAvwbD1niUCbp4rKq-_5RzfyCAlOyDSTjVqqkjGlNuueFiCfXozldN6MxM Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 67d79fd58c8740a78b9a8395fd05475f Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-126741515 Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:14:12.787322 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:14:12.789150 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/67d79fd58c8740a78b9a8395fd05475f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_67d79fd58c8740a78b9a8395fd05475f", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/67d79fd58c8740a78b9a8395fd05475f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/67d79fd58c8740a78b9a8395fd05475f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:14:12.789150 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersAdminNegativeTestJSON-126741515 Aug 22 17:14:12.789150 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 67d79fd58c8740a78b9a8395fd05475f Aug 22 17:14:12.789150 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-126741515 Aug 22 17:14:12.789150 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersAdminNegativeTestJSON-126741515-project-admin Aug 22 17:14:12.789150 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:14:12.789150 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:14:12.789150 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 33ef6c5c41d64d1eac6e6f1290110bff Aug 22 17:14:12.789150 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersAdminNegativeTestJSON-126741515-project-admin Aug 22 17:14:12.789150 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:14:12.789150 n-d-854030-1 devstack@n-api.service[123015]: {"os-resetState": {"state": 1}} Aug 22 17:14:12.789150 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:14:12.789150 n-d-854030-1 devstack@n-api.service[123015]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '0cde06f3-062c-470d-995f-51b1b2136a14', 'body': {'os-resetState': {'state': 1}}} Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 1 Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:14:12.789964 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:14:12.791302 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:12.791302 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:12.791302 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:14:12.791302 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:14:12.791302 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:14:12.791302 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:14:12.791302 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:14:12.791302 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:14:12.791302 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 22 17:14:12.791302 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.791302 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:12.791302 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.791302 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:12.791302 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:12.791302 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:12.791302 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:14:12.791302 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:14:12.791302 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 22 17:14:12.791302 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.792501 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0df5a136-7eba-41dc-822d-f2f93b2216fa tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:14:12.792501 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0df5a136-7eba-41dc-822d-f2f93b2216fa tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14/action" status: 400 len: 120 microversion: 2.1 time: 0.009810 Aug 22 17:14:12.792501 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 373/705] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:14:12 2022] POST /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14/action => generated 120 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:14:12.800577 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-05d78c6a-2bd5-4baa-b6d5-407279f59044 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:12.802795 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-05d78c6a-2bd5-4baa-b6d5-407279f59044 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Failed to fetch instance by id 999 {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 22 17:14:12.803313 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-05d78c6a-2bd5-4baa-b6d5-407279f59044 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-05d78c6a-2bd5-4baa-b6d5-407279f59044 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Request method failure captured: Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 37 Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7kwS5fTDXijSbcaGZOVoKd1Ycg_XTAWlVIViX5X9Xcd62h-mq5g4Sn3S17RwZuWWpvTEOnVL3xHfd8N7K4FQNJYgzVpDLmN7bBs_AZSI0mDEFe6xFaf2aAvwbD1niUCbp4rKq-_5RzfyCAlOyDSTjVqqkjGlNuueFiCfXozldN6MxM Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 67d79fd58c8740a78b9a8395fd05475f Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-126741515 Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:14:12.805013 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:14:12.806354 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/67d79fd58c8740a78b9a8395fd05475f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_67d79fd58c8740a78b9a8395fd05475f", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/67d79fd58c8740a78b9a8395fd05475f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/67d79fd58c8740a78b9a8395fd05475f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:14:12.806354 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersAdminNegativeTestJSON-126741515 Aug 22 17:14:12.806354 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 67d79fd58c8740a78b9a8395fd05475f Aug 22 17:14:12.806354 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-126741515 Aug 22 17:14:12.806354 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersAdminNegativeTestJSON-126741515-project-admin Aug 22 17:14:12.806354 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:14:12.806354 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:14:12.806354 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 33ef6c5c41d64d1eac6e6f1290110bff Aug 22 17:14:12.806354 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersAdminNegativeTestJSON-126741515-project-admin Aug 22 17:14:12.806354 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:14:12.806354 n-d-854030-1 devstack@n-api.service[123015]: {"os-resetState": {"state": "error"}} Aug 22 17:14:12.806354 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:14:12.806354 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance 999 could not be found. Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:12.807230 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 22 17:14:12.808576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 22 17:14:12.808576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:14:12.808576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:14:12.808576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 22 17:14:12.808576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.808576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:12.808576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.808576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:12.808576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:12.808576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:12.808576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:14:12.808576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:14:12.808576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 22 17:14:12.808576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:12.808576 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-05d78c6a-2bd5-4baa-b6d5-407279f59044 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:14:12.808576 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-05d78c6a-2bd5-4baa-b6d5-407279f59044 tempest-ServersAdminNegativeTestJSON-126741515 tempest-ServersAdminNegativeTestJSON-126741515-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.010341 Aug 22 17:14:12.810836 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 374/706] 10.222.0.96 () {60 vars in 1179 bytes} [Mon Aug 22 17:14:12 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 22 17:14:12.818668 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d2b50fcb-dee3-4727-a212-191d15429d9e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:12.819330 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d2b50fcb-dee3-4727-a212-191d15429d9e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:12.829903 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d2b50fcb-dee3-4727-a212-191d15429d9e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:12.830645 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d2b50fcb-dee3-4727-a212-191d15429d9e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:12.831180 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d2b50fcb-dee3-4727-a212-191d15429d9e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:12.832107 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d2b50fcb-dee3-4727-a212-191d15429d9e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:12.832639 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d2b50fcb-dee3-4727-a212-191d15429d9e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:12.833167 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d2b50fcb-dee3-4727-a212-191d15429d9e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:12.864604 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d2b50fcb-dee3-4727-a212-191d15429d9e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Going to try to terminate instance {{(pid=123015) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:14:12.945644 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-cda28bf5-15c6-4543-9ce3-e7969b97d4d1 tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] 10.222.0.96 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.335466 Aug 22 17:14:12.946228 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 333/707] 10.222.0.96 () {58 vars in 1164 bytes} [Mon Aug 22 17:14:12 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:14:12.962732 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-71fa058d-c39b-4577-b4d6-f117b6d211ba tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] Calling method '.version_select at 0x7f8009afcd30>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:13.205245 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d2b50fcb-dee3-4727-a212-191d15429d9e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "DELETE /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 204 len: 0 microversion: 2.1 time: 0.388016 Aug 22 17:14:13.205245 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 375/708] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:14:12 2022] DELETE /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 17:14:13.212679 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9b014ce4-3885-4514-b6c8-189e03a793dc tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:13.215775 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9b014ce4-3885-4514-b6c8-189e03a793dc tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:13.244209 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b014ce4-3885-4514-b6c8-189e03a793dc tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:13.244209 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b014ce4-3885-4514-b6c8-189e03a793dc tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:13.244209 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b014ce4-3885-4514-b6c8-189e03a793dc tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:13.244209 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b014ce4-3885-4514-b6c8-189e03a793dc tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:13.244673 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b014ce4-3885-4514-b6c8-189e03a793dc tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:13.244673 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b014ce4-3885-4514-b6c8-189e03a793dc tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:13.535836 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9b014ce4-3885-4514-b6c8-189e03a793dc tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:13.545814 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9b014ce4-3885-4514-b6c8-189e03a793dc tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 200 len: 1468 microversion: 2.1 time: 0.337509 Aug 22 17:14:13.548739 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 376/709] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:13 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 1468 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:13.825069 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5065086f-1490-41ea-b09d-642c9bb6b051 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Action: 'update', calling method: .version_select at 0x7f8009a6f940>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:13.828624 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:14:13.828624 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:14:13.836465 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5065086f-1490-41ea-b09d-642c9bb6b051 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:13.836465 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5065086f-1490-41ea-b09d-642c9bb6b051 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:13.836465 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5065086f-1490-41ea-b09d-642c9bb6b051 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:13.839580 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5065086f-1490-41ea-b09d-642c9bb6b051 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:13.840623 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5065086f-1490-41ea-b09d-642c9bb6b051 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:13.841277 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5065086f-1490-41ea-b09d-642c9bb6b051 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:13.848965 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-5065086f-1490-41ea-b09d-642c9bb6b051 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] HTTP exception thrown: Service 092cae45-a851-4a2a-a6a8-8eafebf9537b could not be found. Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5065086f-1490-41ea-b09d-642c9bb6b051 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Request method failure captured: Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: request: PUT /compute/v2.1/os-services/092cae45-a851-4a2a-a6a8-8eafebf9537b HTTP/1.1 Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 56 Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7ll5m3AMT0ntc9BZJkhs1eaopYMIm4Dt1U7h79rS7j9akamtZaMr5I0XSbPhEdp_BEpx5L5C1VJYvUD582MFmBBE5OcLPbgtnaWdvX5aYn6JjiMyF-plP1GgnhjC0mrn45L9daG9HRk4yKJcqI0BVCAqNv-PjUAP9oNDnw8UCSSY7U Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: X-Openstack-Nova-Api-Version: 2.53 Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 2a7717fc2a7b4881918414ed3e4e2e01 Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2074267373 Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:14:13.850869 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:14:13.852622 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/2a7717fc2a7b4881918414ed3e4e2e01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_2a7717fc2a7b4881918414ed3e4e2e01", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/2a7717fc2a7b4881918414ed3e4e2e01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/2a7717fc2a7b4881918414ed3e4e2e01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:14:13.852622 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2074267373 Aug 22 17:14:13.852622 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 2a7717fc2a7b4881918414ed3e4e2e01 Aug 22 17:14:13.852622 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2074267373 Aug 22 17:14:13.852622 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin Aug 22 17:14:13.852622 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:14:13.852622 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:14:13.852622 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: bf29bfcb664440ad86d8310eef578cca Aug 22 17:14:13.852622 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin Aug 22 17:14:13.852622 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:14:13.852622 n-d-854030-1 devstack@n-api.service[123015]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 22 17:14:13.852622 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:14:13.852622 n-d-854030-1 devstack@n-api.service[123015]: exception: Service 092cae45-a851-4a2a-a6a8-8eafebf9537b could not be found. Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '092cae45-a851-4a2a-a6a8-8eafebf9537b', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 092cae45-a851-4a2a-a6a8-8eafebf9537b could not be found. Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:13.853614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 092cae45-a851-4a2a-a6a8-8eafebf9537b could not be found. Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:13.855096 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:14:13.866357 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:14:13.866357 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 092cae45-a851-4a2a-a6a8-8eafebf9537b could not be found. Aug 22 17:14:13.866357 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:13.866357 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5065086f-1490-41ea-b09d-642c9bb6b051 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Returning 404 to user: Service 092cae45-a851-4a2a-a6a8-8eafebf9537b could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:14:13.866357 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5065086f-1490-41ea-b09d-642c9bb6b051 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-services/092cae45-a851-4a2a-a6a8-8eafebf9537b" status: 404 len: 110 microversion: 2.53 time: 0.237591 Aug 22 17:14:13.866357 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 377/710] 10.222.0.96 () {62 vars in 1309 bytes} [Mon Aug 22 17:14:13 2022] PUT /compute/v2.1/os-services/092cae45-a851-4a2a-a6a8-8eafebf9537b => generated 110 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 22 17:14:13.866357 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9b32784d-9de1-4515-955a-59df6a643e70 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:13.866887 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9b32784d-9de1-4515-955a-59df6a643e70 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:13.870448 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b32784d-9de1-4515-955a-59df6a643e70 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:13.870931 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b32784d-9de1-4515-955a-59df6a643e70 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:13.871496 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b32784d-9de1-4515-955a-59df6a643e70 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:13.872580 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b32784d-9de1-4515-955a-59df6a643e70 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:13.873038 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b32784d-9de1-4515-955a-59df6a643e70 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:13.873491 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b32784d-9de1-4515-955a-59df6a643e70 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:13.941926 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9b32784d-9de1-4515-955a-59df6a643e70 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:13.949565 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9b32784d-9de1-4515-955a-59df6a643e70 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 200 len: 1271 microversion: 2.1 time: 0.089226 Aug 22 17:14:13.950957 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 378/711] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:13 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:13.955721 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d7072369-17e3-44db-a01e-7b32333f120c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:13.956324 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d7072369-17e3-44db-a01e-7b32333f120c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:13.982878 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-71fa058d-c39b-4577-b4d6-f117b6d211ba tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] 10.222.0.96 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 1.026086 Aug 22 17:14:13.983562 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 334/712] 10.222.0.96 () {58 vars in 1149 bytes} [Mon Aug 22 17:14:12 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:13.991367 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f052ded3-bdd0-40fb-bb41-1ab2718dacc5 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Action: 'update', calling method: .version_select at 0x7f8009afc4c0>, body: {"status": "disabled"} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:13.997955 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:14:13.997955 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:14:13.999957 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f052ded3-bdd0-40fb-bb41-1ab2718dacc5 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:14.006161 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f052ded3-bdd0-40fb-bb41-1ab2718dacc5 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:14.006876 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f052ded3-bdd0-40fb-bb41-1ab2718dacc5 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:14.018827 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f052ded3-bdd0-40fb-bb41-1ab2718dacc5 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:14.019564 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f052ded3-bdd0-40fb-bb41-1ab2718dacc5 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:14.020371 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f052ded3-bdd0-40fb-bb41-1ab2718dacc5 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:14.027893 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d7072369-17e3-44db-a01e-7b32333f120c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:14.035311 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-f052ded3-bdd0-40fb-bb41-1ab2718dacc5 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] HTTP exception thrown: Service 092cae45-a851-4a2a-a6a8-8eafebf9537b could not be found. Aug 22 17:14:14.036430 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d7072369-17e3-44db-a01e-7b32333f120c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1217 microversion: 2.1 time: 0.084468 Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f052ded3-bdd0-40fb-bb41-1ab2718dacc5 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Request method failure captured: Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: request: PUT /compute/v2.1/os-services/092cae45-a851-4a2a-a6a8-8eafebf9537b HTTP/1.1 Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 22 Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7ll5m3AMT0ntc9BZJkhs1eaopYMIm4Dt1U7h79rS7j9akamtZaMr5I0XSbPhEdp_BEpx5L5C1VJYvUD582MFmBBE5OcLPbgtnaWdvX5aYn6JjiMyF-plP1GgnhjC0mrn45L9daG9HRk4yKJcqI0BVCAqNv-PjUAP9oNDnw8UCSSY7U Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: X-Openstack-Nova-Api-Version: 2.53 Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 2a7717fc2a7b4881918414ed3e4e2e01 Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2074267373 Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:14:14.038281 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:14:14.039906 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/2a7717fc2a7b4881918414ed3e4e2e01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_2a7717fc2a7b4881918414ed3e4e2e01", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/2a7717fc2a7b4881918414ed3e4e2e01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/2a7717fc2a7b4881918414ed3e4e2e01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:14:14.039906 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2074267373 Aug 22 17:14:14.039906 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 2a7717fc2a7b4881918414ed3e4e2e01 Aug 22 17:14:14.039906 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2074267373 Aug 22 17:14:14.039906 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin Aug 22 17:14:14.039906 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:14:14.039906 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:14:14.039906 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: bf29bfcb664440ad86d8310eef578cca Aug 22 17:14:14.039906 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin Aug 22 17:14:14.039906 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:14:14.039906 n-d-854030-1 devstack@n-api.service[123016]: {"status": "disabled"} Aug 22 17:14:14.039906 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:14:14.039906 n-d-854030-1 devstack@n-api.service[123016]: exception: Service 092cae45-a851-4a2a-a6a8-8eafebf9537b could not be found. Aug 22 17:14:14.039906 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '092cae45-a851-4a2a-a6a8-8eafebf9537b', 'body': {'status': 'disabled'}} Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 092cae45-a851-4a2a-a6a8-8eafebf9537b could not be found. Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:14.040777 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 092cae45-a851-4a2a-a6a8-8eafebf9537b could not be found. Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:14:14.042066 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:14:14.045835 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 092cae45-a851-4a2a-a6a8-8eafebf9537b could not be found. Aug 22 17:14:14.045835 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:14.050878 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 379/713] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:13 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:14.053984 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f052ded3-bdd0-40fb-bb41-1ab2718dacc5 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Returning 404 to user: Service 092cae45-a851-4a2a-a6a8-8eafebf9537b could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:14:14.061388 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f052ded3-bdd0-40fb-bb41-1ab2718dacc5 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-services/092cae45-a851-4a2a-a6a8-8eafebf9537b" status: 404 len: 110 microversion: 2.53 time: 0.068546 Aug 22 17:14:14.061527 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-01474952-6582-4720-82de-cf9af053439d tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] Calling method '.version_select at 0x7f8009d1df70>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:14.061624 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 335/714] 10.222.0.96 () {62 vars in 1309 bytes} [Mon Aug 22 17:14:13 2022] PUT /compute/v2.1/os-services/092cae45-a851-4a2a-a6a8-8eafebf9537b => generated 110 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:14:14.072499 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f700035c-9051-4424-8247-1ff2dc689282 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Action: 'update', calling method: .version_select at 0x7f8009a7c790>, body: {"status": "enabled"} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:14.077505 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f700035c-9051-4424-8247-1ff2dc689282 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:14.078113 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f700035c-9051-4424-8247-1ff2dc689282 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:14.078794 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f700035c-9051-4424-8247-1ff2dc689282 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:14.085629 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f700035c-9051-4424-8247-1ff2dc689282 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:14.086451 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f700035c-9051-4424-8247-1ff2dc689282 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:14.087157 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f700035c-9051-4424-8247-1ff2dc689282 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:14.092564 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-f700035c-9051-4424-8247-1ff2dc689282 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] HTTP exception thrown: Service 092cae45-a851-4a2a-a6a8-8eafebf9537b could not be found. Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f700035c-9051-4424-8247-1ff2dc689282 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Request method failure captured: Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: request: PUT /compute/v2.1/os-services/092cae45-a851-4a2a-a6a8-8eafebf9537b HTTP/1.1 Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 21 Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7ll5m3AMT0ntc9BZJkhs1eaopYMIm4Dt1U7h79rS7j9akamtZaMr5I0XSbPhEdp_BEpx5L5C1VJYvUD582MFmBBE5OcLPbgtnaWdvX5aYn6JjiMyF-plP1GgnhjC0mrn45L9daG9HRk4yKJcqI0BVCAqNv-PjUAP9oNDnw8UCSSY7U Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: X-Openstack-Nova-Api-Version: 2.53 Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 2a7717fc2a7b4881918414ed3e4e2e01 Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2074267373 Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:14:14.095826 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:14:14.097452 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/2a7717fc2a7b4881918414ed3e4e2e01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_2a7717fc2a7b4881918414ed3e4e2e01", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/2a7717fc2a7b4881918414ed3e4e2e01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/2a7717fc2a7b4881918414ed3e4e2e01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:14:14.097452 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2074267373 Aug 22 17:14:14.097452 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 2a7717fc2a7b4881918414ed3e4e2e01 Aug 22 17:14:14.097452 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2074267373 Aug 22 17:14:14.097452 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin Aug 22 17:14:14.097452 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:14:14.097452 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:14:14.097452 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: bf29bfcb664440ad86d8310eef578cca Aug 22 17:14:14.097452 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin Aug 22 17:14:14.097452 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:14:14.097452 n-d-854030-1 devstack@n-api.service[123016]: {"status": "enabled"} Aug 22 17:14:14.097452 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:14:14.097452 n-d-854030-1 devstack@n-api.service[123016]: exception: Service 092cae45-a851-4a2a-a6a8-8eafebf9537b could not be found. Aug 22 17:14:14.097452 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '092cae45-a851-4a2a-a6a8-8eafebf9537b', 'body': {'status': 'enabled'}} Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 092cae45-a851-4a2a-a6a8-8eafebf9537b could not be found. Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:14.098299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 092cae45-a851-4a2a-a6a8-8eafebf9537b could not be found. Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:14:14.099671 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:14:14.100871 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 092cae45-a851-4a2a-a6a8-8eafebf9537b could not be found. Aug 22 17:14:14.100871 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:14.100871 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f700035c-9051-4424-8247-1ff2dc689282 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Returning 404 to user: Service 092cae45-a851-4a2a-a6a8-8eafebf9537b could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:14:14.102686 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f700035c-9051-4424-8247-1ff2dc689282 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-services/092cae45-a851-4a2a-a6a8-8eafebf9537b" status: 404 len: 110 microversion: 2.53 time: 0.029863 Aug 22 17:14:14.103568 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 336/715] 10.222.0.96 () {62 vars in 1309 bytes} [Mon Aug 22 17:14:14 2022] PUT /compute/v2.1/os-services/092cae45-a851-4a2a-a6a8-8eafebf9537b => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:14:14.113900 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-3e80e715-8808-4d59-b14c-f960b52af017 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:14.116654 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:14:14.116654 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:14:14.117836 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3e80e715-8808-4d59-b14c-f960b52af017 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:14.118315 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3e80e715-8808-4d59-b14c-f960b52af017 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:14.119101 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3e80e715-8808-4d59-b14c-f960b52af017 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:14.120074 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3e80e715-8808-4d59-b14c-f960b52af017 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:14.120658 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3e80e715-8808-4d59-b14c-f960b52af017 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:14.122273 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3e80e715-8808-4d59-b14c-f960b52af017 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:14.150889 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-3e80e715-8808-4d59-b14c-f960b52af017 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.040682 Aug 22 17:14:14.164807 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 337/716] 10.222.0.96 () {60 vars in 1178 bytes} [Mon Aug 22 17:14:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:14:14.171046 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-71c7d4d9-a0d8-43c9-b712-d2c14facea24 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:14.177045 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:14:14.177045 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:14:14.178696 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-71c7d4d9-a0d8-43c9-b712-d2c14facea24 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:14.179566 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-71c7d4d9-a0d8-43c9-b712-d2c14facea24 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:14.179716 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-71c7d4d9-a0d8-43c9-b712-d2c14facea24 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:14.180558 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-71c7d4d9-a0d8-43c9-b712-d2c14facea24 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:14.181168 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-71c7d4d9-a0d8-43c9-b712-d2c14facea24 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:14.181874 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-71c7d4d9-a0d8-43c9-b712-d2c14facea24 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:14.218279 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-71c7d4d9-a0d8-43c9-b712-d2c14facea24 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.051837 Aug 22 17:14:14.220040 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 338/717] 10.222.0.96 () {60 vars in 1211 bytes} [Mon Aug 22 17:14:14 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:14:14.236830 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5f1d275b-5ff8-4122-a435-2b461f7e9137 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:14.241827 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:14:14.241827 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:14:14.245046 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5f1d275b-5ff8-4122-a435-2b461f7e9137 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:14.245601 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5f1d275b-5ff8-4122-a435-2b461f7e9137 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:14.246361 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5f1d275b-5ff8-4122-a435-2b461f7e9137 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:14.247869 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5f1d275b-5ff8-4122-a435-2b461f7e9137 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:14.248698 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5f1d275b-5ff8-4122-a435-2b461f7e9137 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:14.249370 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5f1d275b-5ff8-4122-a435-2b461f7e9137 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:14.309504 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5f1d275b-5ff8-4122-a435-2b461f7e9137 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.080125 Aug 22 17:14:14.310452 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 339/718] 10.222.0.96 () {60 vars in 1178 bytes} [Mon Aug 22 17:14:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:14:14.322071 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c6254932-0ece-4f2a-8533-5b5fa3ea1086 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:14.325822 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:14:14.325822 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:14:14.326693 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c6254932-0ece-4f2a-8533-5b5fa3ea1086 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:14.327327 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c6254932-0ece-4f2a-8533-5b5fa3ea1086 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:14.327772 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c6254932-0ece-4f2a-8533-5b5fa3ea1086 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:14.328505 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c6254932-0ece-4f2a-8533-5b5fa3ea1086 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:14.328958 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c6254932-0ece-4f2a-8533-5b5fa3ea1086 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:14.329480 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c6254932-0ece-4f2a-8533-5b5fa3ea1086 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:14.357354 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c6254932-0ece-4f2a-8533-5b5fa3ea1086 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] 10.222.0.96 "GET /compute/v2.1/os-services?host=n-d-854030-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.038908 Aug 22 17:14:14.358112 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 340/719] 10.222.0.96 () {60 vars in 1235 bytes} [Mon Aug 22 17:14:14 2022] GET /compute/v2.1/os-services?host=n-d-854030-1&binary=xxx => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:14:14.370376 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6d9df487-3047-4ede-9d4f-d23a4988499a tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:14.373529 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:14:14.373529 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:14:14.375066 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6d9df487-3047-4ede-9d4f-d23a4988499a tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:14.375901 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6d9df487-3047-4ede-9d4f-d23a4988499a tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:14.376630 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6d9df487-3047-4ede-9d4f-d23a4988499a tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:14.377648 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6d9df487-3047-4ede-9d4f-d23a4988499a tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:14.378330 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6d9df487-3047-4ede-9d4f-d23a4988499a tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:14.378990 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6d9df487-3047-4ede-9d4f-d23a4988499a tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:14.405406 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-6d9df487-3047-4ede-9d4f-d23a4988499a tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.038856 Aug 22 17:14:14.406729 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 341/720] 10.222.0.96 () {60 vars in 1178 bytes} [Mon Aug 22 17:14:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:14:14.418887 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e7109de9-5342-4021-8d87-8cc6b8591842 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:14.421515 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:14:14.421515 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:14:14.422707 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e7109de9-5342-4021-8d87-8cc6b8591842 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:14.423198 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e7109de9-5342-4021-8d87-8cc6b8591842 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:14.424448 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e7109de9-5342-4021-8d87-8cc6b8591842 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:14.424448 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e7109de9-5342-4021-8d87-8cc6b8591842 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:14.424813 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e7109de9-5342-4021-8d87-8cc6b8591842 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:14.425372 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e7109de9-5342-4021-8d87-8cc6b8591842 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:14.449046 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e7109de9-5342-4021-8d87-8cc6b8591842 tempest-ServicesAdminNegativeV253TestJSON-2074267373 tempest-ServicesAdminNegativeV253TestJSON-2074267373-project-admin] 10.222.0.96 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.034254 Aug 22 17:14:14.450610 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 342/721] 10.222.0.96 () {60 vars in 1239 bytes} [Mon Aug 22 17:14:14 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:14:14.711636 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-73e8a4d4-1ba7-4cf1-806e-10200856c07a tempest-ServicesAdminNegativeV253TestJSON-498002423 tempest-ServicesAdminNegativeV253TestJSON-498002423-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:14.714105 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:14:14.714105 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-73e8a4d4-1ba7-4cf1-806e-10200856c07a tempest-ServicesAdminNegativeV253TestJSON-498002423 tempest-ServicesAdminNegativeV253TestJSON-498002423-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '69182de95ca740399d659c4528740bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6d2223c6a0408e8dd3fcedb6436b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-73e8a4d4-1ba7-4cf1-806e-10200856c07a tempest-ServicesAdminNegativeV253TestJSON-498002423 tempest-ServicesAdminNegativeV253TestJSON-498002423-project] Request method failure captured: Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7ljMackwklrlLM8OhciJ3HmaQ4jGLolgkTJLhp4fYvEH7WPwy92vmiyM2Qp1AOZQyB3D1cPimvr7XGJBvWPAKLc75Knhyhy996iiDtiXURBqjuDWaVR1i6z2gLcc-chEa7lGDZWm_1X2pIU_MKzcSIkabKk8cnur0_k3Jp9RAnVy-s Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: X-Openstack-Nova-Api-Version: 2.53 Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 8c6d2223c6a0408e8dd3fcedb6436b5b Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-498002423 Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:14:14.719310 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:14:14.720736 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8c6d2223c6a0408e8dd3fcedb6436b5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_8c6d2223c6a0408e8dd3fcedb6436b5b", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8c6d2223c6a0408e8dd3fcedb6436b5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/8c6d2223c6a0408e8dd3fcedb6436b5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:14:14.720736 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-498002423 Aug 22 17:14:14.720736 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 8c6d2223c6a0408e8dd3fcedb6436b5b Aug 22 17:14:14.720736 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-498002423 Aug 22 17:14:14.720736 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServicesAdminNegativeV253TestJSON-498002423-project Aug 22 17:14:14.720736 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:14:14.720736 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:14:14.720736 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 69182de95ca740399d659c4528740bb7 Aug 22 17:14:14.720736 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-498002423-project Aug 22 17:14:14.720736 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:14:14.720736 n-d-854030-1 devstack@n-api.service[123016]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 22 17:14:14.720736 n-d-854030-1 devstack@n-api.service[123016]: action_args: {} Aug 22 17:14:14.721570 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:14:14.721570 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:14.721570 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:14.721570 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:14.721570 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:14:14.721570 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:14:14.721570 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 17:14:14.721570 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:14.721570 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 17:14:14.721570 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:14.721570 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:14.721570 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:14.721570 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 22 17:14:14.721570 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 22 17:14:14.721570 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 22 17:14:14.721570 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 22 17:14:14.721570 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 22 17:14:14.721570 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 22 17:14:14.721570 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 22 17:14:14.724402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:14:14.725715 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-73e8a4d4-1ba7-4cf1-806e-10200856c07a tempest-ServicesAdminNegativeV253TestJSON-498002423 tempest-ServicesAdminNegativeV253TestJSON-498002423-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:14:14.725715 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-73e8a4d4-1ba7-4cf1-806e-10200856c07a tempest-ServicesAdminNegativeV253TestJSON-498002423 tempest-ServicesAdminNegativeV253TestJSON-498002423-project] 10.222.0.96 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.259731 Aug 22 17:14:14.726394 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 343/722] 10.222.0.96 () {60 vars in 1178 bytes} [Mon Aug 22 17:14:14 2022] GET /compute/v2.1/os-services => generated 112 bytes in 268 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:14:14.731819 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-20401e0e-1605-4342-ae9b-b228f392aa8e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:14.732673 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-20401e0e-1605-4342-ae9b-b228f392aa8e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:14.740792 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-20401e0e-1605-4342-ae9b-b228f392aa8e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:14.741688 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-20401e0e-1605-4342-ae9b-b228f392aa8e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:14.742369 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-20401e0e-1605-4342-ae9b-b228f392aa8e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:14.743084 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-20401e0e-1605-4342-ae9b-b228f392aa8e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:14.743534 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-20401e0e-1605-4342-ae9b-b228f392aa8e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:14.744235 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-20401e0e-1605-4342-ae9b-b228f392aa8e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:15.307783 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-20401e0e-1605-4342-ae9b-b228f392aa8e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:15.325508 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-20401e0e-1605-4342-ae9b-b228f392aa8e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 200 len: 1468 microversion: 2.1 time: 0.593003 Aug 22 17:14:15.326065 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 344/723] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:14 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 1468 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:15.333176 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b3db11bd-6266-41b5-b838-9afc97504815 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:15.334482 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b3db11bd-6266-41b5-b838-9afc97504815 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:15.346484 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b3db11bd-6266-41b5-b838-9afc97504815 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:15.347889 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b3db11bd-6266-41b5-b838-9afc97504815 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:15.348854 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b3db11bd-6266-41b5-b838-9afc97504815 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:15.349919 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b3db11bd-6266-41b5-b838-9afc97504815 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:15.351143 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b3db11bd-6266-41b5-b838-9afc97504815 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:15.355379 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b3db11bd-6266-41b5-b838-9afc97504815 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:15.484669 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-01474952-6582-4720-82de-cf9af053439d tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] 10.222.0.96 "DELETE /compute/v2.1/os-floating-ips/87b3ba70-6a15-443b-8dfd-5ac52ead3417" status: 202 len: 0 microversion: 2.1 time: 1.433548 Aug 22 17:14:15.486687 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 380/724] 10.222.0.96 () {58 vars in 1263 bytes} [Mon Aug 22 17:14:14 2022] DELETE /compute/v2.1/os-floating-ips/87b3ba70-6a15-443b-8dfd-5ac52ead3417 => generated 0 bytes in 1436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:14:15.495279 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0d9d29d9-6277-4c09-adcb-1360e752bfb9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:15.496460 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0d9d29d9-6277-4c09-adcb-1360e752bfb9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:15.513525 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0d9d29d9-6277-4c09-adcb-1360e752bfb9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:15.518561 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0d9d29d9-6277-4c09-adcb-1360e752bfb9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:15.522420 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0d9d29d9-6277-4c09-adcb-1360e752bfb9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:15.523464 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0d9d29d9-6277-4c09-adcb-1360e752bfb9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:15.524115 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0d9d29d9-6277-4c09-adcb-1360e752bfb9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:15.524850 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0d9d29d9-6277-4c09-adcb-1360e752bfb9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:15.647328 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0d9d29d9-6277-4c09-adcb-1360e752bfb9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:15.661745 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0d9d29d9-6277-4c09-adcb-1360e752bfb9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1269 microversion: 2.1 time: 0.172997 Aug 22 17:14:15.663937 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 381/725] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:15 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1269 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:15.671422 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d801622e-ec04-4a69-9e4f-d2cf80eb4927 tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] Calling method '.version_select at 0x7f8009b31ee0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:16.244578 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b3db11bd-6266-41b5-b838-9afc97504815 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:16.256263 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b3db11bd-6266-41b5-b838-9afc97504815 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 200 len: 1313 microversion: 2.1 time: 0.928633 Aug 22 17:14:16.257397 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 345/726] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:15 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 1313 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:16.350073 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-08f9a41a-0cdf-48eb-8eb6-a26261e9c601 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:16.356742 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-08f9a41a-0cdf-48eb-8eb6-a26261e9c601 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:16.364724 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08f9a41a-0cdf-48eb-8eb6-a26261e9c601 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:16.366249 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08f9a41a-0cdf-48eb-8eb6-a26261e9c601 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:16.366966 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08f9a41a-0cdf-48eb-8eb6-a26261e9c601 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:16.370174 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08f9a41a-0cdf-48eb-8eb6-a26261e9c601 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:16.371900 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08f9a41a-0cdf-48eb-8eb6-a26261e9c601 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:16.372643 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08f9a41a-0cdf-48eb-8eb6-a26261e9c601 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:16.943091 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-08f9a41a-0cdf-48eb-8eb6-a26261e9c601 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:16.952258 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-08f9a41a-0cdf-48eb-8eb6-a26261e9c601 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 200 len: 1468 microversion: 2.1 time: 0.608628 Aug 22 17:14:16.969349 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 346/727] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:16 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 1468 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:16.998506 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f3934c36-abf7-48f0-b4e0-bfcad91a8df3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:16.999421 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-f3934c36-abf7-48f0-b4e0-bfcad91a8df3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:17.020838 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f3934c36-abf7-48f0-b4e0-bfcad91a8df3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:17.033127 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f3934c36-abf7-48f0-b4e0-bfcad91a8df3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:17.069116 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f3934c36-abf7-48f0-b4e0-bfcad91a8df3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:17.072553 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f3934c36-abf7-48f0-b4e0-bfcad91a8df3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:17.073194 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f3934c36-abf7-48f0-b4e0-bfcad91a8df3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:17.073632 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f3934c36-abf7-48f0-b4e0-bfcad91a8df3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:17.291171 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-f3934c36-abf7-48f0-b4e0-bfcad91a8df3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:17.306201 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f3934c36-abf7-48f0-b4e0-bfcad91a8df3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1275 microversion: 2.1 time: 0.334429 Aug 22 17:14:17.307377 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 347/728] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:16 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1275 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:17.318892 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6ed9ba0a-32c5-4b7c-9c86-fad5161e5695 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:17.321305 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-6ed9ba0a-32c5-4b7c-9c86-fad5161e5695 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:17.334797 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ed9ba0a-32c5-4b7c-9c86-fad5161e5695 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:17.337814 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ed9ba0a-32c5-4b7c-9c86-fad5161e5695 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:17.338514 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ed9ba0a-32c5-4b7c-9c86-fad5161e5695 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:17.341836 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ed9ba0a-32c5-4b7c-9c86-fad5161e5695 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:17.342599 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ed9ba0a-32c5-4b7c-9c86-fad5161e5695 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:17.344611 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ed9ba0a-32c5-4b7c-9c86-fad5161e5695 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:17.703097 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-6ed9ba0a-32c5-4b7c-9c86-fad5161e5695 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:17.710175 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-6ed9ba0a-32c5-4b7c-9c86-fad5161e5695 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 200 len: 1313 microversion: 2.1 time: 0.399907 Aug 22 17:14:17.711648 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 348/729] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:17 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:17.728538 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-6f9c771c-0748-4d6e-8cc7-ec73e5340980 req-5a15928a-6678-4237-887b-442db31f8678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2320d5b-5a26-4a82-810e-8f00c00486f5", "name": "network-vif-deleted", "tag": "ccdc9250-f83e-4d21-ac2f-ed4e207f94f7"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:17.739772 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-6f9c771c-0748-4d6e-8cc7-ec73e5340980 req-5a15928a-6678-4237-887b-442db31f8678 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:17.740394 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-6f9c771c-0748-4d6e-8cc7-ec73e5340980 req-5a15928a-6678-4237-887b-442db31f8678 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:17.740946 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-6f9c771c-0748-4d6e-8cc7-ec73e5340980 req-5a15928a-6678-4237-887b-442db31f8678 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:17.774864 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-6f9c771c-0748-4d6e-8cc7-ec73e5340980 req-5a15928a-6678-4237-887b-442db31f8678 service nova] Creating event network-vif-deleted:ccdc9250-f83e-4d21-ac2f-ed4e207f94f7 for instance a2320d5b-5a26-4a82-810e-8f00c00486f5 on n-h1-854030-1 Aug 22 17:14:17.781957 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-6f9c771c-0748-4d6e-8cc7-ec73e5340980 req-5a15928a-6678-4237-887b-442db31f8678 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068513 Aug 22 17:14:17.782894 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 349/730] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:18.000438 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-45a09d2c-eb08-494e-ac07-bf20d55fb1f1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:18.001412 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-45a09d2c-eb08-494e-ac07-bf20d55fb1f1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:18.017071 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45a09d2c-eb08-494e-ac07-bf20d55fb1f1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:18.017597 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45a09d2c-eb08-494e-ac07-bf20d55fb1f1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:18.018036 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45a09d2c-eb08-494e-ac07-bf20d55fb1f1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:18.018748 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45a09d2c-eb08-494e-ac07-bf20d55fb1f1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:18.019211 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45a09d2c-eb08-494e-ac07-bf20d55fb1f1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:18.019633 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45a09d2c-eb08-494e-ac07-bf20d55fb1f1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:18.101437 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45a09d2c-eb08-494e-ac07-bf20d55fb1f1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:18.105997 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45a09d2c-eb08-494e-ac07-bf20d55fb1f1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:18.109289 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45a09d2c-eb08-494e-ac07-bf20d55fb1f1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:18.109289 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-45a09d2c-eb08-494e-ac07-bf20d55fb1f1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lazy-loading 'fault' on Instance uuid a2320d5b-5a26-4a82-810e-8f00c00486f5 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:14:18.365574 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-45a09d2c-eb08-494e-ac07-bf20d55fb1f1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:18.382095 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-45a09d2c-eb08-494e-ac07-bf20d55fb1f1 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 200 len: 1311 microversion: 2.1 time: 0.388218 Aug 22 17:14:18.389955 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 350/731] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:17 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 1311 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:14:18.413766 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-39d92733-f957-4699-a880-4e0b2f31e3b1 req-5260ca87-f83a-45d6-92f7-4d746ee4d230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30fb117d-2950-4ba7-98a0-fd8874ad006c", "tag": "10a64f19-cca9-4d20-a741-bd1661b9f4ba"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:18.445262 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-39d92733-f957-4699-a880-4e0b2f31e3b1 req-5260ca87-f83a-45d6-92f7-4d746ee4d230 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:18.446328 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-39d92733-f957-4699-a880-4e0b2f31e3b1 req-5260ca87-f83a-45d6-92f7-4d746ee4d230 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:18.447020 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-39d92733-f957-4699-a880-4e0b2f31e3b1 req-5260ca87-f83a-45d6-92f7-4d746ee4d230 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:18.481762 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-39d92733-f957-4699-a880-4e0b2f31e3b1 req-5260ca87-f83a-45d6-92f7-4d746ee4d230 service nova] Creating event network-changed:10a64f19-cca9-4d20-a741-bd1661b9f4ba for instance 30fb117d-2950-4ba7-98a0-fd8874ad006c on n-h1-854030-1 Aug 22 17:14:18.490081 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d801622e-ec04-4a69-9e4f-d2cf80eb4927 tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] 10.222.0.96 "DELETE /compute/v2.1/os-floating-ips/8f406045-d2a2-4ad0-8283-ad3377ea633d" status: 202 len: 0 microversion: 2.1 time: 2.824598 Aug 22 17:14:18.491553 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 382/732] 10.222.0.96 () {58 vars in 1263 bytes} [Mon Aug 22 17:14:15 2022] DELETE /compute/v2.1/os-floating-ips/8f406045-d2a2-4ad0-8283-ad3377ea633d => generated 0 bytes in 2827 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:14:18.498066 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d352eb55-757a-44a2-96cc-819691b6e25b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:18.498676 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d352eb55-757a-44a2-96cc-819691b6e25b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:18.506730 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-39d92733-f957-4699-a880-4e0b2f31e3b1 req-5260ca87-f83a-45d6-92f7-4d746ee4d230 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115007 Aug 22 17:14:18.513773 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 351/733] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:18.519185 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d352eb55-757a-44a2-96cc-819691b6e25b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:18.525937 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d352eb55-757a-44a2-96cc-819691b6e25b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:18.529968 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-affde443-cdc0-4c3e-a9d8-3459daaca396 tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] Calling method '.version_select at 0x7f8009bb1dc0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:18.531532 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d352eb55-757a-44a2-96cc-819691b6e25b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:18.534467 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d352eb55-757a-44a2-96cc-819691b6e25b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:18.535138 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d352eb55-757a-44a2-96cc-819691b6e25b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:18.535930 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d352eb55-757a-44a2-96cc-819691b6e25b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:18.683068 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d352eb55-757a-44a2-96cc-819691b6e25b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:18.702622 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d352eb55-757a-44a2-96cc-819691b6e25b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1275 microversion: 2.1 time: 0.205686 Aug 22 17:14:18.704493 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 383/734] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:18 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1275 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:18.744857 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a3b66f0f-2834-4bec-94f3-6b0fe416fca0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:18.745508 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a3b66f0f-2834-4bec-94f3-6b0fe416fca0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:18.757345 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a3b66f0f-2834-4bec-94f3-6b0fe416fca0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:18.759250 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a3b66f0f-2834-4bec-94f3-6b0fe416fca0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:18.760563 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a3b66f0f-2834-4bec-94f3-6b0fe416fca0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:18.762274 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a3b66f0f-2834-4bec-94f3-6b0fe416fca0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:18.763793 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a3b66f0f-2834-4bec-94f3-6b0fe416fca0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:18.764438 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a3b66f0f-2834-4bec-94f3-6b0fe416fca0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:19.095377 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=56 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:19.706223 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a3b66f0f-2834-4bec-94f3-6b0fe416fca0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:19.718693 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a3b66f0f-2834-4bec-94f3-6b0fe416fca0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 200 len: 1313 microversion: 2.1 time: 0.987654 Aug 22 17:14:19.722369 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 384/735] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:18 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 1313 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:19.731260 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8b209c00-b49e-4a8f-a52b-d5ca03b50855 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:19.734746 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8b209c00-b49e-4a8f-a52b-d5ca03b50855 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: a2320d5b-5a26-4a82-810e-8f00c00486f5] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:19.748802 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8b209c00-b49e-4a8f-a52b-d5ca03b50855 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:19.749399 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8b209c00-b49e-4a8f-a52b-d5ca03b50855 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:19.750179 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8b209c00-b49e-4a8f-a52b-d5ca03b50855 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:19.751099 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8b209c00-b49e-4a8f-a52b-d5ca03b50855 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:19.751784 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8b209c00-b49e-4a8f-a52b-d5ca03b50855 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:19.752371 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8b209c00-b49e-4a8f-a52b-d5ca03b50855 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:19.801965 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-8b209c00-b49e-4a8f-a52b-d5ca03b50855 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] HTTP exception thrown: Instance a2320d5b-5a26-4a82-810e-8f00c00486f5 could not be found. Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8b209c00-b49e-4a8f-a52b-d5ca03b50855 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Request method failure captured: Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 HTTP/1.1 Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7kuc6nYbN-XPsQ7ozlJP5QTMafMMejRJP9misDhJYgVAh3AgLrR_mVZmhyv9P_wQNm9TTc1z1vZkXSoPs2LwGrG2vE20_e38nDhmyUe28cdWKFWjpBlai6v-1YgAwOZQjevvTegk6SnnwOHsyCSwusoatVWHBxIdmhNeCJSIV7nZg8 Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: ffdd27bb05144d16aac5c3e39bc05a65 Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-526256208 Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:14:19.804301 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:14:19.806193 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ffdd27bb05144d16aac5c3e39bc05a65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_ffdd27bb05144d16aac5c3e39bc05a65", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ffdd27bb05144d16aac5c3e39bc05a65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/ffdd27bb05144d16aac5c3e39bc05a65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:14:19.806193 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersAdminNegativeTestJSON-526256208 Aug 22 17:14:19.806193 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: ffdd27bb05144d16aac5c3e39bc05a65 Aug 22 17:14:19.806193 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-526256208 Aug 22 17:14:19.806193 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersAdminNegativeTestJSON-526256208-project Aug 22 17:14:19.806193 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:14:19.806193 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:14:19.806193 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 9fd8e9807c9b44e1b83ac7bacbaf8599 Aug 22 17:14:19.806193 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersAdminNegativeTestJSON-526256208-project Aug 22 17:14:19.806193 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:14:19.806193 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance a2320d5b-5a26-4a82-810e-8f00c00486f5 could not be found. Aug 22 17:14:19.806193 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'a2320d5b-5a26-4a82-810e-8f00c00486f5'} Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2320d5b-5a26-4a82-810e-8f00c00486f5 could not be found. Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:14:19.807162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:19.808744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:19.808744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:14:19.808744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:14:19.808744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:14:19.808744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:14:19.808744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:14:19.808744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:14:19.808744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2320d5b-5a26-4a82-810e-8f00c00486f5 could not be found. Aug 22 17:14:19.808744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:19.808744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:19.808744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:19.808744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:19.808744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:19.808744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:19.808744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:14:19.808744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:14:19.808744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2320d5b-5a26-4a82-810e-8f00c00486f5 could not be found. Aug 22 17:14:19.808744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:19.812592 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8b209c00-b49e-4a8f-a52b-d5ca03b50855 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Returning 404 to user: Instance a2320d5b-5a26-4a82-810e-8f00c00486f5 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:14:19.814016 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8b209c00-b49e-4a8f-a52b-d5ca03b50855 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5" status: 404 len: 111 microversion: 2.1 time: 0.090220 Aug 22 17:14:19.818407 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 385/736] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:19 2022] GET /compute/v2.1/servers/a2320d5b-5a26-4a82-810e-8f00c00486f5 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:14:19.821773 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c693b041-2707-47ea-bba2-2c47731ae8ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:19.823121 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-c693b041-2707-47ea-bba2-2c47731ae8ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:19.845948 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c693b041-2707-47ea-bba2-2c47731ae8ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:19.846114 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c693b041-2707-47ea-bba2-2c47731ae8ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:19.846743 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c693b041-2707-47ea-bba2-2c47731ae8ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:19.851268 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c693b041-2707-47ea-bba2-2c47731ae8ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:19.851268 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c693b041-2707-47ea-bba2-2c47731ae8ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:19.851268 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c693b041-2707-47ea-bba2-2c47731ae8ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:20.274777 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c693b041-2707-47ea-bba2-2c47731ae8ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:20.292033 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c693b041-2707-47ea-bba2-2c47731ae8ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1317 microversion: 2.1 time: 0.473079 Aug 22 17:14:20.292869 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 386/737] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:19 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:20.305390 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1379c2e6-ff7d-4ee4-ab78-bff2e3703aea tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:20.308450 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-1379c2e6-ff7d-4ee4-ab78-bff2e3703aea tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:20.349692 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1379c2e6-ff7d-4ee4-ab78-bff2e3703aea tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:20.354977 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1379c2e6-ff7d-4ee4-ab78-bff2e3703aea tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:20.354977 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1379c2e6-ff7d-4ee4-ab78-bff2e3703aea tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:20.355562 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1379c2e6-ff7d-4ee4-ab78-bff2e3703aea tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:20.356156 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1379c2e6-ff7d-4ee4-ab78-bff2e3703aea tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:20.356802 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1379c2e6-ff7d-4ee4-ab78-bff2e3703aea tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:20.420201 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-1379c2e6-ff7d-4ee4-ab78-bff2e3703aea tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Going to try to terminate instance {{(pid=123015) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:14:20.984701 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1379c2e6-ff7d-4ee4-ab78-bff2e3703aea tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "DELETE /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 204 len: 0 microversion: 2.1 time: 0.688963 Aug 22 17:14:20.986138 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 387/738] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:14:20 2022] DELETE /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:14:21.256018 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-94af143b-718c-4954-9298-7258e9f04a0a tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1697659412", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:21.344281 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-94af143b-718c-4954-9298-7258e9f04a0a tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] validate_networks() for None {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:14:21.585716 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-affde443-cdc0-4c3e-a9d8-3459daaca396 tempest-FloatingIPDetailsTestJSON-1511920936 tempest-FloatingIPDetailsTestJSON-1511920936-project] 10.222.0.96 "DELETE /compute/v2.1/os-floating-ips/9a70b02f-c2fb-49b6-b9f2-23e95e0424ad" status: 202 len: 0 microversion: 2.1 time: 3.064501 Aug 22 17:14:21.587460 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 352/739] 10.222.0.96 () {58 vars in 1263 bytes} [Mon Aug 22 17:14:18 2022] DELETE /compute/v2.1/os-floating-ips/9a70b02f-c2fb-49b6-b9f2-23e95e0424ad => generated 0 bytes in 3073 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:14:21.592412 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-701a6199-673c-41c1-97ec-5ce57150bd8e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:21.593305 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-701a6199-673c-41c1-97ec-5ce57150bd8e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:21.608647 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-701a6199-673c-41c1-97ec-5ce57150bd8e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:21.610134 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-701a6199-673c-41c1-97ec-5ce57150bd8e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:21.610594 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-701a6199-673c-41c1-97ec-5ce57150bd8e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:21.611333 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-701a6199-673c-41c1-97ec-5ce57150bd8e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:21.611794 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-701a6199-673c-41c1-97ec-5ce57150bd8e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:21.616132 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-701a6199-673c-41c1-97ec-5ce57150bd8e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:21.873537 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-94af143b-718c-4954-9298-7258e9f04a0a tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:14:21.873964 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-94af143b-718c-4954-9298-7258e9f04a0a tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:14:21.874652 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-94af143b-718c-4954-9298-7258e9f04a0a tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:14:21.875667 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-94af143b-718c-4954-9298-7258e9f04a0a tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:14:21.876246 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-94af143b-718c-4954-9298-7258e9f04a0a tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:14:21.894119 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=43 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:21.897713 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94af143b-718c-4954-9298-7258e9f04a0a tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:21.903771 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94af143b-718c-4954-9298-7258e9f04a0a tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:21.909164 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94af143b-718c-4954-9298-7258e9f04a0a tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:21.909164 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94af143b-718c-4954-9298-7258e9f04a0a tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:21.909164 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94af143b-718c-4954-9298-7258e9f04a0a tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:21.918759 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94af143b-718c-4954-9298-7258e9f04a0a tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:21.968215 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-94af143b-718c-4954-9298-7258e9f04a0a tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Getting quotas for project 4d89b6637c1347fc8ad048509aa68d72. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:14:21.975740 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-94af143b-718c-4954-9298-7258e9f04a0a tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Getting quotas for user b5451732c8d74dd1a2441228702a7d2c and project 4d89b6637c1347fc8ad048509aa68d72. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:14:22.000026 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-94af143b-718c-4954-9298-7258e9f04a0a tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Going to run 1 instances... {{(pid=123015) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:14:22.002868 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-94af143b-718c-4954-9298-7258e9f04a0a tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:14:22.121415 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-701a6199-673c-41c1-97ec-5ce57150bd8e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:22.131500 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-94af143b-718c-4954-9298-7258e9f04a0a tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.143859 Aug 22 17:14:22.132161 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 388/740] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:14:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:14:22.132648 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-701a6199-673c-41c1-97ec-5ce57150bd8e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 200 len: 1313 microversion: 2.1 time: 0.544278 Aug 22 17:14:22.148257 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 353/741] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:21 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:22.157499 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c7e44ff0-2318-4fea-b789-d4e98fe0034f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:22.159037 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c7e44ff0-2318-4fea-b789-d4e98fe0034f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:22.159997 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c470355f-1303-4732-be58-afb1ab70cd6e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:22.162737 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-c470355f-1303-4732-be58-afb1ab70cd6e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:22.171039 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c7e44ff0-2318-4fea-b789-d4e98fe0034f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:22.171774 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c7e44ff0-2318-4fea-b789-d4e98fe0034f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:22.172395 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c7e44ff0-2318-4fea-b789-d4e98fe0034f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:22.175671 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c7e44ff0-2318-4fea-b789-d4e98fe0034f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:22.176330 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c7e44ff0-2318-4fea-b789-d4e98fe0034f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:22.177674 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c7e44ff0-2318-4fea-b789-d4e98fe0034f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:22.217943 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c470355f-1303-4732-be58-afb1ab70cd6e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:22.218486 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c470355f-1303-4732-be58-afb1ab70cd6e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:22.220345 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c470355f-1303-4732-be58-afb1ab70cd6e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:22.233530 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c470355f-1303-4732-be58-afb1ab70cd6e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:22.233530 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c470355f-1303-4732-be58-afb1ab70cd6e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:22.233530 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c470355f-1303-4732-be58-afb1ab70cd6e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:22.571701 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c470355f-1303-4732-be58-afb1ab70cd6e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:22.576514 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:22.581825 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c470355f-1303-4732-be58-afb1ab70cd6e tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 200 len: 1478 microversion: 2.1 time: 0.441965 Aug 22 17:14:22.597034 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 389/742] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:22 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 1478 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:22.602682 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8a751c12-db4c-4875-83dd-0b5133a84c02 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:22.604040 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8a751c12-db4c-4875-83dd-0b5133a84c02 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:22.692319 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8a751c12-db4c-4875-83dd-0b5133a84c02 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:22.719168 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c7e44ff0-2318-4fea-b789-d4e98fe0034f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:22.722296 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8a751c12-db4c-4875-83dd-0b5133a84c02 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1214 microversion: 2.1 time: 0.123727 Aug 22 17:14:22.727718 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 390/743] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:22 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:22.735905 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c7e44ff0-2318-4fea-b789-d4e98fe0034f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1317 microversion: 2.1 time: 0.586141 Aug 22 17:14:22.743540 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 354/744] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:22 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1317 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:22.830446 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-4e21b731-f575-49ca-8a31-cca7b028f406 req-9f4bb3f4-a50c-4658-a52d-d162cdf94b01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de1802ae-582c-4cc0-bda9-86b08d26493f", "tag": "9e2be979-59ce-4656-bfaf-7ce4cb2bb517"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:22.849113 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-4e21b731-f575-49ca-8a31-cca7b028f406 req-9f4bb3f4-a50c-4658-a52d-d162cdf94b01 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:22.852537 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-4e21b731-f575-49ca-8a31-cca7b028f406 req-9f4bb3f4-a50c-4658-a52d-d162cdf94b01 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:22.853351 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-4e21b731-f575-49ca-8a31-cca7b028f406 req-9f4bb3f4-a50c-4658-a52d-d162cdf94b01 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:22.883821 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-4e21b731-f575-49ca-8a31-cca7b028f406 req-9f4bb3f4-a50c-4658-a52d-d162cdf94b01 service nova] Creating event network-changed:9e2be979-59ce-4656-bfaf-7ce4cb2bb517 for instance de1802ae-582c-4cc0-bda9-86b08d26493f on n-h2-854030-1 Aug 22 17:14:22.897434 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-4e21b731-f575-49ca-8a31-cca7b028f406 req-9f4bb3f4-a50c-4658-a52d-d162cdf94b01 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070921 Aug 22 17:14:22.898259 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 391/745] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:23.155546 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-64effd5a-f975-43fc-8bea-5c5d1ec891e7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:23.156197 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-64effd5a-f975-43fc-8bea-5c5d1ec891e7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:23.172487 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-64effd5a-f975-43fc-8bea-5c5d1ec891e7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:23.172991 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-64effd5a-f975-43fc-8bea-5c5d1ec891e7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:23.174446 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-64effd5a-f975-43fc-8bea-5c5d1ec891e7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:23.175155 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-64effd5a-f975-43fc-8bea-5c5d1ec891e7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:23.175892 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-64effd5a-f975-43fc-8bea-5c5d1ec891e7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:23.176319 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-64effd5a-f975-43fc-8bea-5c5d1ec891e7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:23.596840 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-64effd5a-f975-43fc-8bea-5c5d1ec891e7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:23.605763 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8fcaea12-a2c1-4ce0-8381-a6a0a5a860f2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:23.607230 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8fcaea12-a2c1-4ce0-8381-a6a0a5a860f2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:23.611211 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-64effd5a-f975-43fc-8bea-5c5d1ec891e7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 200 len: 1313 microversion: 2.1 time: 0.457787 Aug 22 17:14:23.613635 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 355/746] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:23 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 1313 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:23.619093 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8fcaea12-a2c1-4ce0-8381-a6a0a5a860f2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:23.623371 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8fcaea12-a2c1-4ce0-8381-a6a0a5a860f2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:23.623993 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8fcaea12-a2c1-4ce0-8381-a6a0a5a860f2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:23.624923 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8fcaea12-a2c1-4ce0-8381-a6a0a5a860f2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:23.625554 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8fcaea12-a2c1-4ce0-8381-a6a0a5a860f2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:23.628258 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8fcaea12-a2c1-4ce0-8381-a6a0a5a860f2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:23.747756 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-138d39f2-f222-4fc1-8a6f-599b2a6f9b91 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:23.748460 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-138d39f2-f222-4fc1-8a6f-599b2a6f9b91 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:23.857895 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-138d39f2-f222-4fc1-8a6f-599b2a6f9b91 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:23.867734 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-138d39f2-f222-4fc1-8a6f-599b2a6f9b91 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1214 microversion: 2.1 time: 0.121309 Aug 22 17:14:23.881424 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 356/747] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:23 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1214 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:23.895274 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f9d0120f-0c95-4add-97d4-75b4355e12f1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:23.896570 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-f9d0120f-0c95-4add-97d4-75b4355e12f1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:23.910884 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f9d0120f-0c95-4add-97d4-75b4355e12f1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:23.912636 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f9d0120f-0c95-4add-97d4-75b4355e12f1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:23.914016 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f9d0120f-0c95-4add-97d4-75b4355e12f1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:23.914909 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f9d0120f-0c95-4add-97d4-75b4355e12f1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:23.916336 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f9d0120f-0c95-4add-97d4-75b4355e12f1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:23.917701 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f9d0120f-0c95-4add-97d4-75b4355e12f1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:24.031970 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8fcaea12-a2c1-4ce0-8381-a6a0a5a860f2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:24.044690 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8fcaea12-a2c1-4ce0-8381-a6a0a5a860f2 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 200 len: 1478 microversion: 2.1 time: 0.444306 Aug 22 17:14:24.067559 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 392/748] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:23 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 1478 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:24.242804 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-f9d0120f-0c95-4add-97d4-75b4355e12f1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:24.260519 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f9d0120f-0c95-4add-97d4-75b4355e12f1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1317 microversion: 2.1 time: 0.377747 Aug 22 17:14:24.262394 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 357/749] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:23 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:24.633931 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c84bcaad-e6e2-4bd2-bdbf-0ea9db58d562 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:24.635197 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-c84bcaad-e6e2-4bd2-bdbf-0ea9db58d562 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:24.642873 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c84bcaad-e6e2-4bd2-bdbf-0ea9db58d562 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:24.643830 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c84bcaad-e6e2-4bd2-bdbf-0ea9db58d562 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:24.644771 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c84bcaad-e6e2-4bd2-bdbf-0ea9db58d562 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:24.645898 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c84bcaad-e6e2-4bd2-bdbf-0ea9db58d562 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:24.646606 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c84bcaad-e6e2-4bd2-bdbf-0ea9db58d562 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:24.648311 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c84bcaad-e6e2-4bd2-bdbf-0ea9db58d562 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:24.887243 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=17 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:24.892767 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-30972219-aae2-49c3-994b-42056fbf1e21 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:24.895165 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-30972219-aae2-49c3-994b-42056fbf1e21 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:24.921606 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-30972219-aae2-49c3-994b-42056fbf1e21 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:24.923298 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-30972219-aae2-49c3-994b-42056fbf1e21 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:24.923974 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-30972219-aae2-49c3-994b-42056fbf1e21 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:24.924896 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-30972219-aae2-49c3-994b-42056fbf1e21 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:24.925630 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-30972219-aae2-49c3-994b-42056fbf1e21 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:24.926221 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-30972219-aae2-49c3-994b-42056fbf1e21 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:24.968648 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=100 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:25.070893 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c84bcaad-e6e2-4bd2-bdbf-0ea9db58d562 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:25.084660 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c84bcaad-e6e2-4bd2-bdbf-0ea9db58d562 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 200 len: 1313 microversion: 2.1 time: 0.454934 Aug 22 17:14:25.085915 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 393/750] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:24 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:25.097355 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-af4e0a48-779f-42a2-b54a-e42b8c6eaf27 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:25.098385 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-af4e0a48-779f-42a2-b54a-e42b8c6eaf27 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:25.109534 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-af4e0a48-779f-42a2-b54a-e42b8c6eaf27 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:25.110463 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-af4e0a48-779f-42a2-b54a-e42b8c6eaf27 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:25.111532 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-af4e0a48-779f-42a2-b54a-e42b8c6eaf27 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:25.112817 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-af4e0a48-779f-42a2-b54a-e42b8c6eaf27 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:25.113407 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-af4e0a48-779f-42a2-b54a-e42b8c6eaf27 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:25.113929 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-af4e0a48-779f-42a2-b54a-e42b8c6eaf27 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:25.407485 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-30972219-aae2-49c3-994b-42056fbf1e21 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:25.424756 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-30972219-aae2-49c3-994b-42056fbf1e21 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1266 microversion: 2.1 time: 0.538605 Aug 22 17:14:25.434583 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 358/751] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:24 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1266 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:25.434583 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5a04e949-705f-47e7-8855-0472b7b03155 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:25.434583 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5a04e949-705f-47e7-8855-0472b7b03155 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:25.443988 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5a04e949-705f-47e7-8855-0472b7b03155 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:25.445869 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5a04e949-705f-47e7-8855-0472b7b03155 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:25.447511 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5a04e949-705f-47e7-8855-0472b7b03155 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:25.449503 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5a04e949-705f-47e7-8855-0472b7b03155 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:25.450804 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5a04e949-705f-47e7-8855-0472b7b03155 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:25.451562 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5a04e949-705f-47e7-8855-0472b7b03155 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:25.716961 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-af4e0a48-779f-42a2-b54a-e42b8c6eaf27 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:25.730298 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-af4e0a48-779f-42a2-b54a-e42b8c6eaf27 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 200 len: 1478 microversion: 2.1 time: 0.642452 Aug 22 17:14:25.732155 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 394/752] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:25 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 1478 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:25.994862 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-5a04e949-705f-47e7-8855-0472b7b03155 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:26.004149 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5a04e949-705f-47e7-8855-0472b7b03155 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1317 microversion: 2.1 time: 0.576245 Aug 22 17:14:26.004359 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 359/753] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:25 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:26.112965 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f11906eb-bf7f-4dd5-be99-60c55b5177f6 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:26.113719 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f11906eb-bf7f-4dd5-be99-60c55b5177f6 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:26.117332 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:26.127937 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f11906eb-bf7f-4dd5-be99-60c55b5177f6 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:26.128714 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f11906eb-bf7f-4dd5-be99-60c55b5177f6 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:26.130502 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f11906eb-bf7f-4dd5-be99-60c55b5177f6 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:26.131993 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f11906eb-bf7f-4dd5-be99-60c55b5177f6 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:26.132647 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f11906eb-bf7f-4dd5-be99-60c55b5177f6 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:26.133293 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f11906eb-bf7f-4dd5-be99-60c55b5177f6 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:26.137696 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-d799e08b-d8b8-411d-a0e8-ae4ad4150704 req-afef54db-628d-472a-b52d-a590513c45c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cde06f3-062c-470d-995f-51b1b2136a14", "name": "network-vif-deleted", "tag": "89538d2b-3be7-410b-9b9a-8444ab3244a2"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:26.151149 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-d799e08b-d8b8-411d-a0e8-ae4ad4150704 req-afef54db-628d-472a-b52d-a590513c45c5 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:26.152518 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-d799e08b-d8b8-411d-a0e8-ae4ad4150704 req-afef54db-628d-472a-b52d-a590513c45c5 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:26.153147 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-d799e08b-d8b8-411d-a0e8-ae4ad4150704 req-afef54db-628d-472a-b52d-a590513c45c5 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:26.199233 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-d799e08b-d8b8-411d-a0e8-ae4ad4150704 req-afef54db-628d-472a-b52d-a590513c45c5 service nova] Creating event network-vif-deleted:89538d2b-3be7-410b-9b9a-8444ab3244a2 for instance 0cde06f3-062c-470d-995f-51b1b2136a14 on n-h1-854030-1 Aug 22 17:14:26.213347 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-d799e08b-d8b8-411d-a0e8-ae4ad4150704 req-afef54db-628d-472a-b52d-a590513c45c5 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075176 Aug 22 17:14:26.219538 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 360/754] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:26.451089 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f4037a3d-6bdc-49d1-8b92-ad01d1bdf433 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:26.452297 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-f4037a3d-6bdc-49d1-8b92-ad01d1bdf433 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:26.468252 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f4037a3d-6bdc-49d1-8b92-ad01d1bdf433 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:26.476980 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f4037a3d-6bdc-49d1-8b92-ad01d1bdf433 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:26.476980 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f4037a3d-6bdc-49d1-8b92-ad01d1bdf433 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:26.476980 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f4037a3d-6bdc-49d1-8b92-ad01d1bdf433 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:26.476980 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f4037a3d-6bdc-49d1-8b92-ad01d1bdf433 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:26.477440 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f4037a3d-6bdc-49d1-8b92-ad01d1bdf433 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:26.891526 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-f4037a3d-6bdc-49d1-8b92-ad01d1bdf433 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:26.899568 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f4037a3d-6bdc-49d1-8b92-ad01d1bdf433 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1272 microversion: 2.1 time: 0.453647 Aug 22 17:14:26.900787 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 361/755] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:26 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1272 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:14:26.912617 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d3c2407e-6be5-4524-9e19-1f87246a1824 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:26.918943 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-d3c2407e-6be5-4524-9e19-1f87246a1824 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:26.926972 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d3c2407e-6be5-4524-9e19-1f87246a1824 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:26.927476 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d3c2407e-6be5-4524-9e19-1f87246a1824 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:26.927921 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d3c2407e-6be5-4524-9e19-1f87246a1824 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:26.928641 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d3c2407e-6be5-4524-9e19-1f87246a1824 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:26.929182 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d3c2407e-6be5-4524-9e19-1f87246a1824 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:26.929677 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d3c2407e-6be5-4524-9e19-1f87246a1824 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:26.987289 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d3c2407e-6be5-4524-9e19-1f87246a1824 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:26.988298 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d3c2407e-6be5-4524-9e19-1f87246a1824 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:26.988756 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d3c2407e-6be5-4524-9e19-1f87246a1824 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:26.989417 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-d3c2407e-6be5-4524-9e19-1f87246a1824 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lazy-loading 'fault' on Instance uuid 0cde06f3-062c-470d-995f-51b1b2136a14 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:14:27.006436 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f11906eb-bf7f-4dd5-be99-60c55b5177f6 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:27.017638 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f11906eb-bf7f-4dd5-be99-60c55b5177f6 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 200 len: 1313 microversion: 2.1 time: 0.909631 Aug 22 17:14:27.019185 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 395/756] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:26 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 1313 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:27.029979 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d94aa315-2619-48c9-b2b8-0e51d0778af8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:27.031292 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d94aa315-2619-48c9-b2b8-0e51d0778af8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:27.038852 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d94aa315-2619-48c9-b2b8-0e51d0778af8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:27.039536 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d94aa315-2619-48c9-b2b8-0e51d0778af8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:27.040164 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d94aa315-2619-48c9-b2b8-0e51d0778af8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:27.040877 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d94aa315-2619-48c9-b2b8-0e51d0778af8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:27.041372 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d94aa315-2619-48c9-b2b8-0e51d0778af8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:27.041799 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d94aa315-2619-48c9-b2b8-0e51d0778af8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:27.231958 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-d3c2407e-6be5-4524-9e19-1f87246a1824 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fd8e9807c9b44e1b83ac7bacbaf8599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffdd27bb05144d16aac5c3e39bc05a65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:27.244022 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d3c2407e-6be5-4524-9e19-1f87246a1824 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 200 len: 1312 microversion: 2.1 time: 0.336358 Aug 22 17:14:27.247869 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 362/757] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:26 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 1312 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:27.514220 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d94aa315-2619-48c9-b2b8-0e51d0778af8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:27.514220 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d94aa315-2619-48c9-b2b8-0e51d0778af8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1317 microversion: 2.1 time: 0.488569 Aug 22 17:14:27.523444 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 396/758] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:27 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:14:27.925960 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8662c6f7-4453-4138-bfc9-b4619cea3d43 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:27.926576 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-8662c6f7-4453-4138-bfc9-b4619cea3d43 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:27.945990 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8662c6f7-4453-4138-bfc9-b4619cea3d43 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:27.946542 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8662c6f7-4453-4138-bfc9-b4619cea3d43 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:27.947016 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8662c6f7-4453-4138-bfc9-b4619cea3d43 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:27.947749 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8662c6f7-4453-4138-bfc9-b4619cea3d43 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:27.953343 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8662c6f7-4453-4138-bfc9-b4619cea3d43 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:27.954131 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8662c6f7-4453-4138-bfc9-b4619cea3d43 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:28.040872 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3c1a9e37-654f-4d34-a0ab-34abb3aa3435 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:28.042722 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-3c1a9e37-654f-4d34-a0ab-34abb3aa3435 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:28.049452 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3c1a9e37-654f-4d34-a0ab-34abb3aa3435 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:28.050388 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3c1a9e37-654f-4d34-a0ab-34abb3aa3435 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:28.051090 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3c1a9e37-654f-4d34-a0ab-34abb3aa3435 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:28.051979 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3c1a9e37-654f-4d34-a0ab-34abb3aa3435 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:28.052647 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3c1a9e37-654f-4d34-a0ab-34abb3aa3435 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:28.053333 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3c1a9e37-654f-4d34-a0ab-34abb3aa3435 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:28.290415 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-3c1a9e37-654f-4d34-a0ab-34abb3aa3435 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:28.332025 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3c1a9e37-654f-4d34-a0ab-34abb3aa3435 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 200 len: 1313 microversion: 2.1 time: 0.295296 Aug 22 17:14:28.348814 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 397/759] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:28 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:14:28.357203 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-924a9af7-048b-41a8-a08b-43a6908337c6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:28.359484 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-924a9af7-048b-41a8-a08b-43a6908337c6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] [instance: 0cde06f3-062c-470d-995f-51b1b2136a14] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:28.368443 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-924a9af7-048b-41a8-a08b-43a6908337c6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:28.370347 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-924a9af7-048b-41a8-a08b-43a6908337c6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:28.371058 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-924a9af7-048b-41a8-a08b-43a6908337c6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:28.372541 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-924a9af7-048b-41a8-a08b-43a6908337c6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:28.373449 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-924a9af7-048b-41a8-a08b-43a6908337c6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:28.374116 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-924a9af7-048b-41a8-a08b-43a6908337c6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:28.398547 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-924a9af7-048b-41a8-a08b-43a6908337c6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] HTTP exception thrown: Instance 0cde06f3-062c-470d-995f-51b1b2136a14 could not be found. Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-924a9af7-048b-41a8-a08b-43a6908337c6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Request method failure captured: Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 HTTP/1.1 Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7kuc6nYbN-XPsQ7ozlJP5QTMafMMejRJP9misDhJYgVAh3AgLrR_mVZmhyv9P_wQNm9TTc1z1vZkXSoPs2LwGrG2vE20_e38nDhmyUe28cdWKFWjpBlai6v-1YgAwOZQjevvTegk6SnnwOHsyCSwusoatVWHBxIdmhNeCJSIV7nZg8 Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: ffdd27bb05144d16aac5c3e39bc05a65 Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-526256208 Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:14:28.402506 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:14:28.403821 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ffdd27bb05144d16aac5c3e39bc05a65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_ffdd27bb05144d16aac5c3e39bc05a65", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ffdd27bb05144d16aac5c3e39bc05a65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/ffdd27bb05144d16aac5c3e39bc05a65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:14:28.403821 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersAdminNegativeTestJSON-526256208 Aug 22 17:14:28.403821 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: ffdd27bb05144d16aac5c3e39bc05a65 Aug 22 17:14:28.403821 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-526256208 Aug 22 17:14:28.403821 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersAdminNegativeTestJSON-526256208-project Aug 22 17:14:28.403821 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:14:28.403821 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:14:28.403821 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 9fd8e9807c9b44e1b83ac7bacbaf8599 Aug 22 17:14:28.403821 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersAdminNegativeTestJSON-526256208-project Aug 22 17:14:28.403821 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:14:28.403821 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance 0cde06f3-062c-470d-995f-51b1b2136a14 could not be found. Aug 22 17:14:28.403821 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '0cde06f3-062c-470d-995f-51b1b2136a14'} Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cde06f3-062c-470d-995f-51b1b2136a14 could not be found. Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:14:28.404582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:28.407484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:28.407484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:14:28.407484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:14:28.407484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:14:28.407484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:14:28.407484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:14:28.407484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:14:28.407484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cde06f3-062c-470d-995f-51b1b2136a14 could not be found. Aug 22 17:14:28.407484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:28.407484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:28.407484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:28.407484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:28.407484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:28.407484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:28.407484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:14:28.407484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:14:28.407484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cde06f3-062c-470d-995f-51b1b2136a14 could not be found. Aug 22 17:14:28.407484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:28.420621 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-924a9af7-048b-41a8-a08b-43a6908337c6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] Returning 404 to user: Instance 0cde06f3-062c-470d-995f-51b1b2136a14 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:14:28.422224 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-924a9af7-048b-41a8-a08b-43a6908337c6 tempest-ServersAdminNegativeTestJSON-526256208 tempest-ServersAdminNegativeTestJSON-526256208-project] 10.222.0.96 "GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14" status: 404 len: 111 microversion: 2.1 time: 0.072072 Aug 22 17:14:28.430410 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 398/760] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:28 2022] GET /compute/v2.1/servers/0cde06f3-062c-470d-995f-51b1b2136a14 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:14:28.509967 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-8662c6f7-4453-4138-bfc9-b4619cea3d43 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:28.522479 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8662c6f7-4453-4138-bfc9-b4619cea3d43 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1272 microversion: 2.1 time: 0.600287 Aug 22 17:14:28.545449 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 363/761] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:27 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1272 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:28.550791 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ea98c7bc-55f5-4bf8-956d-95b6ab832591 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:28.551783 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ea98c7bc-55f5-4bf8-956d-95b6ab832591 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:28.563876 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ea98c7bc-55f5-4bf8-956d-95b6ab832591 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:28.564458 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ea98c7bc-55f5-4bf8-956d-95b6ab832591 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:28.565815 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ea98c7bc-55f5-4bf8-956d-95b6ab832591 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:28.566534 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ea98c7bc-55f5-4bf8-956d-95b6ab832591 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:28.566992 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ea98c7bc-55f5-4bf8-956d-95b6ab832591 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:28.567412 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ea98c7bc-55f5-4bf8-956d-95b6ab832591 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:28.804756 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-b42344c3-9c01-438f-8b09-e609146626a2 req-9f3631a1-4459-4702-b257-1923e198b676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30fb117d-2950-4ba7-98a0-fd8874ad006c", "name": "network-vif-plugged", "status": "completed", "tag": "10a64f19-cca9-4d20-a741-bd1661b9f4ba"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:28.820380 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-b42344c3-9c01-438f-8b09-e609146626a2 req-9f3631a1-4459-4702-b257-1923e198b676 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:28.821275 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-b42344c3-9c01-438f-8b09-e609146626a2 req-9f3631a1-4459-4702-b257-1923e198b676 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:28.822041 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-b42344c3-9c01-438f-8b09-e609146626a2 req-9f3631a1-4459-4702-b257-1923e198b676 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:28.847926 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-b42344c3-9c01-438f-8b09-e609146626a2 req-9f3631a1-4459-4702-b257-1923e198b676 service nova] Creating event network-vif-plugged:10a64f19-cca9-4d20-a741-bd1661b9f4ba for instance 30fb117d-2950-4ba7-98a0-fd8874ad006c on n-h1-854030-1 Aug 22 17:14:28.866956 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-b42344c3-9c01-438f-8b09-e609146626a2 req-9f3631a1-4459-4702-b257-1923e198b676 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074681 Aug 22 17:14:28.870011 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 364/762] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:29.051458 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ea98c7bc-55f5-4bf8-956d-95b6ab832591 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:29.065977 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ea98c7bc-55f5-4bf8-956d-95b6ab832591 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1317 microversion: 2.1 time: 0.534694 Aug 22 17:14:29.068987 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 399/763] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:28 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:29.359756 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2964b525-ca47-454f-a540-62512c9a3610 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:29.360998 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-2964b525-ca47-454f-a540-62512c9a3610 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:29.385594 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2964b525-ca47-454f-a540-62512c9a3610 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:29.387515 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2964b525-ca47-454f-a540-62512c9a3610 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:29.388344 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2964b525-ca47-454f-a540-62512c9a3610 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:29.389941 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2964b525-ca47-454f-a540-62512c9a3610 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:29.390782 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2964b525-ca47-454f-a540-62512c9a3610 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:29.391741 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2964b525-ca47-454f-a540-62512c9a3610 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:29.554233 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-78ab9270-0eb3-4551-b1ea-b0e957be4669 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:29.555255 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-78ab9270-0eb3-4551-b1ea-b0e957be4669 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:29.570000 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78ab9270-0eb3-4551-b1ea-b0e957be4669 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:29.571810 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78ab9270-0eb3-4551-b1ea-b0e957be4669 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:29.572339 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78ab9270-0eb3-4551-b1ea-b0e957be4669 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:29.575839 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78ab9270-0eb3-4551-b1ea-b0e957be4669 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:29.576998 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78ab9270-0eb3-4551-b1ea-b0e957be4669 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:29.577951 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78ab9270-0eb3-4551-b1ea-b0e957be4669 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:29.865701 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-2964b525-ca47-454f-a540-62512c9a3610 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:29.874772 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2964b525-ca47-454f-a540-62512c9a3610 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 200 len: 1313 microversion: 2.1 time: 0.522026 Aug 22 17:14:29.888862 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 365/764] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:29 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:30.035493 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-78ab9270-0eb3-4551-b1ea-b0e957be4669 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:30.064443 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-78ab9270-0eb3-4551-b1ea-b0e957be4669 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1314 microversion: 2.1 time: 0.510610 Aug 22 17:14:30.068120 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 400/765] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:29 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:30.092628 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fb37fa27-7b78-4183-9254-4d7a983cb7ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:30.093018 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-fb37fa27-7b78-4183-9254-4d7a983cb7ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:30.100233 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fb37fa27-7b78-4183-9254-4d7a983cb7ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:30.100839 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fb37fa27-7b78-4183-9254-4d7a983cb7ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:30.101625 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fb37fa27-7b78-4183-9254-4d7a983cb7ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:30.102723 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fb37fa27-7b78-4183-9254-4d7a983cb7ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:30.103440 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fb37fa27-7b78-4183-9254-4d7a983cb7ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:30.105063 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fb37fa27-7b78-4183-9254-4d7a983cb7ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:30.576390 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-fb37fa27-7b78-4183-9254-4d7a983cb7ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:30.584446 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-fb37fa27-7b78-4183-9254-4d7a983cb7ac tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1317 microversion: 2.1 time: 0.496666 Aug 22 17:14:30.586572 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 366/766] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:30 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1317 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:30.897238 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-66b76326-279c-4bfa-9a63-b02069e738b0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:30.898206 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-66b76326-279c-4bfa-9a63-b02069e738b0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:30.907537 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-66b76326-279c-4bfa-9a63-b02069e738b0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:30.908267 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-66b76326-279c-4bfa-9a63-b02069e738b0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:30.908914 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-66b76326-279c-4bfa-9a63-b02069e738b0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:30.909790 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-66b76326-279c-4bfa-9a63-b02069e738b0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:30.910994 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-66b76326-279c-4bfa-9a63-b02069e738b0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:30.911579 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-66b76326-279c-4bfa-9a63-b02069e738b0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:31.093000 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b6775685-045a-4bbb-8d2a-7203c29f9328 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:31.093811 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b6775685-045a-4bbb-8d2a-7203c29f9328 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:31.102915 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b6775685-045a-4bbb-8d2a-7203c29f9328 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:31.103942 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b6775685-045a-4bbb-8d2a-7203c29f9328 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:31.107035 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b6775685-045a-4bbb-8d2a-7203c29f9328 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:31.108061 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b6775685-045a-4bbb-8d2a-7203c29f9328 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:31.109316 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b6775685-045a-4bbb-8d2a-7203c29f9328 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:31.110653 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b6775685-045a-4bbb-8d2a-7203c29f9328 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:31.343922 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-66b76326-279c-4bfa-9a63-b02069e738b0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:31.358260 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-66b76326-279c-4bfa-9a63-b02069e738b0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 200 len: 1313 microversion: 2.1 time: 0.463546 Aug 22 17:14:31.360020 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 401/767] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:30 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 1313 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:31.514505 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b6775685-045a-4bbb-8d2a-7203c29f9328 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:31.542393 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b6775685-045a-4bbb-8d2a-7203c29f9328 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1314 microversion: 2.1 time: 0.456394 Aug 22 17:14:31.607864 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 367/768] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:31 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:31.611507 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5ab8cb42-1d1e-4792-aee2-d09cede1d847 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:31.612137 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-5ab8cb42-1d1e-4792-aee2-d09cede1d847 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:31.636648 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5ab8cb42-1d1e-4792-aee2-d09cede1d847 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:31.642097 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5ab8cb42-1d1e-4792-aee2-d09cede1d847 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:31.642700 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5ab8cb42-1d1e-4792-aee2-d09cede1d847 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:31.643885 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5ab8cb42-1d1e-4792-aee2-d09cede1d847 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:31.650020 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5ab8cb42-1d1e-4792-aee2-d09cede1d847 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:31.655022 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5ab8cb42-1d1e-4792-aee2-d09cede1d847 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:31.949370 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=14 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:31.961941 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-f5df6470-0656-44e6-ac17-ce944be255da req-0060bcc9-89d7-4a11-9ff8-181354947726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e734abd7-7fe7-40b1-b6fc-49590a36e09d", "tag": "be9b2e4a-414d-4baa-8230-42315bf4e034"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:31.971666 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:31.974038 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-f5df6470-0656-44e6-ac17-ce944be255da req-0060bcc9-89d7-4a11-9ff8-181354947726 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:31.974684 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-f5df6470-0656-44e6-ac17-ce944be255da req-0060bcc9-89d7-4a11-9ff8-181354947726 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:31.975310 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-f5df6470-0656-44e6-ac17-ce944be255da req-0060bcc9-89d7-4a11-9ff8-181354947726 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:32.016747 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-f5df6470-0656-44e6-ac17-ce944be255da req-0060bcc9-89d7-4a11-9ff8-181354947726 service nova] Creating event network-changed:be9b2e4a-414d-4baa-8230-42315bf4e034 for instance e734abd7-7fe7-40b1-b6fc-49590a36e09d on n-h1-854030-1 Aug 22 17:14:32.016747 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-f5df6470-0656-44e6-ac17-ce944be255da req-0060bcc9-89d7-4a11-9ff8-181354947726 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050748 Aug 22 17:14:32.016747 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 368/769] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:14:32.230412 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-5ab8cb42-1d1e-4792-aee2-d09cede1d847 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:32.260523 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5ab8cb42-1d1e-4792-aee2-d09cede1d847 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1317 microversion: 2.1 time: 0.643569 Aug 22 17:14:32.260523 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 402/770] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:31 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1317 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:14:32.388130 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8afaf36f-8994-4043-b0fd-6a41b95ebf9f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:32.388852 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-8afaf36f-8994-4043-b0fd-6a41b95ebf9f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:32.406330 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8afaf36f-8994-4043-b0fd-6a41b95ebf9f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:32.406842 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8afaf36f-8994-4043-b0fd-6a41b95ebf9f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:32.407292 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8afaf36f-8994-4043-b0fd-6a41b95ebf9f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:32.410705 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8afaf36f-8994-4043-b0fd-6a41b95ebf9f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:32.410705 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8afaf36f-8994-4043-b0fd-6a41b95ebf9f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:32.410705 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8afaf36f-8994-4043-b0fd-6a41b95ebf9f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:32.632206 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-55143c57-c91b-4159-88e9-0c850ffc8efb tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:32.635538 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-55143c57-c91b-4159-88e9-0c850ffc8efb tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:32.670598 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-55143c57-c91b-4159-88e9-0c850ffc8efb tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:32.671335 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-55143c57-c91b-4159-88e9-0c850ffc8efb tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:32.672958 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-55143c57-c91b-4159-88e9-0c850ffc8efb tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:32.674448 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-55143c57-c91b-4159-88e9-0c850ffc8efb tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:32.675291 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-55143c57-c91b-4159-88e9-0c850ffc8efb tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:32.676116 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-55143c57-c91b-4159-88e9-0c850ffc8efb tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:33.187838 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-55143c57-c91b-4159-88e9-0c850ffc8efb tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:33.196945 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-55143c57-c91b-4159-88e9-0c850ffc8efb tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1314 microversion: 2.1 time: 0.583491 Aug 22 17:14:33.197561 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 403/771] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:32 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:14:33.216797 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-b18739dd-dfdd-4f48-bdf1-4ba5d9a0da1b req-e29fd240-e53c-478b-8bb8-a581642a1791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1802ae-582c-4cc0-bda9-86b08d26493f", "name": "network-vif-plugged", "status": "completed", "tag": "9e2be979-59ce-4656-bfaf-7ce4cb2bb517"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:33.274628 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-b18739dd-dfdd-4f48-bdf1-4ba5d9a0da1b req-e29fd240-e53c-478b-8bb8-a581642a1791 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:33.275608 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-b18739dd-dfdd-4f48-bdf1-4ba5d9a0da1b req-e29fd240-e53c-478b-8bb8-a581642a1791 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:33.277334 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-b18739dd-dfdd-4f48-bdf1-4ba5d9a0da1b req-e29fd240-e53c-478b-8bb8-a581642a1791 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:33.284616 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-8afaf36f-8994-4043-b0fd-6a41b95ebf9f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:33.299874 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8afaf36f-8994-4043-b0fd-6a41b95ebf9f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 200 len: 1462 microversion: 2.1 time: 0.918244 Aug 22 17:14:33.313350 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-b18739dd-dfdd-4f48-bdf1-4ba5d9a0da1b req-e29fd240-e53c-478b-8bb8-a581642a1791 service nova] Creating event network-vif-plugged:9e2be979-59ce-4656-bfaf-7ce4cb2bb517 for instance de1802ae-582c-4cc0-bda9-86b08d26493f on n-h2-854030-1 Aug 22 17:14:33.317276 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 369/772] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:32 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 1462 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:33.322606 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-db606c32-35d2-4536-9776-183243d697db tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:33.329231 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-db606c32-35d2-4536-9776-183243d697db tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:33.336150 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-db606c32-35d2-4536-9776-183243d697db tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:33.344283 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-b18739dd-dfdd-4f48-bdf1-4ba5d9a0da1b req-e29fd240-e53c-478b-8bb8-a581642a1791 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141373 Aug 22 17:14:33.344903 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 404/773] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:33.345994 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-db606c32-35d2-4536-9776-183243d697db tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:33.346458 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-db606c32-35d2-4536-9776-183243d697db tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:33.347230 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-db606c32-35d2-4536-9776-183243d697db tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:33.354247 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-db606c32-35d2-4536-9776-183243d697db tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:33.355857 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-db606c32-35d2-4536-9776-183243d697db tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:33.377267 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0524567a-fc96-4df7-b440-8af3ab2db3cb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:33.385723 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0524567a-fc96-4df7-b440-8af3ab2db3cb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:33.403838 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0524567a-fc96-4df7-b440-8af3ab2db3cb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:33.406929 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0524567a-fc96-4df7-b440-8af3ab2db3cb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:33.407760 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0524567a-fc96-4df7-b440-8af3ab2db3cb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:33.408814 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0524567a-fc96-4df7-b440-8af3ab2db3cb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:33.410059 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0524567a-fc96-4df7-b440-8af3ab2db3cb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:33.411703 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0524567a-fc96-4df7-b440-8af3ab2db3cb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:33.641497 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=7 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:33.689000 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-0524567a-fc96-4df7-b440-8af3ab2db3cb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6caf9749-2fdc-4460-bd08-091b0704aa68) Aug 22 17:14:33.689000 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:33.689000 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:33.689000 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:33.689000 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:33.689000 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:33.689000 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 22 17:14:33.689000 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 22 17:14:33.689000 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 22 17:14:33.689000 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 22 17:14:33.689000 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 22 17:14:33.689000 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 22 17:14:33.689000 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 22 17:14:33.689000 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 22 17:14:33.690213 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:14:33.690213 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:14:33.690213 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:14:33.690213 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:14:33.690213 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:14:33.690213 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:14:33.690213 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:33.690213 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:33.690213 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:14:33.690213 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:14:33.690213 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:33.690213 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:33.690213 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:14:33.690213 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:14:33.690213 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:33.690213 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:33.690213 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:14:33.690213 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:14:33.691293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:33.691293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:33.691293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:14:33.691293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:14:33.691293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:14:33.691293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:14:33.691293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:14:33.691293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:14:33.691293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:14:33.691293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:14:33.691293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:14:33.691293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:14:33.691293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:14:33.691293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:14:33.691293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:14:33.691293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:14:33.691293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:14:33.692338 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:14:33.692338 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:14:33.692338 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:14:33.692338 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:14:33.692338 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:14:33.692338 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:14:33.692338 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:14:33.692338 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:14:33.692338 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:14:33.692338 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:14:33.692338 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:14:33.692338 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6caf9749-2fdc-4460-bd08-091b0704aa68) Aug 22 17:14:33.692338 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:33.692338 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-0524567a-fc96-4df7-b440-8af3ab2db3cb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0524567a-fc96-4df7-b440-8af3ab2db3cb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Request method failure captured: Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c/action HTTP/1.1 Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 32 Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7k87sm7WV03FM7bZ8JjHyvQfPnVPLjS8igb88BLXVKmU_5cWSQLGEJGPSdMyWuitZn_vyOfy_MRB5UuFQaoEkCRZuXZwqy6IGsGpeN98b6g_VAprshPTrzwmmZdhYp3OkQB85942qKskPxRA_FIoWgy2xmo-4iwmpVti-FLjmF-gDI Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: c3d5a2fb6b4440168a7e84d03007a6fb Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-MigrationsAdminTest-1971141865 Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:14:33.693216 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:14:33.694521 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c3d5a2fb6b4440168a7e84d03007a6fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_c3d5a2fb6b4440168a7e84d03007a6fb", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c3d5a2fb6b4440168a7e84d03007a6fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/c3d5a2fb6b4440168a7e84d03007a6fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:14:33.694521 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-MigrationsAdminTest-1971141865 Aug 22 17:14:33.694521 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: c3d5a2fb6b4440168a7e84d03007a6fb Aug 22 17:14:33.694521 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-MigrationsAdminTest-1971141865 Aug 22 17:14:33.694521 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-MigrationsAdminTest-1971141865-project Aug 22 17:14:33.694521 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:14:33.694521 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:14:33.694521 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: dafa41865864461fa0e0dbc4a0188e4b Aug 22 17:14:33.694521 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-MigrationsAdminTest-1971141865-project Aug 22 17:14:33.694521 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:14:33.694521 n-d-854030-1 devstack@n-api.service[123015]: {"resize": {"flavorRef": "451"}} Aug 22 17:14:33.694521 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:14:33.694521 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:33.696224 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:14:33.696224 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '30fb117d-2950-4ba7-98a0-fd8874ad006c', 'body': {'resize': {'flavorRef': '451'}}} Aug 22 17:14:33.696224 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:14:33.696224 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:33.696224 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:33.696224 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:33.696224 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:33.696224 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:33.696224 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 22 17:14:33.696224 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 22 17:14:33.696224 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 22 17:14:33.696224 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 22 17:14:33.696224 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 22 17:14:33.696224 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 22 17:14:33.696224 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 22 17:14:33.696224 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 22 17:14:33.696224 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:14:33.696224 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:14:33.696224 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:14:33.698737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:14:33.698737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:14:33.698737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:14:33.698737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:33.698737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:33.698737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:14:33.698737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:14:33.698737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:33.698737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:33.698737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:14:33.698737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:14:33.698737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:33.698737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:33.698737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:14:33.698737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:14:33.698737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:33.698737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:33.698737 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:14:33.701904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:14:33.701904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:14:33.701904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:14:33.701904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:14:33.701904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:14:33.701904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:14:33.701904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:14:33.701904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:14:33.701904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:14:33.701904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:14:33.701904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:14:33.701904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:14:33.701904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:14:33.701904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:14:33.701904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:14:33.701904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:14:33.701904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:14:33.704199 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:14:33.704199 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:14:33.704199 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:14:33.704199 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:14:33.704199 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:14:33.704199 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:14:33.704199 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:14:33.704199 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:14:33.704199 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6caf9749-2fdc-4460-bd08-091b0704aa68) Aug 22 17:14:33.704199 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:33.704199 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:33.704199 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:33.704199 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:33.704199 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:33.704199 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:33.704199 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:14:33.704199 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:14:33.709576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:14:33.709576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:14:33.709576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:33.709576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:33.709576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:33.709576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:33.709576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:33.709576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:33.709576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:33.709576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:33.709576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:14:33.709576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:14:33.709576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:33.709576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:33.709576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:33.709576 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0524567a-fc96-4df7-b440-8af3ab2db3cb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:33.709576 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:14:33.712264 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0524567a-fc96-4df7-b440-8af3ab2db3cb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "POST /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c/action" status: 500 len: 214 microversion: 2.1 time: 0.337152 Aug 22 17:14:33.712264 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 405/774] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:14:33 2022] POST /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c/action => generated 214 bytes in 349 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:14:33.726361 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-86c80faf-b0e2-4703-9a27-0b30e0450efc tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:33.746078 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-86c80faf-b0e2-4703-9a27-0b30e0450efc tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028391 Aug 22 17:14:33.748797 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 406/775] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:14:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:33.759703 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0ecb3869-bc20-42b2-ba23-61276b9bf49e tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1994349491", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:33.768602 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:14:33.768602 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:14:33.862318 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:33.897477 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0ecb3869-bc20-42b2-ba23-61276b9bf49e tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.141934 Aug 22 17:14:33.898425 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 407/776] 10.222.0.96 () {60 vars in 1146 bytes} [Mon Aug 22 17:14:33 2022] POST /compute/v2.1/flavors => generated 499 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:33.910617 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-bb7f3248-febb-4efa-b424-c1ff3f5021f6 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:33.935087 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-bb7f3248-febb-4efa-b424-c1ff3f5021f6 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028563 Aug 22 17:14:33.946100 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 408/777] 10.222.0.96 () {58 vars in 1182 bytes} [Mon Aug 22 17:14:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 22 17:14:34.087071 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-db606c32-35d2-4536-9776-183243d697db tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:34.101457 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-db606c32-35d2-4536-9776-183243d697db tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1317 microversion: 2.1 time: 0.782758 Aug 22 17:14:34.103155 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 370/778] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:33 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1317 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:34.170734 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-40df8c4c-c1ce-4ed7-9003-680eedda001b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1826632987", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "523673ea-12b5-4048-975a-43685837c4d8"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:34.228420 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-caca4487-de79-4d61-b8af-08426c5ce32f tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:34.229961 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-caca4487-de79-4d61-b8af-08426c5ce32f tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:34.243879 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-caca4487-de79-4d61-b8af-08426c5ce32f tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:34.244808 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-caca4487-de79-4d61-b8af-08426c5ce32f tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:34.245789 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-caca4487-de79-4d61-b8af-08426c5ce32f tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:34.246672 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-caca4487-de79-4d61-b8af-08426c5ce32f tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:34.254971 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-caca4487-de79-4d61-b8af-08426c5ce32f tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:34.262700 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-caca4487-de79-4d61-b8af-08426c5ce32f tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:34.274808 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-40df8c4c-c1ce-4ed7-9003-680eedda001b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] validate_networks() for None {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:14:34.781925 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-caca4487-de79-4d61-b8af-08426c5ce32f tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:34.794683 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-caca4487-de79-4d61-b8af-08426c5ce32f tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1314 microversion: 2.1 time: 0.577455 Aug 22 17:14:34.798111 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 371/779] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:34 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:35.126128 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b21e1b6a-e1a4-41a9-b9d2-36998a73f5f6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:35.127356 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b21e1b6a-e1a4-41a9-b9d2-36998a73f5f6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:35.143372 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b21e1b6a-e1a4-41a9-b9d2-36998a73f5f6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:35.143372 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b21e1b6a-e1a4-41a9-b9d2-36998a73f5f6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:35.143372 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b21e1b6a-e1a4-41a9-b9d2-36998a73f5f6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:35.144003 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b21e1b6a-e1a4-41a9-b9d2-36998a73f5f6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:35.144465 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b21e1b6a-e1a4-41a9-b9d2-36998a73f5f6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:35.144889 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b21e1b6a-e1a4-41a9-b9d2-36998a73f5f6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:35.511390 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-40df8c4c-c1ce-4ed7-9003-680eedda001b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:14:35.511939 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-40df8c4c-c1ce-4ed7-9003-680eedda001b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:14:35.512274 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-40df8c4c-c1ce-4ed7-9003-680eedda001b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:14:35.512680 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-40df8c4c-c1ce-4ed7-9003-680eedda001b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:14:35.513108 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-40df8c4c-c1ce-4ed7-9003-680eedda001b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:14:35.527363 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-40df8c4c-c1ce-4ed7-9003-680eedda001b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:35.527850 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-40df8c4c-c1ce-4ed7-9003-680eedda001b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:35.528286 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-40df8c4c-c1ce-4ed7-9003-680eedda001b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:35.529010 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-40df8c4c-c1ce-4ed7-9003-680eedda001b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:35.531419 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-40df8c4c-c1ce-4ed7-9003-680eedda001b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:35.534459 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-40df8c4c-c1ce-4ed7-9003-680eedda001b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:35.561045 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b21e1b6a-e1a4-41a9-b9d2-36998a73f5f6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:35.569396 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-40df8c4c-c1ce-4ed7-9003-680eedda001b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Getting quotas for project c3d5a2fb6b4440168a7e84d03007a6fb. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:14:35.577519 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b21e1b6a-e1a4-41a9-b9d2-36998a73f5f6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1317 microversion: 2.1 time: 0.457464 Aug 22 17:14:35.581968 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-40df8c4c-c1ce-4ed7-9003-680eedda001b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Getting quotas for user dafa41865864461fa0e0dbc4a0188e4b and project c3d5a2fb6b4440168a7e84d03007a6fb. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:14:35.587204 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 372/780] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:35 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:35.606753 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-40df8c4c-c1ce-4ed7-9003-680eedda001b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Going to run 1 instances... {{(pid=123015) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:14:35.614633 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-40df8c4c-c1ce-4ed7-9003-680eedda001b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:14:35.820522 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-995415c1-71b8-4dc7-b07a-fd955b4b4665 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:35.821922 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-995415c1-71b8-4dc7-b07a-fd955b4b4665 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:35.822515 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-40df8c4c-c1ce-4ed7-9003-680eedda001b tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.656684 Aug 22 17:14:35.825952 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 409/781] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:14:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:14:35.840715 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-995415c1-71b8-4dc7-b07a-fd955b4b4665 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:35.841497 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-498733bb-604e-4fcc-9451-3d6d5cb3604c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:35.842319 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-498733bb-604e-4fcc-9451-3d6d5cb3604c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:35.842737 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-995415c1-71b8-4dc7-b07a-fd955b4b4665 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:35.843192 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-995415c1-71b8-4dc7-b07a-fd955b4b4665 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:35.844040 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-995415c1-71b8-4dc7-b07a-fd955b4b4665 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:35.844561 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-995415c1-71b8-4dc7-b07a-fd955b4b4665 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:35.844989 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-995415c1-71b8-4dc7-b07a-fd955b4b4665 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:36.092553 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-498733bb-604e-4fcc-9451-3d6d5cb3604c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:36.107216 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-498733bb-604e-4fcc-9451-3d6d5cb3604c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 200 len: 1279 microversion: 2.1 time: 0.271904 Aug 22 17:14:36.108367 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 410/782] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:35 2022] GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 1279 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:36.598382 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-87c6b99f-1191-4d93-9658-d162de24679b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:36.600114 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-87c6b99f-1191-4d93-9658-d162de24679b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:36.615616 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-87c6b99f-1191-4d93-9658-d162de24679b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:36.616109 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-87c6b99f-1191-4d93-9658-d162de24679b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:36.616543 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-87c6b99f-1191-4d93-9658-d162de24679b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:36.617288 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-87c6b99f-1191-4d93-9658-d162de24679b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:36.617742 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-87c6b99f-1191-4d93-9658-d162de24679b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:36.618159 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-87c6b99f-1191-4d93-9658-d162de24679b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:37.289590 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-995415c1-71b8-4dc7-b07a-fd955b4b4665 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:37.313165 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-995415c1-71b8-4dc7-b07a-fd955b4b4665 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1314 microversion: 2.1 time: 1.495975 Aug 22 17:14:37.313776 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 373/783] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:35 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1314 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:14:37.328310 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-88729236-4f41-466d-b95f-f7999ec6f904 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:37.329142 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-88729236-4f41-466d-b95f-f7999ec6f904 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:37.341219 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-87c6b99f-1191-4d93-9658-d162de24679b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:37.349704 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-87c6b99f-1191-4d93-9658-d162de24679b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1466 microversion: 2.1 time: 0.755138 Aug 22 17:14:37.350294 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 411/784] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:36 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1466 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:14:37.360383 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-88729236-4f41-466d-b95f-f7999ec6f904 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:37.360879 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-88729236-4f41-466d-b95f-f7999ec6f904 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:37.361397 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-88729236-4f41-466d-b95f-f7999ec6f904 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:37.362137 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-88729236-4f41-466d-b95f-f7999ec6f904 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:37.362478 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-88729236-4f41-466d-b95f-f7999ec6f904 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:37.362928 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-88729236-4f41-466d-b95f-f7999ec6f904 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:37.594512 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-88729236-4f41-466d-b95f-f7999ec6f904 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:37.602882 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-88729236-4f41-466d-b95f-f7999ec6f904 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 200 len: 1283 microversion: 2.1 time: 0.288009 Aug 22 17:14:37.608157 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 374/785] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:37 2022] GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 1283 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:37.913454 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-30c65a10-43ac-453c-9d71-1fe5c2c5045b tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:37.914667 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-30c65a10-43ac-453c-9d71-1fe5c2c5045b tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:37.925125 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-30c65a10-43ac-453c-9d71-1fe5c2c5045b tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:37.925682 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-30c65a10-43ac-453c-9d71-1fe5c2c5045b tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:37.927243 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-30c65a10-43ac-453c-9d71-1fe5c2c5045b tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:37.928549 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-30c65a10-43ac-453c-9d71-1fe5c2c5045b tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:37.929236 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-30c65a10-43ac-453c-9d71-1fe5c2c5045b tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:37.930425 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-30c65a10-43ac-453c-9d71-1fe5c2c5045b tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:38.336747 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8275e926-d72f-4ac9-bc6a-69b4437566d4 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:38.338030 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-8275e926-d72f-4ac9-bc6a-69b4437566d4 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:38.348807 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8275e926-d72f-4ac9-bc6a-69b4437566d4 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:38.349352 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8275e926-d72f-4ac9-bc6a-69b4437566d4 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:38.354536 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8275e926-d72f-4ac9-bc6a-69b4437566d4 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:38.358066 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8275e926-d72f-4ac9-bc6a-69b4437566d4 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:38.359113 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8275e926-d72f-4ac9-bc6a-69b4437566d4 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:38.359723 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8275e926-d72f-4ac9-bc6a-69b4437566d4 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:38.757163 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-8275e926-d72f-4ac9-bc6a-69b4437566d4 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:38.784076 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8275e926-d72f-4ac9-bc6a-69b4437566d4 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1314 microversion: 2.1 time: 0.436653 Aug 22 17:14:38.806604 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 375/786] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:38 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:38.825044 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d56db49b-8d79-46ff-b73b-e937dcb0c138 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:38.826255 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-d56db49b-8d79-46ff-b73b-e937dcb0c138 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:38.840251 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d56db49b-8d79-46ff-b73b-e937dcb0c138 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:38.841028 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d56db49b-8d79-46ff-b73b-e937dcb0c138 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:38.841844 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d56db49b-8d79-46ff-b73b-e937dcb0c138 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:38.847300 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d56db49b-8d79-46ff-b73b-e937dcb0c138 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:38.848122 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d56db49b-8d79-46ff-b73b-e937dcb0c138 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:38.848712 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d56db49b-8d79-46ff-b73b-e937dcb0c138 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:38.998088 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-d56db49b-8d79-46ff-b73b-e937dcb0c138 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:39.003020 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=100 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:39.019013 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d56db49b-8d79-46ff-b73b-e937dcb0c138 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 200 len: 1331 microversion: 2.1 time: 0.209533 Aug 22 17:14:39.019848 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 376/787] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:38 2022] GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 1331 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:39.412018 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-30c65a10-43ac-453c-9d71-1fe5c2c5045b tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1617 microversion: 2.1 time: 2.030910 Aug 22 17:14:39.431513 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 412/788] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:37 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1617 bytes in 2048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:39.437839 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-792ca00c-9c80-4dad-9fa1-a7110812cf5a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Action: 'create', calling method: .version_select at 0x7f8009a341f0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-747339881", "policies": ["affinity"]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:39.489555 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-792ca00c-9c80-4dad-9fa1-a7110812cf5a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:14:39.508653 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-792ca00c-9c80-4dad-9fa1-a7110812cf5a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for user 43188026fda44118ad642b7065108966 and project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:14:39.701221 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-792ca00c-9c80-4dad-9fa1-a7110812cf5a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:14:39.714461 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-792ca00c-9c80-4dad-9fa1-a7110812cf5a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for user 43188026fda44118ad642b7065108966 and project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:14:39.748069 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-792ca00c-9c80-4dad-9fa1-a7110812cf5a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.314748 Aug 22 17:14:39.753622 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 377/789] 10.222.0.96 () {60 vars in 1174 bytes} [Mon Aug 22 17:14:39 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:39.811244 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4e221c11-1f0e-46e4-86a8-90c39dba98ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:39.811892 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-4e221c11-1f0e-46e4-86a8-90c39dba98ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:39.836608 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4e221c11-1f0e-46e4-86a8-90c39dba98ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:39.837030 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4e221c11-1f0e-46e4-86a8-90c39dba98ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:39.837497 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4e221c11-1f0e-46e4-86a8-90c39dba98ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:39.838958 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4e221c11-1f0e-46e4-86a8-90c39dba98ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:39.841205 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4e221c11-1f0e-46e4-86a8-90c39dba98ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:39.841683 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4e221c11-1f0e-46e4-86a8-90c39dba98ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:40.048207 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0940b255-d7f4-42f1-8b9e-e064fc2124a7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:40.048836 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-0940b255-d7f4-42f1-8b9e-e064fc2124a7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:40.062079 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0940b255-d7f4-42f1-8b9e-e064fc2124a7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:40.075268 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0940b255-d7f4-42f1-8b9e-e064fc2124a7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:40.075268 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0940b255-d7f4-42f1-8b9e-e064fc2124a7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:40.075268 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0940b255-d7f4-42f1-8b9e-e064fc2124a7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:40.075268 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0940b255-d7f4-42f1-8b9e-e064fc2124a7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:40.075824 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0940b255-d7f4-42f1-8b9e-e064fc2124a7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:40.436141 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-0940b255-d7f4-42f1-8b9e-e064fc2124a7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:40.461401 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0940b255-d7f4-42f1-8b9e-e064fc2124a7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 200 len: 1337 microversion: 2.1 time: 0.421262 Aug 22 17:14:40.480270 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 378/790] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:40 2022] GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 1337 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:14:40.496180 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-569081638", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "e933271f-229e-4e83-b54f-0d94d04187ec"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:40.532921 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-4e221c11-1f0e-46e4-86a8-90c39dba98ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:40.553960 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-4e221c11-1f0e-46e4-86a8-90c39dba98ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1314 microversion: 2.1 time: 0.747481 Aug 22 17:14:40.556815 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 413/791] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:39 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:40.625524 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] validate_networks() for None {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:14:41.144979 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:14:41.145694 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:14:41.146368 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:14:41.147155 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:14:41.147855 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:14:41.205567 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:41.206063 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:41.206509 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:41.207261 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:41.212491 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:41.212491 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:41.232653 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for project d789047469894e1fbe5af3a109a95b4c. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:14:41.238049 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for user 43188026fda44118ad642b7065108966 and project d789047469894e1fbe5af3a109a95b4c. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:14:41.254067 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Going to run 2 instances... {{(pid=123016) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:14:41.258310 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 1637eb7d-9aaf-4222-8c72-451f8599172f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:14:41.377426 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0c888dd6-7531-4f1a-b63d-725302f6ef97 tempest-ImagesOneServerNegativeTestJSON-1517639314 tempest-ImagesOneServerNegativeTestJSON-1517639314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1476341902", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "3bd5f782-bb32-46ac-b839-dd730648ae2e"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:41.463637 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-0c888dd6-7531-4f1a-b63d-725302f6ef97 tempest-ImagesOneServerNegativeTestJSON-1517639314 tempest-ImagesOneServerNegativeTestJSON-1517639314-project] validate_networks() for [('3bd5f782-bb32-46ac-b839-dd730648ae2e', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:14:41.501777 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=123016) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 22 17:14:41.533039 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_group_members'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:14:41.542343 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for user 43188026fda44118ad642b7065108966 and project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_group_members'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:14:41.714807 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_group_members'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:14:41.722906 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for user 43188026fda44118ad642b7065108966 and project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_group_members'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:14:41.744268 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=1637eb7d-9aaf-4222-8c72-451f8599172f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:14:41.909934 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_group_members'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:14:41.919728 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:41.938041 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for user 43188026fda44118ad642b7065108966 and project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_group_members'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:14:42.140424 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_group_members'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:14:42.166789 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for user 43188026fda44118ad642b7065108966 and project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_group_members'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:14:42.231846 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-17467fb8-d3a5-44e3-88c9-298d16cc3618 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.749444 Aug 22 17:14:42.232810 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 379/792] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:14:40 2022] POST /compute/v2.1/servers => generated 32 bytes in 1751 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 22 17:14:42.238042 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-31fbb25a-8296-44bb-8d06-c9e3999c0c74 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80099cad30>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:42.311012 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-31fbb25a-8296-44bb-8d06-c9e3999c0c74 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/fe5e2235-fe7f-4080-a7ea-af5a4d98ebb4" status: 200 len: 660 microversion: 2.1 time: 0.075501 Aug 22 17:14:42.323690 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 380/793] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:14:42 2022] GET /compute/v2.1/images/fe5e2235-fe7f-4080-a7ea-af5a4d98ebb4 => generated 660 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:42.339489 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8049dc06-4e32-4e79-90f7-7d3d01efaab8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:42.340426 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-8049dc06-4e32-4e79-90f7-7d3d01efaab8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:42.348898 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8049dc06-4e32-4e79-90f7-7d3d01efaab8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:42.349773 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8049dc06-4e32-4e79-90f7-7d3d01efaab8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:42.350399 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8049dc06-4e32-4e79-90f7-7d3d01efaab8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:42.351310 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8049dc06-4e32-4e79-90f7-7d3d01efaab8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:42.352188 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8049dc06-4e32-4e79-90f7-7d3d01efaab8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:42.353497 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8049dc06-4e32-4e79-90f7-7d3d01efaab8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:42.642319 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-8049dc06-4e32-4e79-90f7-7d3d01efaab8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:42.652515 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8049dc06-4e32-4e79-90f7-7d3d01efaab8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 200 len: 1379 microversion: 2.1 time: 0.327296 Aug 22 17:14:42.653197 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 381/794] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:42 2022] GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 1379 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:42.665957 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9b6b33d9-d5ce-4c50-ae41-159b07882641 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:42.665957 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-9b6b33d9-d5ce-4c50-ae41-159b07882641 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:42.665957 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b6b33d9-d5ce-4c50-ae41-159b07882641 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:42.666749 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b6b33d9-d5ce-4c50-ae41-159b07882641 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:42.667171 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b6b33d9-d5ce-4c50-ae41-159b07882641 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:42.668064 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b6b33d9-d5ce-4c50-ae41-159b07882641 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:42.668563 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b6b33d9-d5ce-4c50-ae41-159b07882641 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:42.669000 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b6b33d9-d5ce-4c50-ae41-159b07882641 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:43.115934 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9b6b33d9-d5ce-4c50-ae41-159b07882641 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:43.126816 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9b6b33d9-d5ce-4c50-ae41-159b07882641 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1314 microversion: 2.1 time: 0.472524 Aug 22 17:14:43.130277 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 382/795] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:42 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:43.136970 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-85dc9b6a-1cd8-4f68-a27d-f2b15ce95c1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:43.143266 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-85dc9b6a-1cd8-4f68-a27d-f2b15ce95c1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:43.144538 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-85dc9b6a-1cd8-4f68-a27d-f2b15ce95c1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Searching by: {'deleted': False, 'project_id': 'd789047469894e1fbe5af3a109a95b4c'} {{(pid=123016) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 22 17:14:43.178119 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-0c888dd6-7531-4f1a-b63d-725302f6ef97 tempest-ImagesOneServerNegativeTestJSON-1517639314 tempest-ImagesOneServerNegativeTestJSON-1517639314-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c8e1414d-4a65-4711-901f-b1cf8cbf9325) Aug 22 17:14:43.178119 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:43.178119 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:43.178119 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:43.178119 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:43.178119 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:43.178119 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:43.178119 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:43.178119 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:43.178119 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:43.178119 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:14:43.178119 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:14:43.178119 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:14:43.178119 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:14:43.178119 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:14:43.178119 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:14:43.179837 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:14:43.179837 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:14:43.179837 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:14:43.179837 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:14:43.179837 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:14:43.179837 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:14:43.179837 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:14:43.179837 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:14:43.179837 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:14:43.179837 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:14:43.179837 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:14:43.179837 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:43.179837 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:43.179837 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:14:43.179837 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:14:43.179837 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:43.179837 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:43.179837 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:14:43.181328 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:14:43.181328 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:43.181328 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:43.181328 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:14:43.181328 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:14:43.181328 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:43.181328 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:43.181328 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:14:43.181328 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:14:43.181328 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:14:43.181328 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:14:43.181328 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:14:43.181328 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:14:43.181328 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:14:43.181328 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:14:43.181328 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:14:43.181328 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:14:43.181328 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:14:43.183974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:14:43.183974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:14:43.183974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:14:43.183974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:14:43.183974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:14:43.183974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:14:43.183974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:14:43.183974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:14:43.183974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:14:43.183974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:14:43.183974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:14:43.183974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:14:43.183974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:14:43.183974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:14:43.183974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:14:43.185590 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c8e1414d-4a65-4711-901f-b1cf8cbf9325) Aug 22 17:14:43.185590 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:43.186298 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-85dc9b6a-1cd8-4f68-a27d-f2b15ce95c1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:43.187092 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-85dc9b6a-1cd8-4f68-a27d-f2b15ce95c1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:43.187359 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-0c888dd6-7531-4f1a-b63d-725302f6ef97 tempest-ImagesOneServerNegativeTestJSON-1517639314 tempest-ImagesOneServerNegativeTestJSON-1517639314-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:43.187359 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:14:43.188027 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-85dc9b6a-1cd8-4f68-a27d-f2b15ce95c1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:43.189025 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-85dc9b6a-1cd8-4f68-a27d-f2b15ce95c1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:43.189772 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-85dc9b6a-1cd8-4f68-a27d-f2b15ce95c1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0c888dd6-7531-4f1a-b63d-725302f6ef97 tempest-ImagesOneServerNegativeTestJSON-1517639314 tempest-ImagesOneServerNegativeTestJSON-1517639314-project] Request method failure captured: Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 217 Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7mAk1dPuQDkjwN4D_8HvGnDfl0vRljU-rflIRCN4WsjjQjmMUWXcYrOmmmgDjeTlL7w9X20GpUhFSbWsb7yRkay1aOpgp8D9Qnx7F58GDkoA3I5CXEjs-d6uzhZ3gGm2PGlm7kqcpr1hELv7wzf264C4LKepNDeIRUKmGpGLq8MVbU Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: f3b47dd2b36e4a76bd6f171bc0df94c7 Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1517639314 Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:14:43.190456 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:14:43.192205 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/f3b47dd2b36e4a76bd6f171bc0df94c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_f3b47dd2b36e4a76bd6f171bc0df94c7", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/f3b47dd2b36e4a76bd6f171bc0df94c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/f3b47dd2b36e4a76bd6f171bc0df94c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:14:43.192205 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1517639314 Aug 22 17:14:43.192205 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: f3b47dd2b36e4a76bd6f171bc0df94c7 Aug 22 17:14:43.192205 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1517639314 Aug 22 17:14:43.192205 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ImagesOneServerNegativeTestJSON-1517639314-project Aug 22 17:14:43.192205 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:14:43.192205 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:14:43.192205 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: b98a80953a544b7b8dc74e74be4c89ff Aug 22 17:14:43.192205 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1517639314-project Aug 22 17:14:43.192205 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:14:43.192205 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1476341902", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "3bd5f782-bb32-46ac-b839-dd730648ae2e"}]}} Aug 22 17:14:43.192896 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:14:43.192896 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:43.192896 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:14:43.192896 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ImagesOneServerNegativeTestJSON-server-1476341902', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '3bd5f782-bb32-46ac-b839-dd730648ae2e'}]}}} Aug 22 17:14:43.192896 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:14:43.192896 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:43.192896 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:14:43.192896 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:14:43.192896 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:43.192896 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:43.192896 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:43.192896 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:43.192896 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:14:43.192896 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:14:43.192896 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:14:43.192896 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:14:43.192896 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:14:43.192896 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:14:43.192896 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:14:43.194178 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:14:43.194178 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:14:43.194178 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:14:43.194178 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:14:43.194178 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:14:43.194178 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:14:43.194178 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:14:43.194178 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:14:43.194178 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:14:43.194178 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:14:43.194178 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:14:43.194178 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:14:43.194178 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:43.194178 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:43.194178 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:14:43.194178 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:14:43.194178 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:43.194178 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:43.196460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:14:43.196460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:14:43.196460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:43.196460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:43.196460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:14:43.196460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:14:43.196460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:14:43.196460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:14:43.196460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:14:43.196460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:14:43.196460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:14:43.196460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:14:43.196460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:14:43.196460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:14:43.196460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:14:43.196460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:14:43.196460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:14:43.196460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:14:43.199903 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:14:43.199903 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:14:43.199903 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:14:43.199903 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:14:43.199903 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:14:43.199903 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:14:43.199903 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:14:43.199903 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:14:43.199903 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:14:43.199903 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:14:43.199903 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:14:43.199903 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:14:43.199903 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:14:43.199903 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:14:43.199903 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:14:43.199903 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:14:43.201952 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c8e1414d-4a65-4711-901f-b1cf8cbf9325) Aug 22 17:14:43.201952 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:43.201952 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:43.201952 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:43.201952 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:43.201952 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:43.201952 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:43.201952 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:14:43.201952 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:14:43.201952 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:14:43.201952 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:14:43.201952 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:43.201952 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:43.201952 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:43.201952 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:14:43.201952 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:43.201952 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:14:43.201952 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:14:43.201952 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:14:43.203917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:14:43.203917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:14:43.203917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:43.203917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:43.203917 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:14:43.203917 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0c888dd6-7531-4f1a-b63d-725302f6ef97 tempest-ImagesOneServerNegativeTestJSON-1517639314 tempest-ImagesOneServerNegativeTestJSON-1517639314-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:14:43.203917 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:14:43.204637 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-85dc9b6a-1cd8-4f68-a27d-f2b15ce95c1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:43.204772 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0c888dd6-7531-4f1a-b63d-725302f6ef97 tempest-ImagesOneServerNegativeTestJSON-1517639314 tempest-ImagesOneServerNegativeTestJSON-1517639314-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.131787 Aug 22 17:14:43.205928 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 414/796] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:14:41 2022] POST /compute/v2.1/servers => generated 214 bytes in 2145 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:14:43.216133 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1f05966e-9ee0-42dd-b60c-4110b2a0146e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009946f70>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:43.316691 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1f05966e-9ee0-42dd-b60c-4110b2a0146e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/fe5e2235-fe7f-4080-a7ea-af5a4d98ebb4" status: 200 len: 660 microversion: 2.1 time: 0.106338 Aug 22 17:14:43.317860 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 415/797] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:14:43 2022] GET /compute/v2.1/images/fe5e2235-fe7f-4080-a7ea-af5a4d98ebb4 => generated 660 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:43.330170 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-c15db806-7c88-466d-b483-fd0468cc0650 req-993bfe4d-4555-41d6-a9c7-dd7121bfbcb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94de208f-edff-400d-840d-1cb7eafb3913", "tag": "cf9aa49c-6ca6-427a-b18b-f185e8006fca"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:43.351206 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-c15db806-7c88-466d-b483-fd0468cc0650 req-993bfe4d-4555-41d6-a9c7-dd7121bfbcb8 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:43.351785 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-c15db806-7c88-466d-b483-fd0468cc0650 req-993bfe4d-4555-41d6-a9c7-dd7121bfbcb8 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:43.352292 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-c15db806-7c88-466d-b483-fd0468cc0650 req-993bfe4d-4555-41d6-a9c7-dd7121bfbcb8 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:43.387260 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-c15db806-7c88-466d-b483-fd0468cc0650 req-993bfe4d-4555-41d6-a9c7-dd7121bfbcb8 service nova] Creating event network-changed:cf9aa49c-6ca6-427a-b18b-f185e8006fca for instance 94de208f-edff-400d-840d-1cb7eafb3913 on n-h2-854030-1 Aug 22 17:14:43.403906 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-c15db806-7c88-466d-b483-fd0468cc0650 req-993bfe4d-4555-41d6-a9c7-dd7121bfbcb8 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084689 Aug 22 17:14:43.418018 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 416/798] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:43.677011 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-bd90478d-e7f9-47ce-9bae-a5f2cad20535 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:43.678166 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-bd90478d-e7f9-47ce-9bae-a5f2cad20535 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:43.689655 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bd90478d-e7f9-47ce-9bae-a5f2cad20535 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:43.698410 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bd90478d-e7f9-47ce-9bae-a5f2cad20535 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:43.698410 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bd90478d-e7f9-47ce-9bae-a5f2cad20535 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:43.698410 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bd90478d-e7f9-47ce-9bae-a5f2cad20535 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:43.698410 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bd90478d-e7f9-47ce-9bae-a5f2cad20535 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:43.699066 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bd90478d-e7f9-47ce-9bae-a5f2cad20535 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:43.712613 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.multi_cell_list [None req-85dc9b6a-1cd8-4f68-a27d-f2b15ce95c1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=123016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 22 17:14:43.750838 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=100 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:43.850780 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-85dc9b6a-1cd8-4f68-a27d-f2b15ce95c1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.718479 Aug 22 17:14:43.858502 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 383/799] 10.222.0.96 () {58 vars in 1125 bytes} [Mon Aug 22 17:14:43 2022] GET /compute/v2.1/servers => generated 1002 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:43.864100 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-28b81007-3807-4581-9c04-66811c644667 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:43.864761 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-28b81007-3807-4581-9c04-66811c644667 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:43.966820 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-28b81007-3807-4581-9c04-66811c644667 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:43.980159 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-28b81007-3807-4581-9c04-66811c644667 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 200 len: 1218 microversion: 2.1 time: 0.118262 Aug 22 17:14:43.999440 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 384/800] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:43 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:14:44.147986 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c584db78-971c-437e-8b30-bbb1862dc452 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:44.149161 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c584db78-971c-437e-8b30-bbb1862dc452 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:44.166294 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c584db78-971c-437e-8b30-bbb1862dc452 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:44.167036 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c584db78-971c-437e-8b30-bbb1862dc452 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:44.167655 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c584db78-971c-437e-8b30-bbb1862dc452 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:44.168584 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c584db78-971c-437e-8b30-bbb1862dc452 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:44.169155 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c584db78-971c-437e-8b30-bbb1862dc452 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:44.169862 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c584db78-971c-437e-8b30-bbb1862dc452 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:44.280475 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-bd90478d-e7f9-47ce-9bae-a5f2cad20535 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:44.290233 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-bd90478d-e7f9-47ce-9bae-a5f2cad20535 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 200 len: 1379 microversion: 2.1 time: 0.618172 Aug 22 17:14:44.300003 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 417/801] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:43 2022] GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 1379 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:44.442261 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c584db78-971c-437e-8b30-bbb1862dc452 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:44.454439 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c584db78-971c-437e-8b30-bbb1862dc452 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1314 microversion: 2.1 time: 0.309047 Aug 22 17:14:44.458191 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 385/802] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:44 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:44.986171 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-787c76cb-9f2b-4418-8ce7-d07d30792f80 req-8ce817b8-dd03-4af7-b5f0-82046530a3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e734abd7-7fe7-40b1-b6fc-49590a36e09d", "name": "network-vif-plugged", "status": "completed", "tag": "be9b2e4a-414d-4baa-8230-42315bf4e034"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:45.003721 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-787c76cb-9f2b-4418-8ce7-d07d30792f80 req-8ce817b8-dd03-4af7-b5f0-82046530a3e0 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:45.004507 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-787c76cb-9f2b-4418-8ce7-d07d30792f80 req-8ce817b8-dd03-4af7-b5f0-82046530a3e0 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:45.005184 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-787c76cb-9f2b-4418-8ce7-d07d30792f80 req-8ce817b8-dd03-4af7-b5f0-82046530a3e0 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:45.028614 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-787c76cb-9f2b-4418-8ce7-d07d30792f80 req-8ce817b8-dd03-4af7-b5f0-82046530a3e0 service nova] Creating event network-vif-plugged:be9b2e4a-414d-4baa-8230-42315bf4e034 for instance e734abd7-7fe7-40b1-b6fc-49590a36e09d on n-h1-854030-1 Aug 22 17:14:45.037426 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-787c76cb-9f2b-4418-8ce7-d07d30792f80 req-8ce817b8-dd03-4af7-b5f0-82046530a3e0 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063434 Aug 22 17:14:45.038359 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 418/803] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:45.046363 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a21525cd-a327-4306-8b27-bf62db94ae3c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:45.065345 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a21525cd-a327-4306-8b27-bf62db94ae3c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:45.295261 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a21525cd-a327-4306-8b27-bf62db94ae3c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:45.298431 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f65f6516-431b-454e-b4ae-4ca39506ecac tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] Action: 'create', calling method: .version_select at 0x7f8009aa88b0>, body: {"keypair": {"name": "tempest-keypair-426684846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3825aWG1EUVHiO5bgHrMfIOrGpK5h4rolZCvc0ty2lOprMEjKztBEqbdnG88tv4OhHBaGN+wPZNlKsxm7NIgpJNQFv/1Y+lon2+Lkr5NOjrh6Kp+Y3TNjKEbGjpKHgVQ=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:45.311612 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a21525cd-a327-4306-8b27-bf62db94ae3c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 200 len: 1218 microversion: 2.1 time: 0.267817 Aug 22 17:14:45.312528 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 419/804] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:45 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 1218 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:45.326468 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-42f4d2d9-1321-427c-a418-b0943cae9a89 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:45.328998 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-42f4d2d9-1321-427c-a418-b0943cae9a89 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:45.361406 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-f65f6516-431b-454e-b4ae-4ca39506ecac tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] Getting quotas for project 57aa3e1076cf43338cc3a48a6d2c83d4. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:14:45.372575 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-f65f6516-431b-454e-b4ae-4ca39506ecac tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] Getting quotas for user 075de197fb044b8596060c5b3e0f117b and project 57aa3e1076cf43338cc3a48a6d2c83d4. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:14:45.375450 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-42f4d2d9-1321-427c-a418-b0943cae9a89 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:45.376916 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-42f4d2d9-1321-427c-a418-b0943cae9a89 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:45.377404 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-42f4d2d9-1321-427c-a418-b0943cae9a89 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:45.379382 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-42f4d2d9-1321-427c-a418-b0943cae9a89 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:45.379875 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-42f4d2d9-1321-427c-a418-b0943cae9a89 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:45.380389 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-42f4d2d9-1321-427c-a418-b0943cae9a89 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:45.547954 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:45.620185 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f65f6516-431b-454e-b4ae-4ca39506ecac tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.609430 Aug 22 17:14:45.620870 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 386/805] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:14:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:14:45.626018 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b64a1f93-09ac-45b0-b9a2-d1d0d0b303f7 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:45.631245 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b64a1f93-09ac-45b0-b9a2-d1d0d0b303f7 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:45.648862 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b64a1f93-09ac-45b0-b9a2-d1d0d0b303f7 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:45.649489 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b64a1f93-09ac-45b0-b9a2-d1d0d0b303f7 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:45.656659 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b64a1f93-09ac-45b0-b9a2-d1d0d0b303f7 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:45.657849 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b64a1f93-09ac-45b0-b9a2-d1d0d0b303f7 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:45.658141 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b64a1f93-09ac-45b0-b9a2-d1d0d0b303f7 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:45.666736 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b64a1f93-09ac-45b0-b9a2-d1d0d0b303f7 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:46.159829 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-42f4d2d9-1321-427c-a418-b0943cae9a89 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:46.177023 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-42f4d2d9-1321-427c-a418-b0943cae9a89 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 200 len: 1379 microversion: 2.1 time: 0.863180 Aug 22 17:14:46.198201 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 420/806] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:45 2022] GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 1379 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:46.345699 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a5428b0a-1abc-4948-a862-3d2c5cfe1a28 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:46.347231 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a5428b0a-1abc-4948-a862-3d2c5cfe1a28 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:46.358915 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a5428b0a-1abc-4948-a862-3d2c5cfe1a28 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:46.359613 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a5428b0a-1abc-4948-a862-3d2c5cfe1a28 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:46.361151 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a5428b0a-1abc-4948-a862-3d2c5cfe1a28 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:46.362666 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a5428b0a-1abc-4948-a862-3d2c5cfe1a28 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:46.364753 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a5428b0a-1abc-4948-a862-3d2c5cfe1a28 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:46.365555 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a5428b0a-1abc-4948-a862-3d2c5cfe1a28 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:46.384266 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b64a1f93-09ac-45b0-b9a2-d1d0d0b303f7 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:46.399937 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b64a1f93-09ac-45b0-b9a2-d1d0d0b303f7 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1314 microversion: 2.1 time: 0.777715 Aug 22 17:14:46.400540 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 387/807] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:45 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1314 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:46.479617 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e8331a4f-8ab2-4f93-8d70-25981a770203 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009bb1160>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:46.559126 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a5428b0a-1abc-4948-a862-3d2c5cfe1a28 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:46.568798 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e8331a4f-8ab2-4f93-8d70-25981a770203 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/6ae2b917-249e-47ef-a231-b408ad8559e3" status: 200 len: 661 microversion: 2.1 time: 0.098637 Aug 22 17:14:46.576404 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 388/808] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:14:46 2022] GET /compute/v2.1/images/6ae2b917-249e-47ef-a231-b408ad8559e3 => generated 661 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:14:46.585060 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-627d85c5-49b2-44eb-bae7-ddb828c1c524 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009b11430>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:46.586081 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a5428b0a-1abc-4948-a862-3d2c5cfe1a28 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 200 len: 1270 microversion: 2.1 time: 0.239822 Aug 22 17:14:46.587110 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 421/809] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:46 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 1270 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:14:46.660336 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-627d85c5-49b2-44eb-bae7-ddb828c1c524 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/6ae2b917-249e-47ef-a231-b408ad8559e3" status: 200 len: 661 microversion: 2.1 time: 0.077818 Aug 22 17:14:46.660336 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 389/810] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:14:46 2022] GET /compute/v2.1/images/6ae2b917-249e-47ef-a231-b408ad8559e3 => generated 661 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:47.211149 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d42af395-f06a-4e93-844a-fa94897a0dd0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:47.214565 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d42af395-f06a-4e93-844a-fa94897a0dd0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:47.226218 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d42af395-f06a-4e93-844a-fa94897a0dd0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:47.227026 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d42af395-f06a-4e93-844a-fa94897a0dd0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:47.228283 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d42af395-f06a-4e93-844a-fa94897a0dd0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:47.229271 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d42af395-f06a-4e93-844a-fa94897a0dd0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:47.231387 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d42af395-f06a-4e93-844a-fa94897a0dd0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:47.236108 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d42af395-f06a-4e93-844a-fa94897a0dd0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:47.422831 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a2e6894b-03a6-43ab-bb18-edbbe8cb5561 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:47.423929 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-a2e6894b-03a6-43ab-bb18-edbbe8cb5561 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:47.432974 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a2e6894b-03a6-43ab-bb18-edbbe8cb5561 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:47.433598 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a2e6894b-03a6-43ab-bb18-edbbe8cb5561 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:47.434340 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a2e6894b-03a6-43ab-bb18-edbbe8cb5561 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:47.435376 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a2e6894b-03a6-43ab-bb18-edbbe8cb5561 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:47.436118 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a2e6894b-03a6-43ab-bb18-edbbe8cb5561 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:47.437562 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a2e6894b-03a6-43ab-bb18-edbbe8cb5561 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:47.578525 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d42af395-f06a-4e93-844a-fa94897a0dd0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:47.596480 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d42af395-f06a-4e93-844a-fa94897a0dd0 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 200 len: 1379 microversion: 2.1 time: 0.390779 Aug 22 17:14:47.598229 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 422/811] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:47 2022] GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 1379 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:47.624513 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9abc9156-a8dd-480f-8fdf-d37cad51b0d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:47.624513 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9abc9156-a8dd-480f-8fdf-d37cad51b0d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:47.646434 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9abc9156-a8dd-480f-8fdf-d37cad51b0d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:47.652386 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9abc9156-a8dd-480f-8fdf-d37cad51b0d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:47.653189 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9abc9156-a8dd-480f-8fdf-d37cad51b0d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:47.655418 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9abc9156-a8dd-480f-8fdf-d37cad51b0d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:47.660645 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9abc9156-a8dd-480f-8fdf-d37cad51b0d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:47.664615 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9abc9156-a8dd-480f-8fdf-d37cad51b0d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:47.912761 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a2e6894b-03a6-43ab-bb18-edbbe8cb5561 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:47.926760 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a2e6894b-03a6-43ab-bb18-edbbe8cb5561 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1314 microversion: 2.1 time: 0.509209 Aug 22 17:14:47.937159 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 390/812] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:47 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:48.404615 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9abc9156-a8dd-480f-8fdf-d37cad51b0d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:48.429994 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9abc9156-a8dd-480f-8fdf-d37cad51b0d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 200 len: 1270 microversion: 2.1 time: 0.822545 Aug 22 17:14:48.433272 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 423/813] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:47 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 1270 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:14:48.620495 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-91134316-5824-412f-aa2f-08bc4231a75e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:48.621920 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-91134316-5824-412f-aa2f-08bc4231a75e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:48.633444 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-91134316-5824-412f-aa2f-08bc4231a75e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:48.661604 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-91134316-5824-412f-aa2f-08bc4231a75e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:48.664968 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-91134316-5824-412f-aa2f-08bc4231a75e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:48.669036 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-91134316-5824-412f-aa2f-08bc4231a75e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:48.674237 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-91134316-5824-412f-aa2f-08bc4231a75e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:48.675895 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-91134316-5824-412f-aa2f-08bc4231a75e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:48.961943 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4ae9b2cd-dcae-4306-95cb-1fcd4544338e tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:48.964735 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-4ae9b2cd-dcae-4306-95cb-1fcd4544338e tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:48.981209 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4ae9b2cd-dcae-4306-95cb-1fcd4544338e tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:48.982053 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4ae9b2cd-dcae-4306-95cb-1fcd4544338e tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:48.985884 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4ae9b2cd-dcae-4306-95cb-1fcd4544338e tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:48.986763 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4ae9b2cd-dcae-4306-95cb-1fcd4544338e tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:48.988522 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4ae9b2cd-dcae-4306-95cb-1fcd4544338e tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:48.990265 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4ae9b2cd-dcae-4306-95cb-1fcd4544338e tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:49.724694 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-91134316-5824-412f-aa2f-08bc4231a75e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:49.741583 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-91134316-5824-412f-aa2f-08bc4231a75e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 200 len: 1379 microversion: 2.1 time: 1.125334 Aug 22 17:14:49.742484 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 391/814] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:48 2022] GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 1379 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:14:49.752419 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2c164497-0ab1-417a-be9a-72adc038d8d6 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009c4a700>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:49.829688 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2c164497-0ab1-417a-be9a-72adc038d8d6 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/ebdc6e3f-132d-4e9c-9c6c-096999a0f82b" status: 200 len: 660 microversion: 2.1 time: 0.084529 Aug 22 17:14:49.830742 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 392/815] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:14:49 2022] GET /compute/v2.1/images/ebdc6e3f-132d-4e9c-9c6c-096999a0f82b => generated 660 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:49.835938 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0a5146d4-c5f5-4323-97bc-9a5dc4f865c4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:49.836933 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-0a5146d4-c5f5-4323-97bc-9a5dc4f865c4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:49.848237 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0a5146d4-c5f5-4323-97bc-9a5dc4f865c4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:49.856066 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0a5146d4-c5f5-4323-97bc-9a5dc4f865c4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:49.856760 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0a5146d4-c5f5-4323-97bc-9a5dc4f865c4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:49.858826 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0a5146d4-c5f5-4323-97bc-9a5dc4f865c4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:49.859482 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0a5146d4-c5f5-4323-97bc-9a5dc4f865c4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:49.860063 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0a5146d4-c5f5-4323-97bc-9a5dc4f865c4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:50.021205 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-0a5146d4-c5f5-4323-97bc-9a5dc4f865c4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:50.041214 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0a5146d4-c5f5-4323-97bc-9a5dc4f865c4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 200 len: 1276 microversion: 2.1 time: 0.207491 Aug 22 17:14:50.061560 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 393/816] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:49 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:50.074368 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c54fad6a-158d-4510-8846-a7e70899d165 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009afcf70>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:50.121913 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-4ae9b2cd-dcae-4306-95cb-1fcd4544338e tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:50.137676 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-4ae9b2cd-dcae-4306-95cb-1fcd4544338e tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1464 microversion: 2.1 time: 1.182303 Aug 22 17:14:50.144089 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 424/817] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:48 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1464 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:14:50.198890 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c54fad6a-158d-4510-8846-a7e70899d165 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/ebdc6e3f-132d-4e9c-9c6c-096999a0f82b" status: 200 len: 660 microversion: 2.1 time: 0.128655 Aug 22 17:14:50.212980 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 394/818] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:14:50 2022] GET /compute/v2.1/images/ebdc6e3f-132d-4e9c-9c6c-096999a0f82b => generated 660 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:50.456264 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5474e98c-a23b-4ca0-8d15-af8ba64539a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-225132939", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:50.559545 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-5474e98c-a23b-4ca0-8d15-af8ba64539a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] validate_networks() for None {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:14:50.596392 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5f233546-2413-4cbe-90dc-5d00fde064f6 tempest-TenantUsagesTestJSON-1748580760 tempest-TenantUsagesTestJSON-1748580760-project-admin] Calling method '.version_select at 0x7f80099f7040>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:50.636494 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5f233546-2413-4cbe-90dc-5d00fde064f6 tempest-TenantUsagesTestJSON-1748580760 tempest-TenantUsagesTestJSON-1748580760-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:50.637852 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5f233546-2413-4cbe-90dc-5d00fde064f6 tempest-TenantUsagesTestJSON-1748580760 tempest-TenantUsagesTestJSON-1748580760-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:50.640566 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5f233546-2413-4cbe-90dc-5d00fde064f6 tempest-TenantUsagesTestJSON-1748580760 tempest-TenantUsagesTestJSON-1748580760-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:50.714463 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5f233546-2413-4cbe-90dc-5d00fde064f6 tempest-TenantUsagesTestJSON-1748580760 tempest-TenantUsagesTestJSON-1748580760-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:50.715325 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5f233546-2413-4cbe-90dc-5d00fde064f6 tempest-TenantUsagesTestJSON-1748580760 tempest-TenantUsagesTestJSON-1748580760-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:50.716176 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5f233546-2413-4cbe-90dc-5d00fde064f6 tempest-TenantUsagesTestJSON-1748580760 tempest-TenantUsagesTestJSON-1748580760-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:50.752678 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5f233546-2413-4cbe-90dc-5d00fde064f6 tempest-TenantUsagesTestJSON-1748580760 tempest-TenantUsagesTestJSON-1748580760-project-admin] 10.222.0.96 "GET /compute/v2.1/os-simple-tenant-usage/4d89b6637c1347fc8ad048509aa68d72?start=2022-08-21T17%3A14%3A50.155266&end=2022-08-23T17%3A14%3A50.155266" status: 200 len: 694 microversion: 2.1 time: 0.587821 Aug 22 17:14:50.755801 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 425/819] 10.222.0.96 () {58 vars in 1412 bytes} [Mon Aug 22 17:14:50 2022] GET /compute/v2.1/os-simple-tenant-usage/4d89b6637c1347fc8ad048509aa68d72?start=2022-08-21T17%3A14%3A50.155266&end=2022-08-23T17%3A14%3A50.155266 => generated 694 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:14:50.773057 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-deacb0a4-7f11-43b6-859f-c96e810a7fff tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:50.774832 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-deacb0a4-7f11-43b6-859f-c96e810a7fff tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:50.792613 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-deacb0a4-7f11-43b6-859f-c96e810a7fff tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:50.798631 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-deacb0a4-7f11-43b6-859f-c96e810a7fff tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:50.799338 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-deacb0a4-7f11-43b6-859f-c96e810a7fff tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:50.803840 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-deacb0a4-7f11-43b6-859f-c96e810a7fff tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:50.805127 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-deacb0a4-7f11-43b6-859f-c96e810a7fff tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:50.805975 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-deacb0a4-7f11-43b6-859f-c96e810a7fff tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:51.207224 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-deacb0a4-7f11-43b6-859f-c96e810a7fff tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:51.223170 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-deacb0a4-7f11-43b6-859f-c96e810a7fff tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 200 len: 1379 microversion: 2.1 time: 0.451932 Aug 22 17:14:51.223170 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 426/820] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:50 2022] GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 1379 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:51.236248 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9cdcf258-e926-4374-97d3-11326625b056 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '.version_select at 0x7f80099e7e50>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:51.261485 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9cdcf258-e926-4374-97d3-11326625b056 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:51.262264 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9cdcf258-e926-4374-97d3-11326625b056 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:51.262856 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9cdcf258-e926-4374-97d3-11326625b056 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:51.275779 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9cdcf258-e926-4374-97d3-11326625b056 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:51.276461 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9cdcf258-e926-4374-97d3-11326625b056 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:51.277067 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9cdcf258-e926-4374-97d3-11326625b056 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:51.292467 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9cdcf258-e926-4374-97d3-11326625b056 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/os-simple-tenant-usage/4d89b6637c1347fc8ad048509aa68d72?start=2022-08-21T17%3A14%3A50.155266&end=2022-08-23T17%3A14%3A50.155266" status: 200 len: 695 microversion: 2.1 time: 0.068761 Aug 22 17:14:51.293379 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 427/821] 10.222.0.96 () {58 vars in 1412 bytes} [Mon Aug 22 17:14:51 2022] GET /compute/v2.1/os-simple-tenant-usage/4d89b6637c1347fc8ad048509aa68d72?start=2022-08-21T17%3A14%3A50.155266&end=2022-08-23T17%3A14%3A50.155266 => generated 695 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:51.299107 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-bcd2672a-6b7f-4e4b-87eb-82c76b825291 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:51.300016 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-bcd2672a-6b7f-4e4b-87eb-82c76b825291 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:51.307644 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bcd2672a-6b7f-4e4b-87eb-82c76b825291 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:51.309065 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bcd2672a-6b7f-4e4b-87eb-82c76b825291 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:51.309065 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bcd2672a-6b7f-4e4b-87eb-82c76b825291 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:51.309926 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bcd2672a-6b7f-4e4b-87eb-82c76b825291 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:51.310673 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bcd2672a-6b7f-4e4b-87eb-82c76b825291 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:51.311328 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bcd2672a-6b7f-4e4b-87eb-82c76b825291 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:51.458201 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-bcd2672a-6b7f-4e4b-87eb-82c76b825291 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:51.472717 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-bcd2672a-6b7f-4e4b-87eb-82c76b825291 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 200 len: 1276 microversion: 2.1 time: 0.177448 Aug 22 17:14:51.473446 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 428/822] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:51 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:51.497621 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3451d18d-e06d-4683-ac88-dc963d1023e4 tempest-TenantUsagesTestJSON-1748580760 tempest-TenantUsagesTestJSON-1748580760-project-admin] Calling method '.version_select at 0x7f8009ce1940>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:51.512048 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3451d18d-e06d-4683-ac88-dc963d1023e4 tempest-TenantUsagesTestJSON-1748580760 tempest-TenantUsagesTestJSON-1748580760-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:51.512546 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3451d18d-e06d-4683-ac88-dc963d1023e4 tempest-TenantUsagesTestJSON-1748580760 tempest-TenantUsagesTestJSON-1748580760-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:51.513710 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3451d18d-e06d-4683-ac88-dc963d1023e4 tempest-TenantUsagesTestJSON-1748580760 tempest-TenantUsagesTestJSON-1748580760-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:51.540854 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3451d18d-e06d-4683-ac88-dc963d1023e4 tempest-TenantUsagesTestJSON-1748580760 tempest-TenantUsagesTestJSON-1748580760-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:51.541968 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3451d18d-e06d-4683-ac88-dc963d1023e4 tempest-TenantUsagesTestJSON-1748580760 tempest-TenantUsagesTestJSON-1748580760-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:51.543022 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3451d18d-e06d-4683-ac88-dc963d1023e4 tempest-TenantUsagesTestJSON-1748580760 tempest-TenantUsagesTestJSON-1748580760-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:51.593421 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3451d18d-e06d-4683-ac88-dc963d1023e4 tempest-TenantUsagesTestJSON-1748580760 tempest-TenantUsagesTestJSON-1748580760-project-admin] 10.222.0.96 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-21T17%3A14%3A50.155266&end=2022-08-23T17%3A14%3A50.155266&detailed=1" status: 200 len: 7765 microversion: 2.1 time: 0.106398 Aug 22 17:14:51.594032 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 429/823] 10.222.0.96 () {58 vars in 1335 bytes} [Mon Aug 22 17:14:51 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-21T17%3A14%3A50.155266&end=2022-08-23T17%3A14%3A50.155266&detailed=1 => generated 7765 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:51.615745 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-24ca0d91-e97c-4daf-8b30-22e4e070a4ca tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:51.616353 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-24ca0d91-e97c-4daf-8b30-22e4e070a4ca tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:51.622491 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-24ca0d91-e97c-4daf-8b30-22e4e070a4ca tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:51.623590 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-24ca0d91-e97c-4daf-8b30-22e4e070a4ca tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:51.623590 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-24ca0d91-e97c-4daf-8b30-22e4e070a4ca tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:51.624437 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-24ca0d91-e97c-4daf-8b30-22e4e070a4ca tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:51.624998 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-24ca0d91-e97c-4daf-8b30-22e4e070a4ca tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:51.625587 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-24ca0d91-e97c-4daf-8b30-22e4e070a4ca tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:51.653700 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-24ca0d91-e97c-4daf-8b30-22e4e070a4ca tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Going to try to terminate instance {{(pid=123015) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:14:51.839062 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-5474e98c-a23b-4ca0-8d15-af8ba64539a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:14:51.839781 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-5474e98c-a23b-4ca0-8d15-af8ba64539a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:14:51.840129 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-5474e98c-a23b-4ca0-8d15-af8ba64539a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:14:51.840788 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-5474e98c-a23b-4ca0-8d15-af8ba64539a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:14:51.841237 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-5474e98c-a23b-4ca0-8d15-af8ba64539a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:14:51.864161 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5474e98c-a23b-4ca0-8d15-af8ba64539a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:51.864664 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5474e98c-a23b-4ca0-8d15-af8ba64539a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:51.865156 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5474e98c-a23b-4ca0-8d15-af8ba64539a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:51.878527 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5474e98c-a23b-4ca0-8d15-af8ba64539a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:51.878527 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5474e98c-a23b-4ca0-8d15-af8ba64539a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:51.878527 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5474e98c-a23b-4ca0-8d15-af8ba64539a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:51.945052 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-5474e98c-a23b-4ca0-8d15-af8ba64539a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Getting quotas for project dbbae9406ad347fcb1d302b7950d0025. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:14:51.960981 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-5474e98c-a23b-4ca0-8d15-af8ba64539a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Getting quotas for user db950ad892d347049134d767232d170a and project dbbae9406ad347fcb1d302b7950d0025. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:14:52.031943 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5474e98c-a23b-4ca0-8d15-af8ba64539a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Going to run 1 instances... {{(pid=123016) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:14:52.039566 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5474e98c-a23b-4ca0-8d15-af8ba64539a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: b9d1e79a-48e9-436e-a233-7a950de59886] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:14:52.193746 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-24ca0d91-e97c-4daf-8b30-22e4e070a4ca tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "DELETE /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 204 len: 0 microversion: 2.1 time: 0.579068 Aug 22 17:14:52.196732 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 430/824] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:14:51 2022] DELETE /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 17:14:52.207916 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-288777ab-d5c5-4be2-a6fa-87d0229dd2ac tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:52.209678 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-288777ab-d5c5-4be2-a6fa-87d0229dd2ac tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:52.234008 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-288777ab-d5c5-4be2-a6fa-87d0229dd2ac tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:52.235015 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-288777ab-d5c5-4be2-a6fa-87d0229dd2ac tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:52.236560 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-288777ab-d5c5-4be2-a6fa-87d0229dd2ac tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:52.249999 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-288777ab-d5c5-4be2-a6fa-87d0229dd2ac tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:52.250917 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-288777ab-d5c5-4be2-a6fa-87d0229dd2ac tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:52.255158 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-288777ab-d5c5-4be2-a6fa-87d0229dd2ac tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:52.284733 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5474e98c-a23b-4ca0-8d15-af8ba64539a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.832474 Aug 22 17:14:52.288001 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 395/825] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:14:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 17:14:52.345068 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8c06ad3c-1ab1-4ef5-a276-1852cc006937 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:52.350761 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-8c06ad3c-1ab1-4ef5-a276-1852cc006937 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:52.370618 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c06ad3c-1ab1-4ef5-a276-1852cc006937 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:52.371450 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c06ad3c-1ab1-4ef5-a276-1852cc006937 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:52.373522 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c06ad3c-1ab1-4ef5-a276-1852cc006937 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:52.375280 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c06ad3c-1ab1-4ef5-a276-1852cc006937 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:52.378422 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c06ad3c-1ab1-4ef5-a276-1852cc006937 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:52.379076 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c06ad3c-1ab1-4ef5-a276-1852cc006937 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:52.606783 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-288777ab-d5c5-4be2-a6fa-87d0229dd2ac tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:52.620364 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-288777ab-d5c5-4be2-a6fa-87d0229dd2ac tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1470 microversion: 2.1 time: 0.417336 Aug 22 17:14:52.624092 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 431/826] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:52 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1470 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:14:52.634837 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ad13f9bb-b2ad-4869-b34a-c033d92c1c01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-336728325", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:52.710482 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-ad13f9bb-b2ad-4869-b34a-c033d92c1c01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] validate_networks() for None {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:14:53.126771 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ad13f9bb-b2ad-4869-b34a-c033d92c1c01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:14:53.127449 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ad13f9bb-b2ad-4869-b34a-c033d92c1c01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:14:53.128147 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ad13f9bb-b2ad-4869-b34a-c033d92c1c01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:14:53.128776 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ad13f9bb-b2ad-4869-b34a-c033d92c1c01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:14:53.129568 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ad13f9bb-b2ad-4869-b34a-c033d92c1c01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:14:53.132067 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:53.155819 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ad13f9bb-b2ad-4869-b34a-c033d92c1c01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:53.156707 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ad13f9bb-b2ad-4869-b34a-c033d92c1c01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:53.157443 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ad13f9bb-b2ad-4869-b34a-c033d92c1c01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:53.158506 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ad13f9bb-b2ad-4869-b34a-c033d92c1c01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:53.159242 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ad13f9bb-b2ad-4869-b34a-c033d92c1c01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:53.160071 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ad13f9bb-b2ad-4869-b34a-c033d92c1c01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:53.207961 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-ad13f9bb-b2ad-4869-b34a-c033d92c1c01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Getting quotas for project dbbae9406ad347fcb1d302b7950d0025. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:14:53.214639 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-ad13f9bb-b2ad-4869-b34a-c033d92c1c01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Getting quotas for user db950ad892d347049134d767232d170a and project dbbae9406ad347fcb1d302b7950d0025. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:14:53.229644 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ad13f9bb-b2ad-4869-b34a-c033d92c1c01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Going to run 1 instances... {{(pid=123015) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:14:53.233282 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ad13f9bb-b2ad-4869-b34a-c033d92c1c01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:14:53.275113 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-8c06ad3c-1ab1-4ef5-a276-1852cc006937 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:53.291717 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8c06ad3c-1ab1-4ef5-a276-1852cc006937 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 200 len: 1379 microversion: 2.1 time: 0.993169 Aug 22 17:14:53.293394 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 396/827] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:52 2022] GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 1379 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:53.305877 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-73434903-c166-46f2-a2b0-12c6096c1750 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:53.307756 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-73434903-c166-46f2-a2b0-12c6096c1750 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:53.316405 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-73434903-c166-46f2-a2b0-12c6096c1750 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:53.320231 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-73434903-c166-46f2-a2b0-12c6096c1750 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:53.320231 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-73434903-c166-46f2-a2b0-12c6096c1750 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:53.320231 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-73434903-c166-46f2-a2b0-12c6096c1750 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:53.320231 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-73434903-c166-46f2-a2b0-12c6096c1750 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:53.321436 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-73434903-c166-46f2-a2b0-12c6096c1750 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:53.348916 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ad13f9bb-b2ad-4869-b34a-c033d92c1c01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722710 Aug 22 17:14:53.355651 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 432/828] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:14:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:14:53.371727 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-384a9b50-8d16-41ab-af0c-ef8466929e74 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:53.372770 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-384a9b50-8d16-41ab-af0c-ef8466929e74 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:53.539124 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-73434903-c166-46f2-a2b0-12c6096c1750 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:53.553895 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-73434903-c166-46f2-a2b0-12c6096c1750 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 200 len: 1276 microversion: 2.1 time: 0.254225 Aug 22 17:14:53.558087 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 397/829] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:53 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 1276 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:53.648389 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1c875f72-5c0c-4480-b912-2958150ad07b tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:53.650485 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-1c875f72-5c0c-4480-b912-2958150ad07b tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:53.665414 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1c875f72-5c0c-4480-b912-2958150ad07b tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:53.675332 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1c875f72-5c0c-4480-b912-2958150ad07b tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:53.676378 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1c875f72-5c0c-4480-b912-2958150ad07b tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:53.679444 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1c875f72-5c0c-4480-b912-2958150ad07b tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:53.680243 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1c875f72-5c0c-4480-b912-2958150ad07b tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:53.686460 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1c875f72-5c0c-4480-b912-2958150ad07b tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:53.791425 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-384a9b50-8d16-41ab-af0c-ef8466929e74 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:53.801911 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-384a9b50-8d16-41ab-af0c-ef8466929e74 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1217 microversion: 2.1 time: 0.439180 Aug 22 17:14:53.802731 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 433/830] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:53 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1217 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:54.314197 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-22bd9617-05a9-412c-bda9-3c98a600bd5f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:54.314949 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-22bd9617-05a9-412c-bda9-3c98a600bd5f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:54.325775 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-22bd9617-05a9-412c-bda9-3c98a600bd5f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:54.327470 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-22bd9617-05a9-412c-bda9-3c98a600bd5f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:54.328649 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-22bd9617-05a9-412c-bda9-3c98a600bd5f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:54.330275 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-22bd9617-05a9-412c-bda9-3c98a600bd5f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:54.333588 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-22bd9617-05a9-412c-bda9-3c98a600bd5f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:54.336954 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-22bd9617-05a9-412c-bda9-3c98a600bd5f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:55.199820 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-22bd9617-05a9-412c-bda9-3c98a600bd5f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:55.214589 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-22bd9617-05a9-412c-bda9-3c98a600bd5f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 200 len: 1379 microversion: 2.1 time: 0.904541 Aug 22 17:14:55.217460 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 434/831] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:54 2022] GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 1379 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:55.222939 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-f6d368b7-88eb-42c9-87fd-949c5f8b8e15 req-371d25a6-ba8a-4dbb-b8e9-016e40c979a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94de208f-edff-400d-840d-1cb7eafb3913", "name": "network-vif-plugged", "status": "completed", "tag": "cf9aa49c-6ca6-427a-b18b-f185e8006fca"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:55.237788 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-f6d368b7-88eb-42c9-87fd-949c5f8b8e15 req-371d25a6-ba8a-4dbb-b8e9-016e40c979a5 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:55.238543 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-f6d368b7-88eb-42c9-87fd-949c5f8b8e15 req-371d25a6-ba8a-4dbb-b8e9-016e40c979a5 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:55.239167 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-f6d368b7-88eb-42c9-87fd-949c5f8b8e15 req-371d25a6-ba8a-4dbb-b8e9-016e40c979a5 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:55.255172 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-f6d368b7-88eb-42c9-87fd-949c5f8b8e15 req-371d25a6-ba8a-4dbb-b8e9-016e40c979a5 service nova] Creating event network-vif-plugged:cf9aa49c-6ca6-427a-b18b-f185e8006fca for instance 94de208f-edff-400d-840d-1cb7eafb3913 on n-h2-854030-1 Aug 22 17:14:55.271616 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-1c875f72-5c0c-4480-b912-2958150ad07b tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:55.282504 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-f6d368b7-88eb-42c9-87fd-949c5f8b8e15 req-371d25a6-ba8a-4dbb-b8e9-016e40c979a5 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061195 Aug 22 17:14:55.293606 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 435/832] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:55.293905 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1c875f72-5c0c-4480-b912-2958150ad07b tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1470 microversion: 2.1 time: 1.640410 Aug 22 17:14:55.293905 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 398/833] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:53 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1470 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:55.294082 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e367426a-337c-4618-a47d-c18730a1dd1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:55.294082 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-e367426a-337c-4618-a47d-c18730a1dd1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:55.294264 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b9108900-f389-427f-b29e-00d289ae4718 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:55.294626 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b9108900-f389-427f-b29e-00d289ae4718 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:55.304621 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e367426a-337c-4618-a47d-c18730a1dd1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:55.305589 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e367426a-337c-4618-a47d-c18730a1dd1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:55.311770 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e367426a-337c-4618-a47d-c18730a1dd1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:55.312866 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e367426a-337c-4618-a47d-c18730a1dd1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:55.313575 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e367426a-337c-4618-a47d-c18730a1dd1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:55.314162 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e367426a-337c-4618-a47d-c18730a1dd1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:55.317188 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b9108900-f389-427f-b29e-00d289ae4718 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:55.322412 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b9108900-f389-427f-b29e-00d289ae4718 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:55.322412 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b9108900-f389-427f-b29e-00d289ae4718 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:55.322412 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b9108900-f389-427f-b29e-00d289ae4718 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:55.322412 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b9108900-f389-427f-b29e-00d289ae4718 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:55.323002 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b9108900-f389-427f-b29e-00d289ae4718 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:55.549924 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b9108900-f389-427f-b29e-00d289ae4718 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:55.558745 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b9108900-f389-427f-b29e-00d289ae4718 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1221 microversion: 2.1 time: 0.270558 Aug 22 17:14:55.567435 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 399/834] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:55 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1221 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:55.716865 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e367426a-337c-4618-a47d-c18730a1dd1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:55.729957 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e367426a-337c-4618-a47d-c18730a1dd1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 200 len: 1318 microversion: 2.1 time: 0.443658 Aug 22 17:14:55.743125 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 436/835] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:55 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:56.237569 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5d531cee-6386-49bb-b7bc-003b58669b96 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:56.238210 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5d531cee-6386-49bb-b7bc-003b58669b96 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:56.250245 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5d531cee-6386-49bb-b7bc-003b58669b96 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:56.250812 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5d531cee-6386-49bb-b7bc-003b58669b96 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:56.251260 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5d531cee-6386-49bb-b7bc-003b58669b96 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:56.254299 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5d531cee-6386-49bb-b7bc-003b58669b96 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:56.255000 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5d531cee-6386-49bb-b7bc-003b58669b96 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:56.255626 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5d531cee-6386-49bb-b7bc-003b58669b96 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:56.314999 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5dddc34b-405c-42f4-9919-3958fff6b0ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:56.315799 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-5dddc34b-405c-42f4-9919-3958fff6b0ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:56.323563 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5dddc34b-405c-42f4-9919-3958fff6b0ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:56.324487 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5dddc34b-405c-42f4-9919-3958fff6b0ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:56.325291 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5dddc34b-405c-42f4-9919-3958fff6b0ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:56.326185 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5dddc34b-405c-42f4-9919-3958fff6b0ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:56.326804 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5dddc34b-405c-42f4-9919-3958fff6b0ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:56.327668 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5dddc34b-405c-42f4-9919-3958fff6b0ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:56.982202 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-5dddc34b-405c-42f4-9919-3958fff6b0ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:56.995584 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5dddc34b-405c-42f4-9919-3958fff6b0ff tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1470 microversion: 2.1 time: 0.691327 Aug 22 17:14:57.000588 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 437/836] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:56 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1470 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:57.012701 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b476ea0b-64e4-4a19-a802-21350325dcab tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:57.013634 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b476ea0b-64e4-4a19-a802-21350325dcab tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:57.032187 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b476ea0b-64e4-4a19-a802-21350325dcab tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:57.034753 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b476ea0b-64e4-4a19-a802-21350325dcab tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:57.035922 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b476ea0b-64e4-4a19-a802-21350325dcab tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:57.040766 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b476ea0b-64e4-4a19-a802-21350325dcab tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:57.041558 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b476ea0b-64e4-4a19-a802-21350325dcab tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:57.042543 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b476ea0b-64e4-4a19-a802-21350325dcab tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:57.086477 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-5d531cee-6386-49bb-b7bc-003b58669b96 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:57.102750 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:57.111084 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5d531cee-6386-49bb-b7bc-003b58669b96 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 200 len: 1379 microversion: 2.1 time: 0.875643 Aug 22 17:14:57.126047 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 400/837] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:56 2022] GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 1379 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:57.142845 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-83f3967b-bfb0-4a7b-b487-a365ea5464ce tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:57.148051 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-83f3967b-bfb0-4a7b-b487-a365ea5464ce tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:57.170108 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83f3967b-bfb0-4a7b-b487-a365ea5464ce tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:57.170616 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83f3967b-bfb0-4a7b-b487-a365ea5464ce tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:57.171046 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83f3967b-bfb0-4a7b-b487-a365ea5464ce tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:57.171855 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83f3967b-bfb0-4a7b-b487-a365ea5464ce tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:57.172326 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83f3967b-bfb0-4a7b-b487-a365ea5464ce tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:57.172763 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83f3967b-bfb0-4a7b-b487-a365ea5464ce tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:57.368332 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b476ea0b-64e4-4a19-a802-21350325dcab tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:57.432865 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b476ea0b-64e4-4a19-a802-21350325dcab tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1269 microversion: 2.1 time: 0.423125 Aug 22 17:14:57.439817 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 438/838] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:57 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1269 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:57.455957 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cfd0018d-b8b6-4418-9871-9ded4630a73e tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-225002856", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "119c6723-6301-4b30-a6c1-2f9e83ef5d07"}], "security_groups": [{"name": "tempest-securitygroup--1658874224"}], "key_name": "tempest-keypair-426684846", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:58.100492 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-83f3967b-bfb0-4a7b-b487-a365ea5464ce tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:58.128090 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-83f3967b-bfb0-4a7b-b487-a365ea5464ce tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 200 len: 1318 microversion: 2.1 time: 1.005242 Aug 22 17:14:58.136653 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 401/839] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:57 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 1318 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:58.161849 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-5ca7eacb-c66a-4917-b219-a6e5050eb08d req-f8ae3c1c-c4df-4091-8b3f-78c8f6a43c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f63d0c5a-060f-4524-93eb-78c4950d8848", "tag": "b6ddfbbd-fd37-44fd-a8a3-f657b0f59e28"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:58.180275 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-5ca7eacb-c66a-4917-b219-a6e5050eb08d req-f8ae3c1c-c4df-4091-8b3f-78c8f6a43c0b service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:58.183620 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-5ca7eacb-c66a-4917-b219-a6e5050eb08d req-f8ae3c1c-c4df-4091-8b3f-78c8f6a43c0b service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:58.184269 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-5ca7eacb-c66a-4917-b219-a6e5050eb08d req-f8ae3c1c-c4df-4091-8b3f-78c8f6a43c0b service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:58.211286 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-5ca7eacb-c66a-4917-b219-a6e5050eb08d req-f8ae3c1c-c4df-4091-8b3f-78c8f6a43c0b service nova] Creating event network-changed:b6ddfbbd-fd37-44fd-a8a3-f657b0f59e28 for instance f63d0c5a-060f-4524-93eb-78c4950d8848 on n-h1-854030-1 Aug 22 17:14:58.222308 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-5ca7eacb-c66a-4917-b219-a6e5050eb08d req-f8ae3c1c-c4df-4091-8b3f-78c8f6a43c0b service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089289 Aug 22 17:14:58.227655 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 402/840] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:58.236727 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d6183de8-6654-4ed3-a334-20ace76aa7db tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:58.237520 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-d6183de8-6654-4ed3-a334-20ace76aa7db tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:58.245452 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d6183de8-6654-4ed3-a334-20ace76aa7db tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:58.245858 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d6183de8-6654-4ed3-a334-20ace76aa7db tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:58.246310 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d6183de8-6654-4ed3-a334-20ace76aa7db tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:58.247042 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d6183de8-6654-4ed3-a334-20ace76aa7db tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:58.252515 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d6183de8-6654-4ed3-a334-20ace76aa7db tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:58.252515 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d6183de8-6654-4ed3-a334-20ace76aa7db tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:58.264030 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=100 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:14:58.395373 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-cfd0018d-b8b6-4418-9871-9ded4630a73e tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] validate_networks() for [('119c6723-6301-4b30-a6c1-2f9e83ef5d07', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:14:58.833368 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-d6183de8-6654-4ed3-a334-20ace76aa7db tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5451732c8d74dd1a2441228702a7d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d89b6637c1347fc8ad048509aa68d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:58.870283 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d6183de8-6654-4ed3-a334-20ace76aa7db tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 200 len: 1428 microversion: 2.1 time: 0.637728 Aug 22 17:14:58.872115 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 403/841] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:58 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 1428 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:58.883049 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6ff21fe7-6eaa-4e63-9837-cb8c6deddd93 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:58.886187 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-6ff21fe7-6eaa-4e63-9837-cb8c6deddd93 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:58.896592 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ff21fe7-6eaa-4e63-9837-cb8c6deddd93 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:58.898151 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ff21fe7-6eaa-4e63-9837-cb8c6deddd93 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:58.898840 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ff21fe7-6eaa-4e63-9837-cb8c6deddd93 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:58.906000 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ff21fe7-6eaa-4e63-9837-cb8c6deddd93 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:58.906631 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ff21fe7-6eaa-4e63-9837-cb8c6deddd93 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:58.907260 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ff21fe7-6eaa-4e63-9837-cb8c6deddd93 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:59.432596 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-6ff21fe7-6eaa-4e63-9837-cb8c6deddd93 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:59.443239 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-6ff21fe7-6eaa-4e63-9837-cb8c6deddd93 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 200 len: 1527 microversion: 2.1 time: 0.569192 Aug 22 17:14:59.448583 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 404/842] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:58 2022] GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 1527 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:59.472134 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-a718f4a1-4af3-4dc0-8e89-92375a29c7c2 req-a4f0a266-e7ad-4303-b06e-5219196cd817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e734abd7-7fe7-40b1-b6fc-49590a36e09d", "name": "network-vif-deleted", "tag": "be9b2e4a-414d-4baa-8230-42315bf4e034"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:14:59.490334 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-a718f4a1-4af3-4dc0-8e89-92375a29c7c2 req-a4f0a266-e7ad-4303-b06e-5219196cd817 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:59.491063 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-a718f4a1-4af3-4dc0-8e89-92375a29c7c2 req-a4f0a266-e7ad-4303-b06e-5219196cd817 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:59.491661 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-a718f4a1-4af3-4dc0-8e89-92375a29c7c2 req-a4f0a266-e7ad-4303-b06e-5219196cd817 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:59.517836 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-a718f4a1-4af3-4dc0-8e89-92375a29c7c2 req-a4f0a266-e7ad-4303-b06e-5219196cd817 service nova] Creating event network-vif-deleted:be9b2e4a-414d-4baa-8230-42315bf4e034 for instance e734abd7-7fe7-40b1-b6fc-49590a36e09d on n-h1-854030-1 Aug 22 17:14:59.538359 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-a718f4a1-4af3-4dc0-8e89-92375a29c7c2 req-a4f0a266-e7ad-4303-b06e-5219196cd817 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077089 Aug 22 17:14:59.539287 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 405/843] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:14:59.560913 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-732cfcab-c1b4-452f-99c2-50c517a0e680 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:59.561931 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-732cfcab-c1b4-452f-99c2-50c517a0e680 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:59.583268 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-732cfcab-c1b4-452f-99c2-50c517a0e680 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:59.584018 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-732cfcab-c1b4-452f-99c2-50c517a0e680 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:59.584452 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-732cfcab-c1b4-452f-99c2-50c517a0e680 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:59.585216 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-732cfcab-c1b4-452f-99c2-50c517a0e680 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:59.587931 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-732cfcab-c1b4-452f-99c2-50c517a0e680 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:59.588614 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-732cfcab-c1b4-452f-99c2-50c517a0e680 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:59.772603 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-732cfcab-c1b4-452f-99c2-50c517a0e680 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:14:59.786642 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-732cfcab-c1b4-452f-99c2-50c517a0e680 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1275 microversion: 2.1 time: 0.245305 Aug 22 17:14:59.789319 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 406/844] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:59 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1275 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:14:59.805610 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5cf1c516-8ea6-4558-a84b-7b0049a7fb27 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:14:59.808678 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5cf1c516-8ea6-4558-a84b-7b0049a7fb27 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:14:59.826478 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5cf1c516-8ea6-4558-a84b-7b0049a7fb27 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:59.831562 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5cf1c516-8ea6-4558-a84b-7b0049a7fb27 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:59.833412 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5cf1c516-8ea6-4558-a84b-7b0049a7fb27 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:14:59.834490 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5cf1c516-8ea6-4558-a84b-7b0049a7fb27 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:14:59.834984 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5cf1c516-8ea6-4558-a84b-7b0049a7fb27 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:14:59.848975 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5cf1c516-8ea6-4558-a84b-7b0049a7fb27 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:00.092374 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-cfd0018d-b8b6-4418-9871-9ded4630a73e tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bf31c046-427c-46dd-8a04-e70df00cac2d) Aug 22 17:15:00.092374 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:00.092374 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:00.092374 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:00.092374 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:00.092374 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:00.092374 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:00.092374 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:00.092374 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:00.092374 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:00.092374 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:15:00.092374 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:15:00.092374 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:15:00.092374 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:15:00.092374 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:15:00.092374 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:15:00.094093 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:15:00.094093 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:15:00.094093 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:15:00.094093 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:15:00.094093 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:15:00.094093 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:15:00.094093 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:15:00.094093 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:15:00.094093 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:15:00.094093 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:15:00.094093 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:15:00.094093 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:00.094093 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:00.094093 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:15:00.094093 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:15:00.094093 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:00.094093 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:00.094093 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:15:00.095294 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:15:00.095294 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:00.095294 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:00.095294 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:15:00.095294 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:15:00.095294 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:00.095294 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:00.095294 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:15:00.095294 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:15:00.095294 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:15:00.095294 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:15:00.095294 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:15:00.095294 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:15:00.095294 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:15:00.095294 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:15:00.095294 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:15:00.095294 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:15:00.095294 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:15:00.096416 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:15:00.096416 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:15:00.096416 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:15:00.096416 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:15:00.096416 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:15:00.096416 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:15:00.096416 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:15:00.096416 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:15:00.096416 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:15:00.096416 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:15:00.096416 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:15:00.096416 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:15:00.096416 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:15:00.096416 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:15:00.096416 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:15:00.098901 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bf31c046-427c-46dd-8a04-e70df00cac2d) Aug 22 17:15:00.098901 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:00.100845 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-cfd0018d-b8b6-4418-9871-9ded4630a73e tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:00.100845 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cfd0018d-b8b6-4418-9871-9ded4630a73e tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] Request method failure captured: Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 463 Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7luZhqH2uUSn1AB6BDAOHUzsExxaETJPNsr4DxtmCkXwmco6hwv1ugKMqvQyt9TjSUS1evQCiqBCOQDQX9tlTOgrWg-vNT3c9S8zssoqzP9yaiZluiCe95yW6Edaq0xi-iPyBnpy-Z8T84CZSWzy_ACLEYRT1wSJme-CSQ93KF9Z28 Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 57aa3e1076cf43338cc3a48a6d2c83d4 Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-VolumesAdminNegativeTest-1897544385 Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:15:00.105436 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:15:00.106881 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/57aa3e1076cf43338cc3a48a6d2c83d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_57aa3e1076cf43338cc3a48a6d2c83d4", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/57aa3e1076cf43338cc3a48a6d2c83d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/57aa3e1076cf43338cc3a48a6d2c83d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:15:00.106881 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-VolumesAdminNegativeTest-1897544385 Aug 22 17:15:00.106881 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 57aa3e1076cf43338cc3a48a6d2c83d4 Aug 22 17:15:00.106881 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1897544385 Aug 22 17:15:00.106881 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-VolumesAdminNegativeTest-1897544385-project Aug 22 17:15:00.106881 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:15:00.106881 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:15:00.106881 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 075de197fb044b8596060c5b3e0f117b Aug 22 17:15:00.106881 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-VolumesAdminNegativeTest-1897544385-project Aug 22 17:15:00.106881 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:15:00.107560 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-225002856", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "119c6723-6301-4b30-a6c1-2f9e83ef5d07"}], "security_groups": [{"name": "tempest-securitygroup--1658874224"}], "key_name": "tempest-keypair-426684846", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 22 17:15:00.107560 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:15:00.107560 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:00.107560 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:15:00.107560 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-VolumesAdminNegativeTest-server-225002856', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '119c6723-6301-4b30-a6c1-2f9e83ef5d07'}], 'security_groups': [{'name': 'tempest-securitygroup--1658874224'}], 'key_name': 'tempest-keypair-426684846', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 22 17:15:00.107560 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:15:00.107560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:00.107560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:00.107560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:00.107560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:00.107560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:00.107560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:00.107560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:00.108388 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:00.108388 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:00.108388 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:15:00.108388 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:15:00.108388 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:15:00.108388 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:15:00.108388 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:15:00.108388 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:15:00.108388 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:15:00.108388 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:15:00.108388 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:15:00.108388 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:15:00.108388 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:15:00.108388 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:15:00.108388 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:15:00.108388 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:15:00.108388 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:15:00.108388 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:15:00.109543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:15:00.109543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:00.109543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:00.109543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:15:00.109543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:15:00.109543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:00.109543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:00.109543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:15:00.109543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:15:00.109543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:00.109543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:00.109543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:15:00.109543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:15:00.109543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:00.109543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:00.109543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:15:00.109543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:15:00.109543 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:15:00.110698 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:15:00.110698 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:15:00.110698 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:15:00.110698 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:15:00.110698 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:15:00.110698 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:15:00.110698 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:15:00.110698 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:15:00.110698 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:15:00.110698 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:15:00.110698 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:15:00.110698 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:15:00.110698 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:15:00.110698 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:15:00.110698 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:15:00.110698 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:15:00.110698 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:15:00.116369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:15:00.116369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:15:00.116369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:15:00.116369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:15:00.116369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:15:00.116369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:15:00.116369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bf31c046-427c-46dd-8a04-e70df00cac2d) Aug 22 17:15:00.116369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:00.116369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:00.116369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:00.116369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:00.116369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:00.116369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:00.116369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:15:00.116369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:15:00.116369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:15:00.116369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:15:00.120158 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:00.120158 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:00.120158 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:00.120158 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:00.120158 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:00.120158 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:00.120158 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:00.120158 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:00.120158 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:15:00.120158 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:15:00.120158 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:00.120158 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:00.120158 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:00.123786 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cfd0018d-b8b6-4418-9871-9ded4630a73e tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:00.123786 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:15:00.125147 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-cfd0018d-b8b6-4418-9871-9ded4630a73e tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.680291 Aug 22 17:15:00.126407 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 439/845] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:14:57 2022] POST /compute/v2.1/servers => generated 214 bytes in 2686 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:15:00.132057 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1ba3d273-b1fe-4b0b-8a85-478fa4edeb80 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:00.132997 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-1ba3d273-b1fe-4b0b-8a85-478fa4edeb80 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:00.140849 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1ba3d273-b1fe-4b0b-8a85-478fa4edeb80 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:00.142183 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1ba3d273-b1fe-4b0b-8a85-478fa4edeb80 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:00.142812 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1ba3d273-b1fe-4b0b-8a85-478fa4edeb80 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:00.143883 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1ba3d273-b1fe-4b0b-8a85-478fa4edeb80 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:00.144725 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1ba3d273-b1fe-4b0b-8a85-478fa4edeb80 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:00.145440 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1ba3d273-b1fe-4b0b-8a85-478fa4edeb80 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:00.167699 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-5cf1c516-8ea6-4558-a84b-7b0049a7fb27 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:00.183842 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5cf1c516-8ea6-4558-a84b-7b0049a7fb27 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 200 len: 1318 microversion: 2.1 time: 0.389688 Aug 22 17:15:00.184679 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 407/846] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:14:59 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:00.192206 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-209f3443-b651-4164-9293-730be2ded2a8 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:00.193320 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-209f3443-b651-4164-9293-730be2ded2a8 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] [instance: e734abd7-7fe7-40b1-b6fc-49590a36e09d] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:00.207815 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-209f3443-b651-4164-9293-730be2ded2a8 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:00.208419 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-209f3443-b651-4164-9293-730be2ded2a8 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:00.209235 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-209f3443-b651-4164-9293-730be2ded2a8 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:00.210061 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-209f3443-b651-4164-9293-730be2ded2a8 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:00.210617 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-209f3443-b651-4164-9293-730be2ded2a8 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:00.221899 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-209f3443-b651-4164-9293-730be2ded2a8 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:00.265234 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-209f3443-b651-4164-9293-730be2ded2a8 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] HTTP exception thrown: Instance e734abd7-7fe7-40b1-b6fc-49590a36e09d could not be found. Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-209f3443-b651-4164-9293-730be2ded2a8 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Request method failure captured: Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d HTTP/1.1 Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7lqrNhjFMbB9YRrKpxFYA8PytBelzWHb4WxAanDv5LqJimS3N4oJubUjO_up7irlxEGLR-xBwk3WNAaCS8OgUqqJtcm34n3gFI0kkW0YwhqEe6HJA8Yp77i0laZpj-eOZNLkW3MLXsd_wtjH_wR1aFLbVwu3IQUXgI_taGjO701HQY Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 4d89b6637c1347fc8ad048509aa68d72 Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-TenantUsagesTestJSON-96121253 Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:15:00.273118 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:15:00.275360 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4d89b6637c1347fc8ad048509aa68d72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_4d89b6637c1347fc8ad048509aa68d72", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4d89b6637c1347fc8ad048509aa68d72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/4d89b6637c1347fc8ad048509aa68d72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:15:00.275360 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-TenantUsagesTestJSON-96121253 Aug 22 17:15:00.275360 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 4d89b6637c1347fc8ad048509aa68d72 Aug 22 17:15:00.275360 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-TenantUsagesTestJSON-96121253 Aug 22 17:15:00.275360 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-TenantUsagesTestJSON-96121253-project Aug 22 17:15:00.275360 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:15:00.275360 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:15:00.275360 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: b5451732c8d74dd1a2441228702a7d2c Aug 22 17:15:00.275360 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-TenantUsagesTestJSON-96121253-project Aug 22 17:15:00.275360 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:15:00.275360 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance e734abd7-7fe7-40b1-b6fc-49590a36e09d could not be found. Aug 22 17:15:00.275360 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'e734abd7-7fe7-40b1-b6fc-49590a36e09d'} Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e734abd7-7fe7-40b1-b6fc-49590a36e09d could not be found. Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:15:00.276231 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:00.279222 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:00.279222 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:15:00.279222 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:15:00.279222 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:15:00.279222 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:15:00.279222 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:15:00.279222 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:15:00.279222 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e734abd7-7fe7-40b1-b6fc-49590a36e09d could not be found. Aug 22 17:15:00.279222 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:00.279222 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:00.279222 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:00.279222 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:00.279222 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:00.279222 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:00.279222 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:15:00.279222 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:15:00.279222 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e734abd7-7fe7-40b1-b6fc-49590a36e09d could not be found. Aug 22 17:15:00.279222 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:00.283707 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-209f3443-b651-4164-9293-730be2ded2a8 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] Returning 404 to user: Instance e734abd7-7fe7-40b1-b6fc-49590a36e09d could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:15:00.284911 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-209f3443-b651-4164-9293-730be2ded2a8 tempest-TenantUsagesTestJSON-96121253 tempest-TenantUsagesTestJSON-96121253-project] 10.222.0.96 "GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d" status: 404 len: 111 microversion: 2.1 time: 0.096813 Aug 22 17:15:00.289343 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 408/847] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:00 2022] GET /compute/v2.1/servers/e734abd7-7fe7-40b1-b6fc-49590a36e09d => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:15:00.410766 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5ac99e13-14a4-46ef-aca7-4d49da5d6a23 tempest-FloatingIPsNegativeTestJSON-541053732 tempest-FloatingIPsNegativeTestJSON-541053732-project] Calling method '.version_select at 0x7f8009bb15e0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:00.476789 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5ac99e13-14a4-46ef-aca7-4d49da5d6a23 tempest-FloatingIPsNegativeTestJSON-541053732 tempest-FloatingIPsNegativeTestJSON-541053732-project] 10.222.0.96 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.185992 Aug 22 17:15:00.479146 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 409/848] 10.222.0.96 () {58 vars in 1149 bytes} [Mon Aug 22 17:15:00 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:15:00.487406 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-bc4c823a-c6bc-4add-a6ab-ed70005ad26f tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1125920210", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "119c6723-6301-4b30-a6c1-2f9e83ef5d07"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:00.625926 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-bc4c823a-c6bc-4add-a6ab-ed70005ad26f tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] validate_networks() for [('119c6723-6301-4b30-a6c1-2f9e83ef5d07', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:15:00.838631 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1ba3d273-b1fe-4b0b-8a85-478fa4edeb80 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:00.855324 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1ba3d273-b1fe-4b0b-8a85-478fa4edeb80 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 200 len: 1527 microversion: 2.1 time: 0.727203 Aug 22 17:15:00.873738 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 440/849] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:00 2022] GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 1527 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:00.893459 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9682cc6b-a81e-4934-9d6b-b001a67b5db6 tempest-FloatingIPsNegativeTestJSON-541053732 tempest-FloatingIPsNegativeTestJSON-541053732-project] Action: 'create', calling method: .version_select at 0x7f80099f7dc0>, body: {"pool": "non_exist_pool"} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:01.000648 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-bc4c823a-c6bc-4add-a6ab-ed70005ad26f tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3d515fef-f595-49f0-8836-38997252a5d7) Aug 22 17:15:01.000648 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:01.000648 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:01.000648 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:01.000648 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:01.000648 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:01.000648 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:01.000648 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:01.000648 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:01.000648 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:01.000648 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:15:01.000648 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:15:01.000648 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:15:01.000648 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:15:01.000648 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:15:01.000648 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:15:01.001879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:15:01.001879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:15:01.001879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:15:01.001879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:15:01.001879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:15:01.001879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:15:01.001879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:15:01.001879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:15:01.001879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:15:01.001879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:15:01.001879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:15:01.001879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.001879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.001879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:15:01.001879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:15:01.001879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.001879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.001879 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:15:01.002970 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:15:01.002970 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.002970 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.002970 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:15:01.002970 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:15:01.002970 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.002970 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.002970 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:15:01.002970 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:15:01.002970 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:15:01.002970 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:15:01.002970 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:15:01.002970 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:15:01.002970 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:15:01.002970 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:15:01.002970 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:15:01.002970 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:15:01.002970 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:15:01.004032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:15:01.004032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:15:01.004032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:15:01.004032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:15:01.004032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:15:01.004032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:15:01.004032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:15:01.004032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:15:01.004032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:15:01.004032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:15:01.004032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:15:01.004032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:15:01.004032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:15:01.004032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:15:01.004032 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:15:01.004931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3d515fef-f595-49f0-8836-38997252a5d7) Aug 22 17:15:01.004931 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.004931 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-bc4c823a-c6bc-4add-a6ab-ed70005ad26f tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:01.004931 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-bc4c823a-c6bc-4add-a6ab-ed70005ad26f tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] Request method failure captured: Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 210 Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7luZhqH2uUSn1AB6BDAOHUzsExxaETJPNsr4DxtmCkXwmco6hwv1ugKMqvQyt9TjSUS1evQCiqBCOQDQX9tlTOgrWg-vNT3c9S8zssoqzP9yaiZluiCe95yW6Edaq0xi-iPyBnpy-Z8T84CZSWzy_ACLEYRT1wSJme-CSQ93KF9Z28 Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 57aa3e1076cf43338cc3a48a6d2c83d4 Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-VolumesAdminNegativeTest-1897544385 Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:15:01.006647 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:15:01.007951 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/57aa3e1076cf43338cc3a48a6d2c83d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_57aa3e1076cf43338cc3a48a6d2c83d4", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/57aa3e1076cf43338cc3a48a6d2c83d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/57aa3e1076cf43338cc3a48a6d2c83d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:15:01.007951 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-VolumesAdminNegativeTest-1897544385 Aug 22 17:15:01.007951 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 57aa3e1076cf43338cc3a48a6d2c83d4 Aug 22 17:15:01.007951 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1897544385 Aug 22 17:15:01.007951 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-VolumesAdminNegativeTest-1897544385-project Aug 22 17:15:01.007951 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:15:01.007951 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:15:01.007951 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 075de197fb044b8596060c5b3e0f117b Aug 22 17:15:01.007951 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-VolumesAdminNegativeTest-1897544385-project Aug 22 17:15:01.007951 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:15:01.007951 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1125920210", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "119c6723-6301-4b30-a6c1-2f9e83ef5d07"}]}} Aug 22 17:15:01.008662 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:15:01.008662 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:01.008662 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:15:01.008662 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-VolumesAdminNegativeTest-server-1125920210', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '119c6723-6301-4b30-a6c1-2f9e83ef5d07'}]}}} Aug 22 17:15:01.008662 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:15:01.008662 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:01.008662 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:01.008662 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:01.008662 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:01.008662 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:01.008662 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:01.008662 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:01.008662 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:01.008662 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:01.008662 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:15:01.008662 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:15:01.008662 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:15:01.008662 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:15:01.008662 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:15:01.013702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:15:01.013702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:15:01.013702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:15:01.013702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:15:01.013702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:15:01.013702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:15:01.013702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:15:01.013702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:15:01.013702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:15:01.013702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:15:01.013702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:15:01.013702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:15:01.013702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.013702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.013702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:15:01.013702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:15:01.013702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.013702 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.014816 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:15:01.014816 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:15:01.014816 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.014816 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.014816 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:15:01.014816 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:15:01.014816 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.014816 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.014816 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:15:01.014816 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:15:01.014816 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:15:01.014816 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:15:01.014816 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:15:01.014816 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:15:01.014816 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:15:01.014816 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:15:01.014816 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:15:01.014816 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:15:01.015967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:15:01.015967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:15:01.015967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:15:01.015967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:15:01.015967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:15:01.015967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:15:01.015967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:15:01.015967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:15:01.015967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:15:01.015967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:15:01.015967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:15:01.015967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:15:01.015967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:15:01.015967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:15:01.015967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:15:01.015967 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:15:01.016924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3d515fef-f595-49f0-8836-38997252a5d7) Aug 22 17:15:01.016924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.016924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:01.016924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.016924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:01.016924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:01.016924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:01.016924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:15:01.016924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:15:01.016924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:15:01.016924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:15:01.016924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:01.016924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.016924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.016924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:01.016924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.016924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:01.016924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:01.016924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:01.019832 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:15:01.019832 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:15:01.019832 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:01.019832 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.019832 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.019832 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-bc4c823a-c6bc-4add-a6ab-ed70005ad26f tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:01.019832 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:15:01.019832 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-bc4c823a-c6bc-4add-a6ab-ed70005ad26f tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.528689 Aug 22 17:15:01.019832 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 410/850] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:15:00 2022] POST /compute/v2.1/servers => generated 214 bytes in 531 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:15:01.019832 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ed1cb283-e694-4c6c-ad31-db7baf57bec6 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:01.021250 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-ed1cb283-e694-4c6c-ad31-db7baf57bec6 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:01.032401 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ed1cb283-e694-4c6c-ad31-db7baf57bec6 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:01.032896 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ed1cb283-e694-4c6c-ad31-db7baf57bec6 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:01.033360 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ed1cb283-e694-4c6c-ad31-db7baf57bec6 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:01.034077 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ed1cb283-e694-4c6c-ad31-db7baf57bec6 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:01.034646 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ed1cb283-e694-4c6c-ad31-db7baf57bec6 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:01.035260 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ed1cb283-e694-4c6c-ad31-db7baf57bec6 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:01.167814 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ed1cb283-e694-4c6c-ad31-db7baf57bec6 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:01.185676 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ed1cb283-e694-4c6c-ad31-db7baf57bec6 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1275 microversion: 2.1 time: 0.167916 Aug 22 17:15:01.185676 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 411/851] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:01 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:01.193137 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5103173c-8f01-45b8-8eec-ae58d12cf9d2 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:01.199467 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:15:01.199467 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:15:01.199757 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-9682cc6b-a81e-4934-9d6b-b001a67b5db6 tempest-FloatingIPsNegativeTestJSON-541053732 tempest-FloatingIPsNegativeTestJSON-541053732-project] HTTP exception thrown: Floating IP pool not found. Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9682cc6b-a81e-4934-9d6b-b001a67b5db6 tempest-FloatingIPsNegativeTestJSON-541053732 tempest-FloatingIPsNegativeTestJSON-541053732-project] Request method failure captured: Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 26 Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7mT42jgQIwVVxnQtAWZHG7W8ZG-ukQoK9pu2VpOD0psraM-WFIxLbRnoOL519m62DZ4qw6RhqDe_Qo3v7HPw555rbPOS19FZMqHeXsviDYufoUqzaW_2h1r4a-yz-FZwwhaSFWud0mwsdA7ZoyVXtMKPSx6vJzhbxkmKOf546r6YLI Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 5f4e492d0b1d40f38dac6f31229b8687 Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-541053732 Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:15:01.201188 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:15:01.202657 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/5f4e492d0b1d40f38dac6f31229b8687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_5f4e492d0b1d40f38dac6f31229b8687", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/5f4e492d0b1d40f38dac6f31229b8687"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/5f4e492d0b1d40f38dac6f31229b8687"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:15:01.202657 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-541053732 Aug 22 17:15:01.202657 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 5f4e492d0b1d40f38dac6f31229b8687 Aug 22 17:15:01.202657 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-541053732 Aug 22 17:15:01.202657 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-FloatingIPsNegativeTestJSON-541053732-project Aug 22 17:15:01.202657 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:15:01.202657 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:15:01.202657 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: b24937fbd2d944618cd6fc3d226b46da Aug 22 17:15:01.202657 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-541053732-project Aug 22 17:15:01.202657 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:15:01.202657 n-d-854030-1 devstack@n-api.service[123015]: {"pool": "non_exist_pool"} Aug 22 17:15:01.202657 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:15:01.202657 n-d-854030-1 devstack@n-api.service[123015]: exception: Floating IP pool not found. Aug 22 17:15:01.202657 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 22 17:15:01.202657 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:01.203751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:01.205030 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 22 17:15:01.205030 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:15:01.205030 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 22 17:15:01.205030 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.205030 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:01.205030 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.205030 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:01.205030 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:01.205030 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:01.205030 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:15:01.205030 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:15:01.205030 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 22 17:15:01.205030 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.205030 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9682cc6b-a81e-4934-9d6b-b001a67b5db6 tempest-FloatingIPsNegativeTestJSON-541053732 tempest-FloatingIPsNegativeTestJSON-541053732-project] Returning 404 to user: Floating IP pool not found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:15:01.205030 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9682cc6b-a81e-4934-9d6b-b001a67b5db6 tempest-FloatingIPsNegativeTestJSON-541053732 tempest-FloatingIPsNegativeTestJSON-541053732-project] 10.222.0.96 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.327248 Aug 22 17:15:01.207022 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 441/852] 10.222.0.96 () {60 vars in 1170 bytes} [Mon Aug 22 17:15:00 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 329 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:15:01.210801 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3b05d490-1adf-418b-b33b-b916287e294c tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] Calling method '.version_select at 0x7f80099e7550>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:01.232845 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:01.430077 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5103173c-8f01-45b8-8eec-ae58d12cf9d2 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/523673ea-12b5-4048-975a-43685837c4d8" status: 202 len: 0 microversion: 2.1 time: 0.242992 Aug 22 17:15:01.430559 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3b05d490-1adf-418b-b33b-b916287e294c tempest-VolumesAdminNegativeTest-1897544385 tempest-VolumesAdminNegativeTest-1897544385-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-426684846" status: 202 len: 0 microversion: 2.1 time: 0.226425 Aug 22 17:15:01.431406 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 442/853] 10.222.0.96 () {58 vars in 1218 bytes} [Mon Aug 22 17:15:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-426684846 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:15:01.434779 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 412/854] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:15:01 2022] DELETE /compute/v2.1/flavors/523673ea-12b5-4048-975a-43685837c4d8 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:15:01.442877 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-976f0284-548a-4e35-85df-28cbef34be61 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:01.442877 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-976f0284-548a-4e35-85df-28cbef34be61 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:01.443074 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1674fa79-c122-4864-900f-b3a43d81b3d5 tempest-FloatingIPsNegativeTestJSON-541053732 tempest-FloatingIPsNegativeTestJSON-541053732-project] Calling method '.version_select at 0x7f80099463a0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:01.454971 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-976f0284-548a-4e35-85df-28cbef34be61 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:01.455496 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-976f0284-548a-4e35-85df-28cbef34be61 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:01.458040 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-976f0284-548a-4e35-85df-28cbef34be61 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:01.460443 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-976f0284-548a-4e35-85df-28cbef34be61 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:01.460952 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-976f0284-548a-4e35-85df-28cbef34be61 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:01.465269 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-976f0284-548a-4e35-85df-28cbef34be61 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:01.718796 n-d-854030-1 devstack@n-api.service[123015]: DEBUG neutronclient.v2_0.client [None req-1674fa79-c122-4864-900f-b3a43d81b3d5 tempest-FloatingIPsNegativeTestJSON-541053732 tempest-FloatingIPsNegativeTestJSON-541053732-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6899f6e2-eb3e-42a7-b415-aa6ded84fc5a could not be found", "detail": ""}} {{(pid=123015) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:15:01.719801 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-1674fa79-c122-4864-900f-b3a43d81b3d5 tempest-FloatingIPsNegativeTestJSON-541053732 tempest-FloatingIPsNegativeTestJSON-541053732-project] HTTP exception thrown: Floating IP not found for ID 6899f6e2-eb3e-42a7-b415-aa6ded84fc5a Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1674fa79-c122-4864-900f-b3a43d81b3d5 tempest-FloatingIPsNegativeTestJSON-541053732 tempest-FloatingIPsNegativeTestJSON-541053732-project] Request method failure captured: Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/os-floating-ips/6899f6e2-eb3e-42a7-b415-aa6ded84fc5a HTTP/1.1 Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7mT42jgQIwVVxnQtAWZHG7W8ZG-ukQoK9pu2VpOD0psraM-WFIxLbRnoOL519m62DZ4qw6RhqDe_Qo3v7HPw555rbPOS19FZMqHeXsviDYufoUqzaW_2h1r4a-yz-FZwwhaSFWud0mwsdA7ZoyVXtMKPSx6vJzhbxkmKOf546r6YLI Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 5f4e492d0b1d40f38dac6f31229b8687 Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-541053732 Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:15:01.733690 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:15:01.735445 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/5f4e492d0b1d40f38dac6f31229b8687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_5f4e492d0b1d40f38dac6f31229b8687", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/5f4e492d0b1d40f38dac6f31229b8687"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/5f4e492d0b1d40f38dac6f31229b8687"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:15:01.735445 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-541053732 Aug 22 17:15:01.735445 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 5f4e492d0b1d40f38dac6f31229b8687 Aug 22 17:15:01.735445 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-541053732 Aug 22 17:15:01.735445 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-FloatingIPsNegativeTestJSON-541053732-project Aug 22 17:15:01.735445 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:15:01.735445 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:15:01.735445 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: b24937fbd2d944618cd6fc3d226b46da Aug 22 17:15:01.735445 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-541053732-project Aug 22 17:15:01.735445 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:15:01.735445 n-d-854030-1 devstack@n-api.service[123015]: exception: Floating IP not found for ID 6899f6e2-eb3e-42a7-b415-aa6ded84fc5a Aug 22 17:15:01.735445 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '6899f6e2-eb3e-42a7-b415-aa6ded84fc5a'} Aug 22 17:15:01.735445 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:15:01.736397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:01.736397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 22 17:15:01.736397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 22 17:15:01.736397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.736397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.736397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 22 17:15:01.736397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 22 17:15:01.736397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.736397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.736397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:15:01.736397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:15:01.736397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.736397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.736397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:15:01.736397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:15:01.736397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.736397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.736397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 22 17:15:01.736397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6899f6e2-eb3e-42a7-b415-aa6ded84fc5a could not be found Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ff47c98-6906-419f-bfdc-91a59c4c6711'] Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6899f6e2-eb3e-42a7-b415-aa6ded84fc5a. Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:01.737844 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6899f6e2-eb3e-42a7-b415-aa6ded84fc5a Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:15:01.739380 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:15:01.740950 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6899f6e2-eb3e-42a7-b415-aa6ded84fc5a Aug 22 17:15:01.740950 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.740950 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1674fa79-c122-4864-900f-b3a43d81b3d5 tempest-FloatingIPsNegativeTestJSON-541053732 tempest-FloatingIPsNegativeTestJSON-541053732-project] Returning 404 to user: Floating IP not found for ID 6899f6e2-eb3e-42a7-b415-aa6ded84fc5a {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:15:01.740950 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1674fa79-c122-4864-900f-b3a43d81b3d5 tempest-FloatingIPsNegativeTestJSON-541053732 tempest-FloatingIPsNegativeTestJSON-541053732-project] 10.222.0.96 "DELETE /compute/v2.1/os-floating-ips/6899f6e2-eb3e-42a7-b415-aa6ded84fc5a" status: 404 len: 111 microversion: 2.1 time: 0.303551 Aug 22 17:15:01.741709 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 443/855] 10.222.0.96 () {58 vars in 1263 bytes} [Mon Aug 22 17:15:01 2022] DELETE /compute/v2.1/os-floating-ips/6899f6e2-eb3e-42a7-b415-aa6ded84fc5a => generated 111 bytes in 306 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:15:01.746421 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-739b47df-8206-4b4c-ae84-f99b4104f69c tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:01.768472 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-739b47df-8206-4b4c-ae84-f99b4104f69c tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025609 Aug 22 17:15:01.769026 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 444/856] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:15:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:01.773635 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-bc9500bb-e0fb-4930-9b4b-2a3246859de0 req-e398e4c2-2a06-4fa2-87d5-4a2ae7b792a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1637eb7d-9aaf-4222-8c72-451f8599172f", "tag": "4c523d3d-ae85-4cfa-be7b-a786a656afa2"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:01.784014 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-bc9500bb-e0fb-4930-9b4b-2a3246859de0 req-e398e4c2-2a06-4fa2-87d5-4a2ae7b792a3 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:01.784720 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-bc9500bb-e0fb-4930-9b4b-2a3246859de0 req-e398e4c2-2a06-4fa2-87d5-4a2ae7b792a3 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:01.785180 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-bc9500bb-e0fb-4930-9b4b-2a3246859de0 req-e398e4c2-2a06-4fa2-87d5-4a2ae7b792a3 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:01.815121 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-bc9500bb-e0fb-4930-9b4b-2a3246859de0 req-e398e4c2-2a06-4fa2-87d5-4a2ae7b792a3 service nova] Creating event network-changed:4c523d3d-ae85-4cfa-be7b-a786a656afa2 for instance 1637eb7d-9aaf-4222-8c72-451f8599172f on n-h1-854030-1 Aug 22 17:15:01.823836 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-bc9500bb-e0fb-4930-9b4b-2a3246859de0 req-e398e4c2-2a06-4fa2-87d5-4a2ae7b792a3 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052926 Aug 22 17:15:01.824635 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 445/857] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:01.831100 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d17ebb43-3885-4e6e-8f6e-8ca643a9654d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:01.834541 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d17ebb43-3885-4e6e-8f6e-8ca643a9654d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:01.843457 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d17ebb43-3885-4e6e-8f6e-8ca643a9654d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:01.844532 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d17ebb43-3885-4e6e-8f6e-8ca643a9654d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:01.845326 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d17ebb43-3885-4e6e-8f6e-8ca643a9654d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:01.846890 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d17ebb43-3885-4e6e-8f6e-8ca643a9654d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:01.847699 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d17ebb43-3885-4e6e-8f6e-8ca643a9654d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:01.849010 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d17ebb43-3885-4e6e-8f6e-8ca643a9654d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:01.883401 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-976f0284-548a-4e35-85df-28cbef34be61 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:01.892688 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-976f0284-548a-4e35-85df-28cbef34be61 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 200 len: 1318 microversion: 2.1 time: 0.459611 Aug 22 17:15:01.893607 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 413/858] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:01 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:01.936273 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-d17ebb43-3885-4e6e-8f6e-8ca643a9654d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-10c0991d-9d66-4d7d-bd1a-e9959c210e0d) Aug 22 17:15:01.936273 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:01.936273 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:01.936273 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:01.936273 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:01.936273 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:01.936273 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 22 17:15:01.936273 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 22 17:15:01.936273 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 22 17:15:01.936273 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 22 17:15:01.936273 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 22 17:15:01.936273 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 22 17:15:01.936273 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 22 17:15:01.936273 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 22 17:15:01.937290 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:15:01.937290 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:15:01.937290 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:15:01.937290 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:15:01.937290 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:15:01.937290 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:15:01.937290 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.937290 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.937290 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:15:01.937290 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:15:01.937290 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.937290 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.937290 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:15:01.937290 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:15:01.937290 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.937290 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.937290 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:15:01.937290 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:15:01.938368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.938368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.938368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:15:01.938368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:15:01.938368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:15:01.938368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:15:01.938368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:15:01.938368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:15:01.938368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:15:01.938368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:15:01.938368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:15:01.938368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:15:01.938368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:15:01.938368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:15:01.938368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:15:01.938368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:15:01.938368 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:15:01.939399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:15:01.939399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:15:01.939399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:15:01.939399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:15:01.939399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:15:01.939399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:15:01.939399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:15:01.939399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:15:01.939399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:15:01.939399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:15:01.939399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:15:01.939399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-10c0991d-9d66-4d7d-bd1a-e9959c210e0d) Aug 22 17:15:01.939399 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.939399 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-d17ebb43-3885-4e6e-8f6e-8ca643a9654d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d17ebb43-3885-4e6e-8f6e-8ca643a9654d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Request method failure captured: Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913/action HTTP/1.1 Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 32 Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7k87sm7WV03FM7bZ8JjHyvQfPnVPLjS8igb88BLXVKmU_5cWSQLGEJGPSdMyWuitZn_vyOfy_MRB5UuFQaoEkCRZuXZwqy6IGsGpeN98b6g_VAprshPTrzwmmZdhYp3OkQB85942qKskPxRA_FIoWgy2xmo-4iwmpVti-FLjmF-gDI Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: c3d5a2fb6b4440168a7e84d03007a6fb Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-MigrationsAdminTest-1971141865 Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:15:01.940259 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:15:01.941723 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c3d5a2fb6b4440168a7e84d03007a6fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_c3d5a2fb6b4440168a7e84d03007a6fb", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c3d5a2fb6b4440168a7e84d03007a6fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/c3d5a2fb6b4440168a7e84d03007a6fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:15:01.941723 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-MigrationsAdminTest-1971141865 Aug 22 17:15:01.941723 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: c3d5a2fb6b4440168a7e84d03007a6fb Aug 22 17:15:01.941723 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-MigrationsAdminTest-1971141865 Aug 22 17:15:01.941723 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-MigrationsAdminTest-1971141865-project Aug 22 17:15:01.941723 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:15:01.941723 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:15:01.941723 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: dafa41865864461fa0e0dbc4a0188e4b Aug 22 17:15:01.941723 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-MigrationsAdminTest-1971141865-project Aug 22 17:15:01.941723 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:15:01.941723 n-d-854030-1 devstack@n-api.service[123015]: {"resize": {"flavorRef": "451"}} Aug 22 17:15:01.941723 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:15:01.941723 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:01.942570 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:15:01.942570 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '94de208f-edff-400d-840d-1cb7eafb3913', 'body': {'resize': {'flavorRef': '451'}}} Aug 22 17:15:01.942570 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:15:01.942570 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:01.942570 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:01.942570 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:01.942570 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:01.942570 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:01.942570 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 22 17:15:01.942570 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 22 17:15:01.942570 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 22 17:15:01.942570 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 22 17:15:01.942570 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 22 17:15:01.942570 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 22 17:15:01.942570 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 22 17:15:01.942570 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 22 17:15:01.942570 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:15:01.942570 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:15:01.942570 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:15:01.943793 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:15:01.943793 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:15:01.943793 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:15:01.943793 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.943793 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.943793 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:15:01.943793 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:15:01.943793 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.943793 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.943793 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:15:01.943793 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:15:01.943793 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.943793 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.943793 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:15:01.943793 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:15:01.943793 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:01.943793 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:01.943793 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:15:01.944968 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:15:01.944968 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:15:01.944968 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:15:01.944968 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:15:01.944968 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:15:01.944968 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:15:01.944968 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:15:01.944968 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:15:01.944968 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:15:01.944968 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:15:01.944968 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:15:01.944968 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:15:01.944968 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:15:01.944968 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:15:01.944968 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:15:01.944968 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:15:01.944968 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:15:01.950279 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:15:01.950279 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:15:01.950279 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:15:01.950279 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:15:01.950279 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:15:01.950279 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:15:01.950279 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:15:01.950279 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:15:01.950279 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-10c0991d-9d66-4d7d-bd1a-e9959c210e0d) Aug 22 17:15:01.950279 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.950279 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:01.950279 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.950279 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:01.950279 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:01.950279 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:01.950279 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:15:01.950279 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:15:01.957182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:15:01.957182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:15:01.957182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:01.957182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.957182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.957182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:01.957182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.957182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:01.957182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:01.957182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:01.957182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:15:01.957182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:15:01.957182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:01.957182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.957182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.957182 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d17ebb43-3885-4e6e-8f6e-8ca643a9654d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:01.957182 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:15:01.959529 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d17ebb43-3885-4e6e-8f6e-8ca643a9654d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "POST /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913/action" status: 500 len: 214 microversion: 2.1 time: 0.105305 Aug 22 17:15:01.959676 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c370397c-6834-4dde-88cb-41239a29cb4f tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:01.960780 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:15:01.960780 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:15:01.973014 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 446/859] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:15:01 2022] POST /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913/action => generated 214 bytes in 147 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:15:01.974916 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=6 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:01.979423 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-c370397c-6834-4dde-88cb-41239a29cb4f tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] HTTP exception thrown: Flavor 523673ea-12b5-4048-975a-43685837c4d8 could not be found. Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c370397c-6834-4dde-88cb-41239a29cb4f tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Request method failure captured: Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: request: DELETE /compute/v2.1/flavors/523673ea-12b5-4048-975a-43685837c4d8 HTTP/1.1 Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7k-eHTtoh8JT4OY7na4sDNAiFpsEfe3go2M3ox3vL3Yg5jQTcSDGN-bzPc4Jufq2zgz9ZPHyYEAVU5s1JQKere2Lktt-O13MKVepTActz5JqD52chtrFMEg_x4sXfzRrT7GJ8gfG8GlcMClKndtLRBnqjMEy6nL-RMY5jQDVKfFX1s Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 21ea51a81af14b2592a2e0f46be6b778 Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-MigrationsAdminTest-1307498773 Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:15:01.982080 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:15:01.983543 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/21ea51a81af14b2592a2e0f46be6b778"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_21ea51a81af14b2592a2e0f46be6b778", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/21ea51a81af14b2592a2e0f46be6b778"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/21ea51a81af14b2592a2e0f46be6b778"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:15:01.983543 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-MigrationsAdminTest-1307498773 Aug 22 17:15:01.983543 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 21ea51a81af14b2592a2e0f46be6b778 Aug 22 17:15:01.983543 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-MigrationsAdminTest-1307498773 Aug 22 17:15:01.983543 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-MigrationsAdminTest-1307498773-project-admin Aug 22 17:15:01.983543 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:15:01.983543 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:15:01.983543 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: f0b166e7b8d74473a3a4db88436f284f Aug 22 17:15:01.983543 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-MigrationsAdminTest-1307498773-project-admin Aug 22 17:15:01.983543 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:15:01.983543 n-d-854030-1 devstack@n-api.service[123016]: exception: Flavor 523673ea-12b5-4048-975a-43685837c4d8 could not be found. Aug 22 17:15:01.983543 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '523673ea-12b5-4048-975a-43685837c4d8'} Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 523673ea-12b5-4048-975a-43685837c4d8 could not be found. Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:01.984283 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:01.985760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:01.985760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:15:01.985760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:15:01.985760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:01.985760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:01.985760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 22 17:15:01.985760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:15:01.985760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 523673ea-12b5-4048-975a-43685837c4d8 could not be found. Aug 22 17:15:01.985760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.985760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:01.985760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.985760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:01.985760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:01.985760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:01.985760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:15:01.985760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:15:01.985760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 523673ea-12b5-4048-975a-43685837c4d8 could not be found. Aug 22 17:15:01.985760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:01.989187 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c370397c-6834-4dde-88cb-41239a29cb4f tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Returning 404 to user: Flavor 523673ea-12b5-4048-975a-43685837c4d8 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:15:01.990446 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c370397c-6834-4dde-88cb-41239a29cb4f tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/523673ea-12b5-4048-975a-43685837c4d8" status: 404 len: 109 microversion: 2.1 time: 0.042151 Aug 22 17:15:01.991383 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 414/860] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:15:01 2022] DELETE /compute/v2.1/flavors/523673ea-12b5-4048-975a-43685837c4d8 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:15:02.207199 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f13922a7-ee40-41d9-937e-d998941f6f1e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:02.209555 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f13922a7-ee40-41d9-937e-d998941f6f1e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:02.223689 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f13922a7-ee40-41d9-937e-d998941f6f1e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:02.224402 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f13922a7-ee40-41d9-937e-d998941f6f1e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:02.225272 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f13922a7-ee40-41d9-937e-d998941f6f1e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:02.231256 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f13922a7-ee40-41d9-937e-d998941f6f1e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:02.231536 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f13922a7-ee40-41d9-937e-d998941f6f1e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:02.232061 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f13922a7-ee40-41d9-937e-d998941f6f1e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:02.259230 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fef72065-1479-4586-b4dc-23a9f90385f8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-436047650", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:02.288471 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=42 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:02.370301 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-fef72065-1479-4586-b4dc-23a9f90385f8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] validate_networks() for None {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:15:02.544568 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f13922a7-ee40-41d9-937e-d998941f6f1e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:02.554177 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f13922a7-ee40-41d9-937e-d998941f6f1e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1275 microversion: 2.1 time: 0.350811 Aug 22 17:15:02.556851 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 447/861] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:02 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1275 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:02.921021 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9ba39296-2053-4666-a4fe-6d170a9e0c71 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:02.922161 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9ba39296-2053-4666-a4fe-6d170a9e0c71 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:02.933817 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-fef72065-1479-4586-b4dc-23a9f90385f8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:15:02.935870 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-fef72065-1479-4586-b4dc-23a9f90385f8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:15:02.938085 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-fef72065-1479-4586-b4dc-23a9f90385f8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:15:02.938837 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-fef72065-1479-4586-b4dc-23a9f90385f8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:15:02.940584 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-fef72065-1479-4586-b4dc-23a9f90385f8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:15:02.984456 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ba39296-2053-4666-a4fe-6d170a9e0c71 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:02.989948 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ba39296-2053-4666-a4fe-6d170a9e0c71 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:02.997328 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ba39296-2053-4666-a4fe-6d170a9e0c71 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:02.998349 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ba39296-2053-4666-a4fe-6d170a9e0c71 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:03.003062 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ba39296-2053-4666-a4fe-6d170a9e0c71 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:03.005476 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ba39296-2053-4666-a4fe-6d170a9e0c71 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:03.007149 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fef72065-1479-4586-b4dc-23a9f90385f8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:03.012917 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fef72065-1479-4586-b4dc-23a9f90385f8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:03.014955 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fef72065-1479-4586-b4dc-23a9f90385f8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:03.016026 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fef72065-1479-4586-b4dc-23a9f90385f8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:03.020938 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fef72065-1479-4586-b4dc-23a9f90385f8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:03.023421 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fef72065-1479-4586-b4dc-23a9f90385f8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:03.085792 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-fef72065-1479-4586-b4dc-23a9f90385f8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Getting quotas for project c3d5a2fb6b4440168a7e84d03007a6fb. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:03.108400 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-fef72065-1479-4586-b4dc-23a9f90385f8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Getting quotas for user dafa41865864461fa0e0dbc4a0188e4b and project c3d5a2fb6b4440168a7e84d03007a6fb. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:03.143603 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-fef72065-1479-4586-b4dc-23a9f90385f8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Going to run 1 instances... {{(pid=123016) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:15:03.151746 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-fef72065-1479-4586-b4dc-23a9f90385f8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:15:03.177856 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=8 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:03.342588 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-fef72065-1479-4586-b4dc-23a9f90385f8 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.087147 Aug 22 17:15:03.349480 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 415/862] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:15:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 17:15:03.362015 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5dd757a4-9b14-4e9f-bfe6-a10b5b35997f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:03.362396 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5dd757a4-9b14-4e9f-bfe6-a10b5b35997f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:03.800336 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=18 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:03.882695 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-5dd757a4-9b14-4e9f-bfe6-a10b5b35997f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:03.891056 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5dd757a4-9b14-4e9f-bfe6-a10b5b35997f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1212 microversion: 2.1 time: 0.533755 Aug 22 17:15:03.894154 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 416/863] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:03 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1212 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:03.907719 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0d6416e5-5c32-4953-aa8a-dd58dd1da776 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:03.908708 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-0d6416e5-5c32-4953-aa8a-dd58dd1da776 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:03.927237 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d6416e5-5c32-4953-aa8a-dd58dd1da776 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:03.928140 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d6416e5-5c32-4953-aa8a-dd58dd1da776 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:03.928693 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d6416e5-5c32-4953-aa8a-dd58dd1da776 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:03.929554 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d6416e5-5c32-4953-aa8a-dd58dd1da776 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:03.930268 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d6416e5-5c32-4953-aa8a-dd58dd1da776 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:03.931516 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d6416e5-5c32-4953-aa8a-dd58dd1da776 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:04.503485 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-0d6416e5-5c32-4953-aa8a-dd58dd1da776 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:04.519783 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0d6416e5-5c32-4953-aa8a-dd58dd1da776 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1317 microversion: 2.1 time: 0.624217 Aug 22 17:15:04.538326 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 417/864] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:03 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1317 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:04.920291 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ce320e08-be0b-42b5-a423-1d217189976c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:04.921497 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-ce320e08-be0b-42b5-a423-1d217189976c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:04.937338 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ce320e08-be0b-42b5-a423-1d217189976c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:04.938311 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ce320e08-be0b-42b5-a423-1d217189976c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:04.941018 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ce320e08-be0b-42b5-a423-1d217189976c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:04.943531 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ce320e08-be0b-42b5-a423-1d217189976c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:04.945147 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ce320e08-be0b-42b5-a423-1d217189976c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:04.946990 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ce320e08-be0b-42b5-a423-1d217189976c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:04.974038 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9ba39296-2053-4666-a4fe-6d170a9e0c71 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:04.992531 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9ba39296-2053-4666-a4fe-6d170a9e0c71 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 200 len: 1318 microversion: 2.1 time: 2.080618 Aug 22 17:15:04.997826 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 448/865] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:02 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 1318 bytes in 2088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:15:05.555136 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-10139fb8-9e64-425b-a0fb-701c7a63ea63 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:05.556847 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-10139fb8-9e64-425b-a0fb-701c7a63ea63 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:05.574293 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-10139fb8-9e64-425b-a0fb-701c7a63ea63 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:05.575136 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-10139fb8-9e64-425b-a0fb-701c7a63ea63 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:05.584033 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-10139fb8-9e64-425b-a0fb-701c7a63ea63 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:05.584033 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-10139fb8-9e64-425b-a0fb-701c7a63ea63 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:05.584033 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-10139fb8-9e64-425b-a0fb-701c7a63ea63 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:05.584033 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-10139fb8-9e64-425b-a0fb-701c7a63ea63 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:05.740428 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ce320e08-be0b-42b5-a423-1d217189976c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:05.758318 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ce320e08-be0b-42b5-a423-1d217189976c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1216 microversion: 2.1 time: 0.844336 Aug 22 17:15:05.760244 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 418/866] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:04 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1216 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:06.021916 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b59e585f-a53e-4dd7-aa6b-a7608e449e98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:06.022493 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b59e585f-a53e-4dd7-aa6b-a7608e449e98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:06.044565 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b59e585f-a53e-4dd7-aa6b-a7608e449e98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:06.045162 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b59e585f-a53e-4dd7-aa6b-a7608e449e98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:06.045623 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b59e585f-a53e-4dd7-aa6b-a7608e449e98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:06.046377 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b59e585f-a53e-4dd7-aa6b-a7608e449e98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:06.046842 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b59e585f-a53e-4dd7-aa6b-a7608e449e98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:06.054818 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b59e585f-a53e-4dd7-aa6b-a7608e449e98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:06.438918 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-10139fb8-9e64-425b-a0fb-701c7a63ea63 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:06.457251 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-10139fb8-9e64-425b-a0fb-701c7a63ea63 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1317 microversion: 2.1 time: 0.901118 Aug 22 17:15:06.475224 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 449/867] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:05 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1317 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:06.572094 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b59e585f-a53e-4dd7-aa6b-a7608e449e98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:06.588593 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b59e585f-a53e-4dd7-aa6b-a7608e449e98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 200 len: 1318 microversion: 2.1 time: 0.570975 Aug 22 17:15:06.589219 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 419/868] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:06 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 1318 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:15:06.693403 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-fe613833-f089-4b16-833d-3e3dab49b8ab req-da4ca3a5-09ea-4ca5-8534-10ec7855a6fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9d1e79a-48e9-436e-a233-7a950de59886", "tag": "6f8bb3a8-685e-4d62-8584-0402c1743657"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:06.749633 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-fe613833-f089-4b16-833d-3e3dab49b8ab req-da4ca3a5-09ea-4ca5-8534-10ec7855a6fe service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:06.760707 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-fe613833-f089-4b16-833d-3e3dab49b8ab req-da4ca3a5-09ea-4ca5-8534-10ec7855a6fe service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:06.761392 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-fe613833-f089-4b16-833d-3e3dab49b8ab req-da4ca3a5-09ea-4ca5-8534-10ec7855a6fe service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:06.771878 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c9339918-bd4d-4e7a-bd36-2b228409995e tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Action: 'create', calling method: .version_select at 0x7f80099e7790>, body: {"keypair": {"name": "tempest-keypair-1579186132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3te8ssHMZVVjrxdlt1wnALNNR0BxUiFmVKVl+V0rtx6Kx8hXrG6OjAqKaiHi7rPGzEwsX6f7VyJ4hR6O/6OP0ugKfQChLXObazlahGHaV5jcd7M7fXibGvdJ6S425/gA=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:06.810045 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-c9339918-bd4d-4e7a-bd36-2b228409995e tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Getting quotas for project dbcea631d35f4c55b8fb3196a4125490. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:06.820872 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-c9339918-bd4d-4e7a-bd36-2b228409995e tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Getting quotas for user 5c58367aa6a147c58a55f6ff6dd0144d and project dbcea631d35f4c55b8fb3196a4125490. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:06.832712 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-fe613833-f089-4b16-833d-3e3dab49b8ab req-da4ca3a5-09ea-4ca5-8534-10ec7855a6fe service nova] Creating event network-changed:6f8bb3a8-685e-4d62-8584-0402c1743657 for instance b9d1e79a-48e9-436e-a233-7a950de59886 on n-h2-854030-1 Aug 22 17:15:06.886890 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-fe613833-f089-4b16-833d-3e3dab49b8ab req-da4ca3a5-09ea-4ca5-8534-10ec7855a6fe service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198035 Aug 22 17:15:06.901765 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 420/869] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:06.907396 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-08281630-8904-4154-a768-9f60e39545b9 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:06.908119 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-08281630-8904-4154-a768-9f60e39545b9 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:06.979320 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c9339918-bd4d-4e7a-bd36-2b228409995e tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.502190 Aug 22 17:15:06.984803 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08281630-8904-4154-a768-9f60e39545b9 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:06.985851 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 450/870] 10.222.0.96 () {62 vars in 1199 bytes} [Mon Aug 22 17:15:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 509 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 22 17:15:06.990972 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-426a5d47-980e-49dc-b3d4-e54f170484f2 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Calling method '.version_select at 0x7f8009ce1af0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:06.998488 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08281630-8904-4154-a768-9f60e39545b9 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:06.999061 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08281630-8904-4154-a768-9f60e39545b9 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:06.999850 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08281630-8904-4154-a768-9f60e39545b9 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:07.000335 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08281630-8904-4154-a768-9f60e39545b9 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:07.000776 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-08281630-8904-4154-a768-9f60e39545b9 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:07.015565 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-426a5d47-980e-49dc-b3d4-e54f170484f2 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "GET /compute/v2.1/os-keypairs/tempest-keypair-1579186132" status: 200 len: 512 microversion: 2.2 time: 0.027173 Aug 22 17:15:07.022721 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 451/871] 10.222.0.96 () {60 vars in 1258 bytes} [Mon Aug 22 17:15:06 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1579186132 => generated 512 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:07.034386 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2a805daf-9e79-4a96-93ba-f4eced225e29 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Calling method '.version_select at 0x7f8009d1d3a0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:07.206029 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2a805daf-9e79-4a96-93ba-f4eced225e29 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1579186132" status: 204 len: 0 microversion: 2.2 time: 0.179829 Aug 22 17:15:07.207112 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 452/872] 10.222.0.96 () {60 vars in 1261 bytes} [Mon Aug 22 17:15:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1579186132 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:15:07.224604 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-620c29b9-07af-4dc1-a193-37f36b3a2028 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Action: 'create', calling method: .version_select at 0x7f8009df0d30>, body: {"keypair": {"name": "tempest-keypair-775398377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBk/AYu3O6REArXDGr2sCnuS9uMJ/r/eys27NAXvZXm488hjWG9X7nkLix7Gv4z0OBnwVjANBMnY1HWZgxJ3cY4TEgJW7fv8w9rTh9a1KM+JGaNqRjq/K7KdI3ScnI+hWA=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:07.257820 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-620c29b9-07af-4dc1-a193-37f36b3a2028 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Getting quotas for project dbcea631d35f4c55b8fb3196a4125490. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:07.272213 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-620c29b9-07af-4dc1-a193-37f36b3a2028 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Getting quotas for user 5c58367aa6a147c58a55f6ff6dd0144d and project dbcea631d35f4c55b8fb3196a4125490. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:07.298652 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-08281630-8904-4154-a768-9f60e39545b9 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:07.346382 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-08281630-8904-4154-a768-9f60e39545b9 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1264 microversion: 2.1 time: 0.443182 Aug 22 17:15:07.354362 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 421/873] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:06 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1264 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:07.406933 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-620c29b9-07af-4dc1-a193-37f36b3a2028 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.186699 Aug 22 17:15:07.414016 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 453/874] 10.222.0.96 () {62 vars in 1199 bytes} [Mon Aug 22 17:15:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 188 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 22 17:15:07.428892 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-34ab421f-c4ad-443e-869b-ea0d7f1a3989 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Calling method '.version_select at 0x7f8009df29d0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:07.483895 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9d178e36-d0dd-42ff-a656-47f8bef92403 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:07.485173 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9d178e36-d0dd-42ff-a656-47f8bef92403 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:07.503182 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9d178e36-d0dd-42ff-a656-47f8bef92403 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:07.507484 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9d178e36-d0dd-42ff-a656-47f8bef92403 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:07.510615 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9d178e36-d0dd-42ff-a656-47f8bef92403 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:07.513965 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9d178e36-d0dd-42ff-a656-47f8bef92403 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:07.515919 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9d178e36-d0dd-42ff-a656-47f8bef92403 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:07.516559 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9d178e36-d0dd-42ff-a656-47f8bef92403 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:07.584552 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-34ab421f-c4ad-443e-869b-ea0d7f1a3989 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-775398377" status: 204 len: 0 microversion: 2.2 time: 0.169190 Aug 22 17:15:07.592247 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 422/875] 10.222.0.96 () {60 vars in 1258 bytes} [Mon Aug 22 17:15:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-775398377 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:15:07.601465 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b6c2ec14-b3a8-4018-9bc0-7bae761326d4 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Action: 'create', calling method: .version_select at 0x7f8009f570d0>, body: {"keypair": {"name": "tempest-keypair-1392311534", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:07.684960 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-b6c2ec14-b3a8-4018-9bc0-7bae761326d4 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Getting quotas for project dbcea631d35f4c55b8fb3196a4125490. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:07.707899 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-b6c2ec14-b3a8-4018-9bc0-7bae761326d4 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Getting quotas for user 5c58367aa6a147c58a55f6ff6dd0144d and project dbcea631d35f4c55b8fb3196a4125490. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:07.877831 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b6c2ec14-b3a8-4018-9bc0-7bae761326d4 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.284002 Aug 22 17:15:07.878671 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 423/876] 10.222.0.96 () {62 vars in 1199 bytes} [Mon Aug 22 17:15:07 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 286 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 22 17:15:07.891416 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-87eecf20-38c9-4ccb-8bc6-2b91523e3b22 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:07.895294 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-87eecf20-38c9-4ccb-8bc6-2b91523e3b22 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:07.932254 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-87eecf20-38c9-4ccb-8bc6-2b91523e3b22 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:07.933068 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-87eecf20-38c9-4ccb-8bc6-2b91523e3b22 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:07.938998 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-87eecf20-38c9-4ccb-8bc6-2b91523e3b22 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:07.944381 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-87eecf20-38c9-4ccb-8bc6-2b91523e3b22 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:07.949562 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-87eecf20-38c9-4ccb-8bc6-2b91523e3b22 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:07.950357 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-87eecf20-38c9-4ccb-8bc6-2b91523e3b22 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:08.829741 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-87eecf20-38c9-4ccb-8bc6-2b91523e3b22 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:08.841283 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-87eecf20-38c9-4ccb-8bc6-2b91523e3b22 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 200 len: 1318 microversion: 2.1 time: 0.955660 Aug 22 17:15:08.843222 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 424/877] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:07 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 1318 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:08.863817 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b9de84bc-6f7d-43ec-8d5a-33ccad5aaeb1 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Calling method '.version_select at 0x7f8009bb1160>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:08.974680 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9d178e36-d0dd-42ff-a656-47f8bef92403 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:08.984986 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9d178e36-d0dd-42ff-a656-47f8bef92403 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1317 microversion: 2.1 time: 1.505700 Aug 22 17:15:08.989930 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 454/878] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:07 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1317 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:15:08.996142 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-84f88e0c-0dd3-40d5-b02b-56089e384bc1 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:08.997330 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-84f88e0c-0dd3-40d5-b02b-56089e384bc1 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:09.004630 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-84f88e0c-0dd3-40d5-b02b-56089e384bc1 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:09.005618 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-84f88e0c-0dd3-40d5-b02b-56089e384bc1 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:09.006507 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-84f88e0c-0dd3-40d5-b02b-56089e384bc1 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:09.007609 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-84f88e0c-0dd3-40d5-b02b-56089e384bc1 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:09.008753 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-84f88e0c-0dd3-40d5-b02b-56089e384bc1 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:09.009505 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-84f88e0c-0dd3-40d5-b02b-56089e384bc1 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:09.063504 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b9de84bc-6f7d-43ec-8d5a-33ccad5aaeb1 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392311534" status: 204 len: 0 microversion: 2.2 time: 0.212763 Aug 22 17:15:09.083430 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 425/879] 10.222.0.96 () {60 vars in 1261 bytes} [Mon Aug 22 17:15:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392311534 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:15:09.091424 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-39bfb05f-3820-4ad4-a98a-f5a6cda72f50 req-da5d7386-c585-46d5-88a7-89e9bdb81296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1637eb7d-9aaf-4222-8c72-451f8599172f", "name": "network-vif-plugged", "status": "completed", "tag": "4c523d3d-ae85-4cfa-be7b-a786a656afa2"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:09.130582 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-39bfb05f-3820-4ad4-a98a-f5a6cda72f50 req-da5d7386-c585-46d5-88a7-89e9bdb81296 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:09.135308 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-39bfb05f-3820-4ad4-a98a-f5a6cda72f50 req-da5d7386-c585-46d5-88a7-89e9bdb81296 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:09.135308 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-39bfb05f-3820-4ad4-a98a-f5a6cda72f50 req-da5d7386-c585-46d5-88a7-89e9bdb81296 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:09.165166 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-39bfb05f-3820-4ad4-a98a-f5a6cda72f50 req-da5d7386-c585-46d5-88a7-89e9bdb81296 service nova] Creating event network-vif-plugged:4c523d3d-ae85-4cfa-be7b-a786a656afa2 for instance 1637eb7d-9aaf-4222-8c72-451f8599172f on n-h1-854030-1 Aug 22 17:15:09.175035 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-39bfb05f-3820-4ad4-a98a-f5a6cda72f50 req-da5d7386-c585-46d5-88a7-89e9bdb81296 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089524 Aug 22 17:15:09.181398 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 426/880] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:09.197030 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b79bc615-b8ac-4603-9680-32f93c6e0e2f tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Action: 'create', calling method: .version_select at 0x7f800a15b310>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-758464596", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSCGQ877KZpux2fkvhPgaKVU8ZKf3C/AieyBmznBxcXOTJrXIFgQhRanfYp/I1d65UzpEHNngNK6ULRpvwo3OK30yXWml4w0oQUauYLKuWBpgCmzQXDHT1MtumwciPBIQ=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:09.238632 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-b79bc615-b8ac-4603-9680-32f93c6e0e2f tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Getting quotas for project dbcea631d35f4c55b8fb3196a4125490. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:09.248491 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-b79bc615-b8ac-4603-9680-32f93c6e0e2f tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Getting quotas for user 5c58367aa6a147c58a55f6ff6dd0144d and project dbcea631d35f4c55b8fb3196a4125490. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:09.374896 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-84f88e0c-0dd3-40d5-b02b-56089e384bc1 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:09.391177 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-84f88e0c-0dd3-40d5-b02b-56089e384bc1 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1270 microversion: 2.1 time: 0.399793 Aug 22 17:15:09.397911 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 455/881] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:08 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1270 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:09.440785 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b79bc615-b8ac-4603-9680-32f93c6e0e2f tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.257027 Aug 22 17:15:09.441550 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 427/882] 10.222.0.96 () {62 vars in 1199 bytes} [Mon Aug 22 17:15:09 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 259 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 22 17:15:09.465965 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a7cc2fa7-a36a-485c-80ba-026314f90176 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Action: 'create', calling method: .version_select at 0x7f8009d1de50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1816677312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAnlpATe1hMrsk1K6IszmZFYCxmhAxW8rmBjWlN8p8QTzGGyFpQeo07+35iukU5NIb7wjDjhio6qdlgnlm5rIa/DwHxRXtOQCoObPA4SYDvWxmM1zOBuvwqHSXZA4SS5Q=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:09.511959 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-a7cc2fa7-a36a-485c-80ba-026314f90176 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Getting quotas for project dbcea631d35f4c55b8fb3196a4125490. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:09.523310 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-a7cc2fa7-a36a-485c-80ba-026314f90176 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Getting quotas for user 5c58367aa6a147c58a55f6ff6dd0144d and project dbcea631d35f4c55b8fb3196a4125490. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:09.671123 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a7cc2fa7-a36a-485c-80ba-026314f90176 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.218109 Aug 22 17:15:09.671940 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 456/883] 10.222.0.96 () {62 vars in 1199 bytes} [Mon Aug 22 17:15:09 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 220 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 22 17:15:09.686008 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-bd7c8fe3-177e-48f4-9ee9-7c469e171b15 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Action: 'create', calling method: .version_select at 0x7f8009bb1160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-138355491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4/7tfp72BNdkVlm4pdgIlVwW7lhK+EPUldYndVxBPhT7wnL6d/2gLRxyHf0tguzQNLh88JzyXUx5tSgQG1tRBo0fRzEW5OrivZpzlhyqNOct2cGaqgcecgN+rlJECT/A=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:09.741221 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-bd7c8fe3-177e-48f4-9ee9-7c469e171b15 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Getting quotas for project dbcea631d35f4c55b8fb3196a4125490. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:09.755013 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-bd7c8fe3-177e-48f4-9ee9-7c469e171b15 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Getting quotas for user 5c58367aa6a147c58a55f6ff6dd0144d and project dbcea631d35f4c55b8fb3196a4125490. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:09.875836 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-65d6917f-6d51-4a60-8298-64aa5eb2b7c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:09.876968 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-65d6917f-6d51-4a60-8298-64aa5eb2b7c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:09.896227 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65d6917f-6d51-4a60-8298-64aa5eb2b7c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:09.897137 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65d6917f-6d51-4a60-8298-64aa5eb2b7c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:09.897846 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65d6917f-6d51-4a60-8298-64aa5eb2b7c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:09.898807 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65d6917f-6d51-4a60-8298-64aa5eb2b7c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:09.902216 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65d6917f-6d51-4a60-8298-64aa5eb2b7c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:09.903110 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65d6917f-6d51-4a60-8298-64aa5eb2b7c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:09.903834 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-bd7c8fe3-177e-48f4-9ee9-7c469e171b15 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.221992 Aug 22 17:15:09.909531 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 428/884] 10.222.0.96 () {62 vars in 1199 bytes} [Mon Aug 22 17:15:09 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 224 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 22 17:15:09.916078 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-dd7d6ab8-799d-4f63-8fe9-e0460fb7c973 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Calling method '.version_select at 0x7f8009eb8a60>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:09.929375 n-d-854030-1 devstack@n-api.service[123016]: WARNING oslo_db.sqlalchemy.utils [None req-dd7d6ab8-799d-4f63-8fe9-e0460fb7c973 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 22 17:15:09.959509 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-dd7d6ab8-799d-4f63-8fe9-e0460fb7c973 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.048197 Aug 22 17:15:09.965066 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 429/885] 10.222.0.96 () {60 vars in 1177 bytes} [Mon Aug 22 17:15:09 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:15:09.981460 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ca39ee37-e4d0-48cd-abd9-105aada02cf1 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Calling method '.version_select at 0x7f8009afcf70>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:10.109580 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ca39ee37-e4d0-48cd-abd9-105aada02cf1 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-138355491" status: 204 len: 0 microversion: 2.2 time: 0.138489 Aug 22 17:15:10.111075 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 430/886] 10.222.0.96 () {60 vars in 1318 bytes} [Mon Aug 22 17:15:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-138355491 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:15:10.116675 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-eb00a74c-9402-4360-8f0d-d53eb959c22e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:10.118446 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-eb00a74c-9402-4360-8f0d-d53eb959c22e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:10.126648 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eb00a74c-9402-4360-8f0d-d53eb959c22e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:10.127431 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eb00a74c-9402-4360-8f0d-d53eb959c22e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:10.128077 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eb00a74c-9402-4360-8f0d-d53eb959c22e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:10.130442 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eb00a74c-9402-4360-8f0d-d53eb959c22e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:10.131040 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eb00a74c-9402-4360-8f0d-d53eb959c22e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:10.131856 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eb00a74c-9402-4360-8f0d-d53eb959c22e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:10.466367 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-65d6917f-6d51-4a60-8298-64aa5eb2b7c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:10.477561 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-65d6917f-6d51-4a60-8298-64aa5eb2b7c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 200 len: 1318 microversion: 2.1 time: 0.609354 Aug 22 17:15:10.482172 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 457/887] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:09 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:10.500326 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-073a1ae6-6d06-495e-a164-97dc48791834 req-dd1d5c6e-d2dc-42df-8d50-20c05089195e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a9699e0-8054-4491-91a6-2d8e34898838", "tag": "0bc75a5b-a857-42d1-be9e-f441f5aad90b"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:10.544200 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-073a1ae6-6d06-495e-a164-97dc48791834 req-dd1d5c6e-d2dc-42df-8d50-20c05089195e service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:10.544782 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-073a1ae6-6d06-495e-a164-97dc48791834 req-dd1d5c6e-d2dc-42df-8d50-20c05089195e service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:10.545263 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-073a1ae6-6d06-495e-a164-97dc48791834 req-dd1d5c6e-d2dc-42df-8d50-20c05089195e service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:10.586427 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-073a1ae6-6d06-495e-a164-97dc48791834 req-dd1d5c6e-d2dc-42df-8d50-20c05089195e service nova] Creating event network-changed:0bc75a5b-a857-42d1-be9e-f441f5aad90b for instance 8a9699e0-8054-4491-91a6-2d8e34898838 on n-h2-854030-1 Aug 22 17:15:10.595049 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-073a1ae6-6d06-495e-a164-97dc48791834 req-dd1d5c6e-d2dc-42df-8d50-20c05089195e service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111195 Aug 22 17:15:10.597193 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 458/888] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:10.603932 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a635bddf-ab2e-45f1-a821-853c572a6e2e tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Calling method '.version_select at 0x7f80099469d0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:10.615091 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:10.779363 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a635bddf-ab2e-45f1-a821-853c572a6e2e tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1816677312" status: 204 len: 0 microversion: 2.2 time: 0.180435 Aug 22 17:15:10.780280 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 459/889] 10.222.0.96 () {60 vars in 1321 bytes} [Mon Aug 22 17:15:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1816677312 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:15:10.791171 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-86d0505a-0f86-49c0-8557-4c4592fa971c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:10.795065 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-86d0505a-0f86-49c0-8557-4c4592fa971c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:10.889970 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-eb00a74c-9402-4360-8f0d-d53eb959c22e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:10.898211 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-eb00a74c-9402-4360-8f0d-d53eb959c22e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1317 microversion: 2.1 time: 0.785903 Aug 22 17:15:10.904940 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-86d0505a-0f86-49c0-8557-4c4592fa971c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:10.904940 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-86d0505a-0f86-49c0-8557-4c4592fa971c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:10.904940 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-86d0505a-0f86-49c0-8557-4c4592fa971c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:10.904940 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-86d0505a-0f86-49c0-8557-4c4592fa971c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:10.905326 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-86d0505a-0f86-49c0-8557-4c4592fa971c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:10.905326 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-86d0505a-0f86-49c0-8557-4c4592fa971c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:10.907169 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 431/890] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:10 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1317 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:10.915559 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a58e2206-addf-4125-b399-bce46fa7d710 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Calling method '.version_select at 0x7f8009f570d0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:11.078482 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a58e2206-addf-4125-b399-bce46fa7d710 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-758464596" status: 204 len: 0 microversion: 2.2 time: 0.169889 Aug 22 17:15:11.080832 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 432/891] 10.222.0.96 () {60 vars in 1318 bytes} [Mon Aug 22 17:15:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-758464596 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:15:11.110017 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-385abeae-af71-4e45-b269-15630c46ef13 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Action: 'create', calling method: .version_select at 0x7f8009d42820>, body: {"keypair": {"name": "tempest-keypair-1346891246", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVuTyweChp9PsEjBI7ekUW3TONMD4RUqIGGR2x5d/hzfVVpM/bL5I0KhpnBD9b+kwfJI7lxnHdJqZvMCJyxrPSwiUNph9zU2ZKD1B5O0nvB7LRK7aTf4+HtFQXhzURQuQ=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:11.138745 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=5,nova_api:INSERT=6 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:11.186434 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-385abeae-af71-4e45-b269-15630c46ef13 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Getting quotas for project dbcea631d35f4c55b8fb3196a4125490. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:11.202438 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-385abeae-af71-4e45-b269-15630c46ef13 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Getting quotas for user 5c58367aa6a147c58a55f6ff6dd0144d and project dbcea631d35f4c55b8fb3196a4125490. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:11.384896 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-385abeae-af71-4e45-b269-15630c46ef13 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.286030 Aug 22 17:15:11.385640 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 433/892] 10.222.0.96 () {62 vars in 1199 bytes} [Mon Aug 22 17:15:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 288 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 22 17:15:11.391695 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-46f1979b-6fb1-4eb6-a3d8-1ac138b64c99 req-825756d4-8d80-4d3f-bf63-3e501aea1563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f63d0c5a-060f-4524-93eb-78c4950d8848", "name": "network-vif-plugged", "status": "completed", "tag": "b6ddfbbd-fd37-44fd-a8a3-f657b0f59e28"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:11.419502 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-46f1979b-6fb1-4eb6-a3d8-1ac138b64c99 req-825756d4-8d80-4d3f-bf63-3e501aea1563 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:11.420325 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-46f1979b-6fb1-4eb6-a3d8-1ac138b64c99 req-825756d4-8d80-4d3f-bf63-3e501aea1563 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:11.421195 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-46f1979b-6fb1-4eb6-a3d8-1ac138b64c99 req-825756d4-8d80-4d3f-bf63-3e501aea1563 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:11.438028 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-46f1979b-6fb1-4eb6-a3d8-1ac138b64c99 req-825756d4-8d80-4d3f-bf63-3e501aea1563 service nova] Creating event network-vif-plugged:b6ddfbbd-fd37-44fd-a8a3-f657b0f59e28 for instance f63d0c5a-060f-4524-93eb-78c4950d8848 on n-h1-854030-1 Aug 22 17:15:11.447368 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-46f1979b-6fb1-4eb6-a3d8-1ac138b64c99 req-825756d4-8d80-4d3f-bf63-3e501aea1563 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060056 Aug 22 17:15:11.461494 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 434/893] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:11.476514 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e757d4d9-a650-43a7-afd0-9cc6f98147ed tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Calling method '.version_select at 0x7f8009eb88b0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:11.496706 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e757d4d9-a650-43a7-afd0-9cc6f98147ed tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "GET /compute/v2.1/os-keypairs/tempest-keypair-1346891246" status: 200 len: 513 microversion: 2.2 time: 0.032677 Aug 22 17:15:11.498067 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 435/894] 10.222.0.96 () {60 vars in 1258 bytes} [Mon Aug 22 17:15:11 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1346891246 => generated 513 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:11.503262 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e591ba00-e98a-47f7-be5a-75e7f15612e0 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:11.504556 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e591ba00-e98a-47f7-be5a-75e7f15612e0 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:11.513637 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e591ba00-e98a-47f7-be5a-75e7f15612e0 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:11.514595 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e591ba00-e98a-47f7-be5a-75e7f15612e0 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:11.515442 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e591ba00-e98a-47f7-be5a-75e7f15612e0 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:11.516740 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e591ba00-e98a-47f7-be5a-75e7f15612e0 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:11.517644 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e591ba00-e98a-47f7-be5a-75e7f15612e0 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:11.518332 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e591ba00-e98a-47f7-be5a-75e7f15612e0 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:11.816599 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-86d0505a-0f86-49c0-8557-4c4592fa971c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:11.833455 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-86d0505a-0f86-49c0-8557-4c4592fa971c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1312 microversion: 2.1 time: 1.051654 Aug 22 17:15:11.834591 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 460/895] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:10 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1312 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:11.840169 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0cc09907-712b-4078-930c-d7b77e1556c0 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Calling method '.version_select at 0x7f8009a86550>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:11.845672 n-d-854030-1 devstack@n-api.service[123015]: WARNING oslo_db.sqlalchemy.utils [None req-0cc09907-712b-4078-930c-d7b77e1556c0 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 22 17:15:11.855515 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0cc09907-712b-4078-930c-d7b77e1556c0 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.017677 Aug 22 17:15:11.856397 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 461/896] 10.222.0.96 () {60 vars in 1177 bytes} [Mon Aug 22 17:15:11 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:11.858412 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e591ba00-e98a-47f7-be5a-75e7f15612e0 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:11.875490 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-390eb796-173a-426e-a013-a3a6e3b494b5 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Calling method '.version_select at 0x7f8009d1db80>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:11.879685 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e591ba00-e98a-47f7-be5a-75e7f15612e0 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 200 len: 1318 microversion: 2.1 time: 0.379989 Aug 22 17:15:11.885302 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 436/897] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:11 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:11.928756 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1f28e6c9-a026-4565-b5b8-3f0be335d3c3 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:11.929841 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-1f28e6c9-a026-4565-b5b8-3f0be335d3c3 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:11.957873 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1f28e6c9-a026-4565-b5b8-3f0be335d3c3 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:11.960746 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1f28e6c9-a026-4565-b5b8-3f0be335d3c3 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:11.961463 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1f28e6c9-a026-4565-b5b8-3f0be335d3c3 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:11.962748 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1f28e6c9-a026-4565-b5b8-3f0be335d3c3 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:11.964003 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1f28e6c9-a026-4565-b5b8-3f0be335d3c3 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:11.967466 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1f28e6c9-a026-4565-b5b8-3f0be335d3c3 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:12.017849 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-390eb796-173a-426e-a013-a3a6e3b494b5 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346891246" status: 204 len: 0 microversion: 2.2 time: 0.152150 Aug 22 17:15:12.019118 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 462/898] 10.222.0.96 () {60 vars in 1261 bytes} [Mon Aug 22 17:15:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346891246 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:15:12.041069 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-aac15343-127f-4f61-9651-b8dd5ffa228b tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Action: 'create', calling method: .version_select at 0x7f8009d2bee0>, body: {"keypair": {"name": "tempest-keypair-528217713", "type": "x509"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:12.068884 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-aac15343-127f-4f61-9651-b8dd5ffa228b tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Getting quotas for project dbcea631d35f4c55b8fb3196a4125490. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:12.081293 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-aac15343-127f-4f61-9651-b8dd5ffa228b tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Getting quotas for user 5c58367aa6a147c58a55f6ff6dd0144d and project dbcea631d35f4c55b8fb3196a4125490. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:12.119308 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.processutils [None req-aac15343-127f-4f61-9651-b8dd5ffa228b tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp1z29891v/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1z29891v/temp.key -subj /CN=5c58367aa6a147c58a55f6ff6dd0144d -extensions v3_req_client {{(pid=123015) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 22 17:15:12.337145 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-1f28e6c9-a026-4565-b5b8-3f0be335d3c3 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:12.348620 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1f28e6c9-a026-4565-b5b8-3f0be335d3c3 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1317 microversion: 2.1 time: 0.425057 Aug 22 17:15:12.370773 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 437/899] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:11 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:12.812737 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.processutils [None req-aac15343-127f-4f61-9651-b8dd5ffa228b tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp1z29891v/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1z29891v/temp.key -subj /CN=5c58367aa6a147c58a55f6ff6dd0144d -extensions v3_req_client" returned: 0 in 0.692s {{(pid=123015) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 22 17:15:12.814624 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.processutils [None req-aac15343-127f-4f61-9651-b8dd5ffa228b tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp1z29891v/temp.key -password pass: {{(pid=123015) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 22 17:15:12.860722 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.processutils [None req-aac15343-127f-4f61-9651-b8dd5ffa228b tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp1z29891v/temp.key -password pass:" returned: 0 in 0.039s {{(pid=123015) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 22 17:15:12.864701 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-aaba6bbb-c85a-4272-9904-0c13f63198f3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:12.865494 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-aaba6bbb-c85a-4272-9904-0c13f63198f3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:12.876040 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-aaba6bbb-c85a-4272-9904-0c13f63198f3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:12.878499 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-aaba6bbb-c85a-4272-9904-0c13f63198f3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:12.879872 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-aaba6bbb-c85a-4272-9904-0c13f63198f3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:12.881295 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-aaba6bbb-c85a-4272-9904-0c13f63198f3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:12.881873 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-aaba6bbb-c85a-4272-9904-0c13f63198f3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:12.889978 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-aaba6bbb-c85a-4272-9904-0c13f63198f3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:13.005421 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-aac15343-127f-4f61-9651-b8dd5ffa228b tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Getting quotas for project dbcea631d35f4c55b8fb3196a4125490. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:13.012130 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-aac15343-127f-4f61-9651-b8dd5ffa228b tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Getting quotas for user 5c58367aa6a147c58a55f6ff6dd0144d and project dbcea631d35f4c55b8fb3196a4125490. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:13.031292 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-aac15343-127f-4f61-9651-b8dd5ffa228b tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.005559 Aug 22 17:15:13.032797 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 463/900] 10.222.0.96 () {62 vars in 1198 bytes} [Mon Aug 22 17:15:12 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1009 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:15:13.039375 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c00df067-ea49-44f3-8ca0-bd4019cb129d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:13.040538 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-c00df067-ea49-44f3-8ca0-bd4019cb129d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:13.048727 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c00df067-ea49-44f3-8ca0-bd4019cb129d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:13.049601 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c00df067-ea49-44f3-8ca0-bd4019cb129d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:13.050258 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c00df067-ea49-44f3-8ca0-bd4019cb129d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:13.050935 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:13.051737 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c00df067-ea49-44f3-8ca0-bd4019cb129d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:13.052476 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c00df067-ea49-44f3-8ca0-bd4019cb129d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:13.053057 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c00df067-ea49-44f3-8ca0-bd4019cb129d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:13.280761 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-aaba6bbb-c85a-4272-9904-0c13f63198f3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:13.283481 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=100 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:13.302457 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-aaba6bbb-c85a-4272-9904-0c13f63198f3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1312 microversion: 2.1 time: 0.444731 Aug 22 17:15:13.304523 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 438/901] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:12 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1312 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:13.312288 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c3ce353e-3b0d-47b9-bfc7-53b3bb51b7b4 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Calling method '.version_select at 0x7f8009a3f5e0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:13.323394 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c3ce353e-3b0d-47b9-bfc7-53b3bb51b7b4 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "GET /compute/v2.1/os-keypairs/tempest-keypair-528217713" status: 200 len: 1533 microversion: 2.2 time: 0.016738 Aug 22 17:15:13.324254 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 439/902] 10.222.0.96 () {60 vars in 1255 bytes} [Mon Aug 22 17:15:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-528217713 => generated 1533 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:13.337889 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e6c94829-8000-42d2-89e7-7667e18e716a tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Calling method '.version_select at 0x7f8009b11430>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:13.345680 n-d-854030-1 devstack@n-api.service[123016]: WARNING oslo_db.sqlalchemy.utils [None req-e6c94829-8000-42d2-89e7-7667e18e716a tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 22 17:15:13.351680 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e6c94829-8000-42d2-89e7-7667e18e716a tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.018024 Aug 22 17:15:13.354115 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 440/903] 10.222.0.96 () {60 vars in 1177 bytes} [Mon Aug 22 17:15:13 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:13.365449 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b1f9c4ec-4927-44cc-8ba2-d3bb5b0dc347 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] Calling method '.version_select at 0x7f8009dccf70>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:13.520541 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b1f9c4ec-4927-44cc-8ba2-d3bb5b0dc347 tempest-KeyPairsV22TestJSON-749030231 tempest-KeyPairsV22TestJSON-749030231-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-528217713" status: 204 len: 0 microversion: 2.2 time: 0.160012 Aug 22 17:15:13.521809 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 441/904] 10.222.0.96 () {60 vars in 1258 bytes} [Mon Aug 22 17:15:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-528217713 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:15:13.533629 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-699cba6d-ab37-4523-b7fb-5de0cf458559 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:13.534428 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-699cba6d-ab37-4523-b7fb-5de0cf458559 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:13.550334 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-699cba6d-ab37-4523-b7fb-5de0cf458559 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:13.578099 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-699cba6d-ab37-4523-b7fb-5de0cf458559 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:13.578759 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-699cba6d-ab37-4523-b7fb-5de0cf458559 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:13.579624 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-699cba6d-ab37-4523-b7fb-5de0cf458559 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:13.580098 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-699cba6d-ab37-4523-b7fb-5de0cf458559 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:13.580537 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-699cba6d-ab37-4523-b7fb-5de0cf458559 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:13.738758 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c00df067-ea49-44f3-8ca0-bd4019cb129d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:13.752229 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c00df067-ea49-44f3-8ca0-bd4019cb129d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 200 len: 1318 microversion: 2.1 time: 0.717891 Aug 22 17:15:13.762342 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 464/905] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:13 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 1318 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:14.108299 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-699cba6d-ab37-4523-b7fb-5de0cf458559 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:14.116363 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-699cba6d-ab37-4523-b7fb-5de0cf458559 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1317 microversion: 2.1 time: 0.592794 Aug 22 17:15:14.130091 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 442/906] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:13 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1317 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:14.252332 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-f27d1646-a971-406c-961f-6f9cad018b21 req-b67c3251-0123-49df-8adf-e6c53660d6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8507ebf3-26fb-454f-bffb-e3aae22e3e37", "tag": "06644b82-5010-4ba1-879b-3c2e1d9e2444"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:14.288093 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-f27d1646-a971-406c-961f-6f9cad018b21 req-b67c3251-0123-49df-8adf-e6c53660d6f7 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:14.288809 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-f27d1646-a971-406c-961f-6f9cad018b21 req-b67c3251-0123-49df-8adf-e6c53660d6f7 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:14.289956 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-f27d1646-a971-406c-961f-6f9cad018b21 req-b67c3251-0123-49df-8adf-e6c53660d6f7 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:14.309476 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-f27d1646-a971-406c-961f-6f9cad018b21 req-b67c3251-0123-49df-8adf-e6c53660d6f7 service nova] Creating event network-changed:06644b82-5010-4ba1-879b-3c2e1d9e2444 for instance 8507ebf3-26fb-454f-bffb-e3aae22e3e37 on n-h1-854030-1 Aug 22 17:15:14.321259 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-f27d1646-a971-406c-961f-6f9cad018b21 req-b67c3251-0123-49df-8adf-e6c53660d6f7 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072121 Aug 22 17:15:14.324935 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 465/907] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:14.337054 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-849bf4af-97d2-4c0c-a175-fad76ca16032 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:14.337707 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-849bf4af-97d2-4c0c-a175-fad76ca16032 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:14.358369 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-849bf4af-97d2-4c0c-a175-fad76ca16032 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:14.369166 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-849bf4af-97d2-4c0c-a175-fad76ca16032 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:14.373976 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-849bf4af-97d2-4c0c-a175-fad76ca16032 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:14.376794 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-849bf4af-97d2-4c0c-a175-fad76ca16032 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:14.379696 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-849bf4af-97d2-4c0c-a175-fad76ca16032 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:14.380414 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-849bf4af-97d2-4c0c-a175-fad76ca16032 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:14.778886 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e99c384b-c69e-4188-9a9d-22b0f43b6f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:14.779848 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-e99c384b-c69e-4188-9a9d-22b0f43b6f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:14.792816 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e99c384b-c69e-4188-9a9d-22b0f43b6f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:14.793343 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e99c384b-c69e-4188-9a9d-22b0f43b6f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:14.797342 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e99c384b-c69e-4188-9a9d-22b0f43b6f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:14.799703 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e99c384b-c69e-4188-9a9d-22b0f43b6f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:14.800263 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e99c384b-c69e-4188-9a9d-22b0f43b6f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:14.800717 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e99c384b-c69e-4188-9a9d-22b0f43b6f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:14.938952 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-849bf4af-97d2-4c0c-a175-fad76ca16032 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:14.956011 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-849bf4af-97d2-4c0c-a175-fad76ca16032 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1312 microversion: 2.1 time: 0.623797 Aug 22 17:15:14.961740 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 443/908] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:14 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1312 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:15.142093 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7ee34b54-b92d-4bc8-8c03-c6b7fa896639 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:15.143062 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-7ee34b54-b92d-4bc8-8c03-c6b7fa896639 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:15.159049 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7ee34b54-b92d-4bc8-8c03-c6b7fa896639 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:15.160731 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7ee34b54-b92d-4bc8-8c03-c6b7fa896639 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:15.161782 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7ee34b54-b92d-4bc8-8c03-c6b7fa896639 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:15.166582 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7ee34b54-b92d-4bc8-8c03-c6b7fa896639 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:15.167692 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7ee34b54-b92d-4bc8-8c03-c6b7fa896639 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:15.188086 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7ee34b54-b92d-4bc8-8c03-c6b7fa896639 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:15.455599 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e99c384b-c69e-4188-9a9d-22b0f43b6f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:15.475364 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e99c384b-c69e-4188-9a9d-22b0f43b6f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 200 len: 1468 microversion: 2.1 time: 0.700710 Aug 22 17:15:15.477906 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 466/909] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:14 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 1468 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:15:15.514945 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-86c18903-2348-4ed1-9f5c-7d574328fbe4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:15.515685 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-86c18903-2348-4ed1-9f5c-7d574328fbe4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 1637eb7d-9aaf-4222-8c72-451f8599172f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:15.533071 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-86c18903-2348-4ed1-9f5c-7d574328fbe4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:15.543708 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-86c18903-2348-4ed1-9f5c-7d574328fbe4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:15.544169 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-86c18903-2348-4ed1-9f5c-7d574328fbe4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:15.544935 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-86c18903-2348-4ed1-9f5c-7d574328fbe4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:15.545434 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-86c18903-2348-4ed1-9f5c-7d574328fbe4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:15.545868 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-86c18903-2348-4ed1-9f5c-7d574328fbe4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:15.952126 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-7ee34b54-b92d-4bc8-8c03-c6b7fa896639 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:15.964565 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7ee34b54-b92d-4bc8-8c03-c6b7fa896639 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1317 microversion: 2.1 time: 0.827762 Aug 22 17:15:15.975992 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 444/910] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:15 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1317 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:16.000807 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-bb9119c4-2e81-4718-9903-5e709ff28215 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:16.001629 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-bb9119c4-2e81-4718-9903-5e709ff28215 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:16.014289 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb9119c4-2e81-4718-9903-5e709ff28215 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:16.016958 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb9119c4-2e81-4718-9903-5e709ff28215 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:16.018526 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb9119c4-2e81-4718-9903-5e709ff28215 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:16.023473 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb9119c4-2e81-4718-9903-5e709ff28215 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:16.023473 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb9119c4-2e81-4718-9903-5e709ff28215 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:16.023473 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb9119c4-2e81-4718-9903-5e709ff28215 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:16.646918 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-bb9119c4-2e81-4718-9903-5e709ff28215 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:16.662784 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-bb9119c4-2e81-4718-9903-5e709ff28215 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1312 microversion: 2.1 time: 0.670150 Aug 22 17:15:16.665545 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 445/911] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:15 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1312 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:16.987987 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-437b6996-df11-4b0a-91e0-c95931a3e4c1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:16.991166 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-437b6996-df11-4b0a-91e0-c95931a3e4c1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:17.012836 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-437b6996-df11-4b0a-91e0-c95931a3e4c1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:17.013660 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-437b6996-df11-4b0a-91e0-c95931a3e4c1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:17.014397 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-437b6996-df11-4b0a-91e0-c95931a3e4c1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:17.015377 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-437b6996-df11-4b0a-91e0-c95931a3e4c1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:17.015765 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-437b6996-df11-4b0a-91e0-c95931a3e4c1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:17.016221 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-437b6996-df11-4b0a-91e0-c95931a3e4c1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:17.123788 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-86c18903-2348-4ed1-9f5c-7d574328fbe4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:17.135145 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-86c18903-2348-4ed1-9f5c-7d574328fbe4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/1637eb7d-9aaf-4222-8c72-451f8599172f" status: 200 len: 1468 microversion: 2.1 time: 1.624916 Aug 22 17:15:17.147017 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 467/912] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:15 2022] GET /compute/v2.1/servers/1637eb7d-9aaf-4222-8c72-451f8599172f => generated 1468 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:17.171698 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-15e85bce-58fd-47db-a79a-2bdfb866f4c2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:17.185375 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-15e85bce-58fd-47db-a79a-2bdfb866f4c2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:17.192932 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-15e85bce-58fd-47db-a79a-2bdfb866f4c2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Searching by: {'reservation_id': 'r-ejwd00i9', 'deleted': False, 'project_id': 'd789047469894e1fbe5af3a109a95b4c'} {{(pid=123015) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 22 17:15:17.213995 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-15e85bce-58fd-47db-a79a-2bdfb866f4c2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:17.217290 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-15e85bce-58fd-47db-a79a-2bdfb866f4c2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:17.218051 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-15e85bce-58fd-47db-a79a-2bdfb866f4c2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:17.219411 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-15e85bce-58fd-47db-a79a-2bdfb866f4c2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:17.220137 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-15e85bce-58fd-47db-a79a-2bdfb866f4c2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:17.220797 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-15e85bce-58fd-47db-a79a-2bdfb866f4c2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:17.437795 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.multi_cell_list [None req-15e85bce-58fd-47db-a79a-2bdfb866f4c2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123015) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 22 17:15:17.683787 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-437b6996-df11-4b0a-91e0-c95931a3e4c1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:17.696458 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-437b6996-df11-4b0a-91e0-c95931a3e4c1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1317 microversion: 2.1 time: 0.711635 Aug 22 17:15:17.707588 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 446/913] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:16 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1317 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:17.723738 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9d88be7c-5b19-4ae5-bbdb-6dbc089b0d3f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:17.728554 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-9d88be7c-5b19-4ae5-bbdb-6dbc089b0d3f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:17.744064 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9d88be7c-5b19-4ae5-bbdb-6dbc089b0d3f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:17.744729 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9d88be7c-5b19-4ae5-bbdb-6dbc089b0d3f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:17.746477 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9d88be7c-5b19-4ae5-bbdb-6dbc089b0d3f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:17.747915 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9d88be7c-5b19-4ae5-bbdb-6dbc089b0d3f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:17.749190 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9d88be7c-5b19-4ae5-bbdb-6dbc089b0d3f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:17.750974 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9d88be7c-5b19-4ae5-bbdb-6dbc089b0d3f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:17.798858 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-15e85bce-58fd-47db-a79a-2bdfb866f4c2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:17.810961 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-15e85bce-58fd-47db-a79a-2bdfb866f4c2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:17.811775 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-15e85bce-58fd-47db-a79a-2bdfb866f4c2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:17.812157 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-15e85bce-58fd-47db-a79a-2bdfb866f4c2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:17.962656 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-15e85bce-58fd-47db-a79a-2bdfb866f4c2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/detail?reservation_id=r-ejwd00i9" status: 200 len: 2929 microversion: 2.1 time: 0.805465 Aug 22 17:15:17.969501 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 468/914] 10.222.0.96 () {58 vars in 1197 bytes} [Mon Aug 22 17:15:17 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ejwd00i9 => generated 2929 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:17.988441 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-61daa3f3-f4d7-4ee8-8dcf-b160f5039fe2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:18.040827 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.compute.server_groups [None req-61daa3f3-f4d7-4ee8-8dcf-b160f5039fe2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Querying cell 0e788ee0-d5b8-44d6-b202-c201e1b338b4(cell1) for 2 instances {{(pid=123015) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 22 17:15:18.043233 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-61daa3f3-f4d7-4ee8-8dcf-b160f5039fe2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:18.043942 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-61daa3f3-f4d7-4ee8-8dcf-b160f5039fe2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:18.044608 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-61daa3f3-f4d7-4ee8-8dcf-b160f5039fe2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:18.094374 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-61daa3f3-f4d7-4ee8-8dcf-b160f5039fe2 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/os-server-groups/e933271f-229e-4e83-b54f-0d94d04187ec" status: 200 len: 265 microversion: 2.1 time: 0.108709 Aug 22 17:15:18.095660 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 469/915] 10.222.0.96 () {58 vars in 1263 bytes} [Mon Aug 22 17:15:17 2022] GET /compute/v2.1/os-server-groups/e933271f-229e-4e83-b54f-0d94d04187ec => generated 265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:15:18.106636 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2603876d-1888-4d00-a27b-a5195a859859 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:18.108775 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-2603876d-1888-4d00-a27b-a5195a859859 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] [instance: 1637eb7d-9aaf-4222-8c72-451f8599172f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:18.120030 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2603876d-1888-4d00-a27b-a5195a859859 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:18.120543 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2603876d-1888-4d00-a27b-a5195a859859 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:18.120985 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2603876d-1888-4d00-a27b-a5195a859859 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:18.121899 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2603876d-1888-4d00-a27b-a5195a859859 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:18.122305 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2603876d-1888-4d00-a27b-a5195a859859 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:18.122731 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2603876d-1888-4d00-a27b-a5195a859859 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:18.194750 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9d88be7c-5b19-4ae5-bbdb-6dbc089b0d3f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:18.203335 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9d88be7c-5b19-4ae5-bbdb-6dbc089b0d3f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1312 microversion: 2.1 time: 0.500898 Aug 22 17:15:18.207063 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 447/916] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:17 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1312 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:18.375967 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=100 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:18.379347 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2603876d-1888-4d00-a27b-a5195a859859 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/1637eb7d-9aaf-4222-8c72-451f8599172f" status: 200 len: 1619 microversion: 2.1 time: 0.276947 Aug 22 17:15:18.383777 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 470/917] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:18 2022] GET /compute/v2.1/servers/1637eb7d-9aaf-4222-8c72-451f8599172f => generated 1619 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:18.405756 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-23f61935-787e-4923-b59e-da522bdef299 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:18.407105 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-23f61935-787e-4923-b59e-da522bdef299 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:18.417975 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-23f61935-787e-4923-b59e-da522bdef299 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:18.418809 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-23f61935-787e-4923-b59e-da522bdef299 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:18.419775 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-23f61935-787e-4923-b59e-da522bdef299 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:18.422172 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-23f61935-787e-4923-b59e-da522bdef299 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:18.422874 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-23f61935-787e-4923-b59e-da522bdef299 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:18.423579 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-23f61935-787e-4923-b59e-da522bdef299 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:18.732430 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6fd0c7c3-b398-4fc2-89cc-21c6c55920f8 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:18.732973 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-6fd0c7c3-b398-4fc2-89cc-21c6c55920f8 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:18.743992 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6fd0c7c3-b398-4fc2-89cc-21c6c55920f8 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:18.745510 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6fd0c7c3-b398-4fc2-89cc-21c6c55920f8 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:18.746109 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6fd0c7c3-b398-4fc2-89cc-21c6c55920f8 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:18.750173 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6fd0c7c3-b398-4fc2-89cc-21c6c55920f8 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:18.750983 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6fd0c7c3-b398-4fc2-89cc-21c6c55920f8 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:18.751607 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6fd0c7c3-b398-4fc2-89cc-21c6c55920f8 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:18.959914 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-23f61935-787e-4923-b59e-da522bdef299 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 200 len: 1619 microversion: 2.1 time: 0.560608 Aug 22 17:15:18.965479 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 448/918] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:18 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 1619 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:18.987518 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6fd0c7c3-b398-4fc2-89cc-21c6c55920f8 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:19.002009 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6fd0c7c3-b398-4fc2-89cc-21c6c55920f8 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1317 microversion: 2.1 time: 0.273707 Aug 22 17:15:19.003273 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 471/919] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:18 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:15:19.003779 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ed407868-01a8-4ff1-a28d-0429b0925985 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Action: 'create', calling method: .version_select at 0x7f8009cba790>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1085759581", "policies": ["anti-affinity"]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:19.036298 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-ed407868-01a8-4ff1-a28d-0429b0925985 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:19.050714 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-ed407868-01a8-4ff1-a28d-0429b0925985 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for user 43188026fda44118ad642b7065108966 and project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:19.240085 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-eb94ee75-5fb7-4055-af54-99ca4c3e9eb4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:19.247989 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-eb94ee75-5fb7-4055-af54-99ca4c3e9eb4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:19.260942 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eb94ee75-5fb7-4055-af54-99ca4c3e9eb4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:19.263732 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eb94ee75-5fb7-4055-af54-99ca4c3e9eb4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:19.264757 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eb94ee75-5fb7-4055-af54-99ca4c3e9eb4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:19.265683 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eb94ee75-5fb7-4055-af54-99ca4c3e9eb4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:19.266786 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eb94ee75-5fb7-4055-af54-99ca4c3e9eb4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:19.267408 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eb94ee75-5fb7-4055-af54-99ca4c3e9eb4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:19.282078 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-ed407868-01a8-4ff1-a28d-0429b0925985 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:19.305116 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-ed407868-01a8-4ff1-a28d-0429b0925985 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for user 43188026fda44118ad642b7065108966 and project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:19.348760 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ed407868-01a8-4ff1-a28d-0429b0925985 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.349509 Aug 22 17:15:19.370021 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 449/920] 10.222.0.96 () {60 vars in 1174 bytes} [Mon Aug 22 17:15:18 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:15:19.770934 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-eb94ee75-5fb7-4055-af54-99ca4c3e9eb4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:19.783682 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-eb94ee75-5fb7-4055-af54-99ca4c3e9eb4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1312 microversion: 2.1 time: 0.557043 Aug 22 17:15:19.785807 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 472/921] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:19 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1312 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:19.812481 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-491631526", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "22e6357f-c720-4967-967a-94f0a2aafff8"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:19.915688 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] validate_networks() for None {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:15:19.967671 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-dc5e7398-4d7e-4dee-bc0b-289d5169f275 tempest-AbsoluteLimitsTestJSON-519406061 tempest-AbsoluteLimitsTestJSON-519406061-project] Calling method '.version_select at 0x7f8009aa88b0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:20.009894 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dc5e7398-4d7e-4dee-bc0b-289d5169f275 tempest-AbsoluteLimitsTestJSON-519406061 tempest-AbsoluteLimitsTestJSON-519406061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:20.018142 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dc5e7398-4d7e-4dee-bc0b-289d5169f275 tempest-AbsoluteLimitsTestJSON-519406061 tempest-AbsoluteLimitsTestJSON-519406061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:20.018142 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dc5e7398-4d7e-4dee-bc0b-289d5169f275 tempest-AbsoluteLimitsTestJSON-519406061 tempest-AbsoluteLimitsTestJSON-519406061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:20.018142 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dc5e7398-4d7e-4dee-bc0b-289d5169f275 tempest-AbsoluteLimitsTestJSON-519406061 tempest-AbsoluteLimitsTestJSON-519406061-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:20.018587 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dc5e7398-4d7e-4dee-bc0b-289d5169f275 tempest-AbsoluteLimitsTestJSON-519406061 tempest-AbsoluteLimitsTestJSON-519406061-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:20.019661 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dc5e7398-4d7e-4dee-bc0b-289d5169f275 tempest-AbsoluteLimitsTestJSON-519406061 tempest-AbsoluteLimitsTestJSON-519406061-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:20.090219 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-dc5e7398-4d7e-4dee-bc0b-289d5169f275 tempest-AbsoluteLimitsTestJSON-519406061 tempest-AbsoluteLimitsTestJSON-519406061-project] 10.222.0.96 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.452853 Aug 22 17:15:20.103359 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 450/922] 10.222.0.96 () {58 vars in 1122 bytes} [Mon Aug 22 17:15:19 2022] GET /compute/v2.1/limits => generated 511 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:15:20.116765 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-1e43ef35-cc21-4500-bedd-eab4b20d1de5 req-e2e562c2-08a8-4867-a2ac-c88f842922e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d1e79a-48e9-436e-a233-7a950de59886", "name": "network-vif-plugged", "status": "completed", "tag": "6f8bb3a8-685e-4d62-8584-0402c1743657"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:20.148785 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-1e43ef35-cc21-4500-bedd-eab4b20d1de5 req-e2e562c2-08a8-4867-a2ac-c88f842922e1 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:20.149597 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-1e43ef35-cc21-4500-bedd-eab4b20d1de5 req-e2e562c2-08a8-4867-a2ac-c88f842922e1 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:20.150042 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-1e43ef35-cc21-4500-bedd-eab4b20d1de5 req-e2e562c2-08a8-4867-a2ac-c88f842922e1 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:20.173161 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-1e43ef35-cc21-4500-bedd-eab4b20d1de5 req-e2e562c2-08a8-4867-a2ac-c88f842922e1 service nova] Creating event network-vif-plugged:6f8bb3a8-685e-4d62-8584-0402c1743657 for instance b9d1e79a-48e9-436e-a233-7a950de59886 on n-h2-854030-1 Aug 22 17:15:20.185008 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-1e43ef35-cc21-4500-bedd-eab4b20d1de5 req-e2e562c2-08a8-4867-a2ac-c88f842922e1 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078228 Aug 22 17:15:20.186308 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 451/923] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:20.207998 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8dadc28a-0d36-420d-aaf1-358021a18cd5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:20.209049 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-8dadc28a-0d36-420d-aaf1-358021a18cd5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:20.225835 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8dadc28a-0d36-420d-aaf1-358021a18cd5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:20.227209 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8dadc28a-0d36-420d-aaf1-358021a18cd5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:20.227890 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8dadc28a-0d36-420d-aaf1-358021a18cd5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:20.230186 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8dadc28a-0d36-420d-aaf1-358021a18cd5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:20.231047 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8dadc28a-0d36-420d-aaf1-358021a18cd5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:20.231701 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8dadc28a-0d36-420d-aaf1-358021a18cd5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:20.796713 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:15:20.797980 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:15:20.798726 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:15:20.799111 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-8dadc28a-0d36-420d-aaf1-358021a18cd5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:20.800313 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:15:20.800955 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:15:20.813172 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8dadc28a-0d36-420d-aaf1-358021a18cd5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1317 microversion: 2.1 time: 0.623622 Aug 22 17:15:20.815193 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 452/924] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:20 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1317 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:20.829387 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-759346b1-025f-4b76-8a00-9e5b60d758af tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:20.829387 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-759346b1-025f-4b76-8a00-9e5b60d758af tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:20.846024 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-759346b1-025f-4b76-8a00-9e5b60d758af tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:20.847983 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-759346b1-025f-4b76-8a00-9e5b60d758af tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:20.849257 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-759346b1-025f-4b76-8a00-9e5b60d758af tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:20.851059 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-759346b1-025f-4b76-8a00-9e5b60d758af tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:20.853444 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-759346b1-025f-4b76-8a00-9e5b60d758af tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:20.854201 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-759346b1-025f-4b76-8a00-9e5b60d758af tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:20.882076 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:20.883593 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:20.885866 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:20.887350 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:20.891019 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:20.892357 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:20.952929 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for project d789047469894e1fbe5af3a109a95b4c. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:20.967307 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for user 43188026fda44118ad642b7065108966 and project d789047469894e1fbe5af3a109a95b4c. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:20.999487 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Going to run 2 instances... {{(pid=123015) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:15:21.008204 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: fdf44444-5aec-46a8-a23a-d9d6621684a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:15:21.169563 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=123015) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 22 17:15:21.222827 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_group_members'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:21.238957 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for user 43188026fda44118ad642b7065108966 and project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_group_members'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:21.500824 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_group_members'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:21.508730 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for user 43188026fda44118ad642b7065108966 and project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_group_members'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:21.532610 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-759346b1-025f-4b76-8a00-9e5b60d758af tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:21.544405 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-759346b1-025f-4b76-8a00-9e5b60d758af tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1312 microversion: 2.1 time: 0.728081 Aug 22 17:15:21.545501 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 453/925] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:20 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1312 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:21.558234 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=fdf44444-5aec-46a8-a23a-d9d6621684a6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:15:21.588178 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=5 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:21.782598 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_group_members'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:21.803292 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for user 43188026fda44118ad642b7065108966 and project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_group_members'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:21.837723 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5254afdd-0431-42e3-9fab-cb8b028ec335 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:21.838259 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5254afdd-0431-42e3-9fab-cb8b028ec335 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:21.857784 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5254afdd-0431-42e3-9fab-cb8b028ec335 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:21.858473 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5254afdd-0431-42e3-9fab-cb8b028ec335 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:21.858967 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5254afdd-0431-42e3-9fab-cb8b028ec335 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:21.859733 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5254afdd-0431-42e3-9fab-cb8b028ec335 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:21.860197 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5254afdd-0431-42e3-9fab-cb8b028ec335 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:21.860716 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5254afdd-0431-42e3-9fab-cb8b028ec335 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:21.990330 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_group_members'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:22.003427 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for user 43188026fda44118ad642b7065108966 and project d789047469894e1fbe5af3a109a95b4c. Resources: {'server_group_members'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:22.098631 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-abc58af7-121c-4a00-8352-98a4dbdcaee3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.294422 Aug 22 17:15:22.102274 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 473/926] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:15:19 2022] POST /compute/v2.1/servers => generated 32 bytes in 2300 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 22 17:15:22.114404 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b657740a-1f54-449c-a8b8-046191d2ff98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:22.131407 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b657740a-1f54-449c-a8b8-046191d2ff98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:22.133584 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b657740a-1f54-449c-a8b8-046191d2ff98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Searching by: {'deleted': False, 'project_id': 'd789047469894e1fbe5af3a109a95b4c'} {{(pid=123015) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 22 17:15:22.156639 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b657740a-1f54-449c-a8b8-046191d2ff98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:22.164093 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b657740a-1f54-449c-a8b8-046191d2ff98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:22.164093 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b657740a-1f54-449c-a8b8-046191d2ff98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:22.164093 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b657740a-1f54-449c-a8b8-046191d2ff98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:22.164093 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b657740a-1f54-449c-a8b8-046191d2ff98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:22.164736 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b657740a-1f54-449c-a8b8-046191d2ff98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:22.306334 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.multi_cell_list [None req-b657740a-1f54-449c-a8b8-046191d2ff98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=123015) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 22 17:15:22.404463 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-5254afdd-0431-42e3-9fab-cb8b028ec335 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:22.460934 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b657740a-1f54-449c-a8b8-046191d2ff98 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.348260 Aug 22 17:15:22.461332 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5254afdd-0431-42e3-9fab-cb8b028ec335 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1317 microversion: 2.1 time: 0.626351 Aug 22 17:15:22.469267 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 474/927] 10.222.0.96 () {58 vars in 1125 bytes} [Mon Aug 22 17:15:22 2022] GET /compute/v2.1/servers => generated 1662 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:22.478027 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 454/928] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:21 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1317 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:15:22.496271 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-ed9ccb52-6f9f-48ac-bc3e-b69ef53f3eff req-59dae115-3cca-4e8b-a5c2-0f0f6ad63499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9699e0-8054-4491-91a6-2d8e34898838", "name": "network-vif-plugged", "status": "completed", "tag": "0bc75a5b-a857-42d1-be9e-f441f5aad90b"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:22.504626 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2b305d89-a55d-4697-a507-b0a320d6ec3e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:22.514522 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-2b305d89-a55d-4697-a507-b0a320d6ec3e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:22.547743 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-ed9ccb52-6f9f-48ac-bc3e-b69ef53f3eff req-59dae115-3cca-4e8b-a5c2-0f0f6ad63499 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:22.551052 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-ed9ccb52-6f9f-48ac-bc3e-b69ef53f3eff req-59dae115-3cca-4e8b-a5c2-0f0f6ad63499 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:22.552987 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-ed9ccb52-6f9f-48ac-bc3e-b69ef53f3eff req-59dae115-3cca-4e8b-a5c2-0f0f6ad63499 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:22.597039 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-ed9ccb52-6f9f-48ac-bc3e-b69ef53f3eff req-59dae115-3cca-4e8b-a5c2-0f0f6ad63499 service nova] Creating event network-vif-plugged:0bc75a5b-a857-42d1-be9e-f441f5aad90b for instance 8a9699e0-8054-4491-91a6-2d8e34898838 on n-h2-854030-1 Aug 22 17:15:22.608178 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-ed9ccb52-6f9f-48ac-bc3e-b69ef53f3eff req-59dae115-3cca-4e8b-a5c2-0f0f6ad63499 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134592 Aug 22 17:15:22.612258 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 475/929] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:22.623468 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5d58b73d-12da-4c1c-9241-f41f77719f4d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:22.624247 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-5d58b73d-12da-4c1c-9241-f41f77719f4d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:22.652160 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5d58b73d-12da-4c1c-9241-f41f77719f4d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:22.652656 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5d58b73d-12da-4c1c-9241-f41f77719f4d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:22.653166 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5d58b73d-12da-4c1c-9241-f41f77719f4d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:22.656483 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5d58b73d-12da-4c1c-9241-f41f77719f4d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:22.656972 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5d58b73d-12da-4c1c-9241-f41f77719f4d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:22.657532 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5d58b73d-12da-4c1c-9241-f41f77719f4d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:23.012034 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-5d58b73d-12da-4c1c-9241-f41f77719f4d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:23.020581 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5d58b73d-12da-4c1c-9241-f41f77719f4d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1312 microversion: 2.1 time: 0.407030 Aug 22 17:15:23.037632 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 476/930] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:22 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1312 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:23.233599 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-2b305d89-a55d-4697-a507-b0a320d6ec3e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:23.243755 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2b305d89-a55d-4697-a507-b0a320d6ec3e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 200 len: 1218 microversion: 2.1 time: 0.762360 Aug 22 17:15:23.246024 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 455/931] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:22 2022] GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 1218 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:23.501121 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7fb3dbfe-2903-466a-b7d4-3b4340b7ac82 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:23.501778 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-7fb3dbfe-2903-466a-b7d4-3b4340b7ac82 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:23.511103 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7fb3dbfe-2903-466a-b7d4-3b4340b7ac82 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:23.511594 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7fb3dbfe-2903-466a-b7d4-3b4340b7ac82 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:23.512034 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7fb3dbfe-2903-466a-b7d4-3b4340b7ac82 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:23.512751 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7fb3dbfe-2903-466a-b7d4-3b4340b7ac82 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:23.514326 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7fb3dbfe-2903-466a-b7d4-3b4340b7ac82 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:23.530378 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7fb3dbfe-2903-466a-b7d4-3b4340b7ac82 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:23.903665 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-7fb3dbfe-2903-466a-b7d4-3b4340b7ac82 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:23.916886 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7fb3dbfe-2903-466a-b7d4-3b4340b7ac82 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1317 microversion: 2.1 time: 0.415621 Aug 22 17:15:23.916886 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 477/932] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:23 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:24.046458 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c0b943ee-4bc6-4c2d-bac6-7eff56af5500 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:24.047150 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c0b943ee-4bc6-4c2d-bac6-7eff56af5500 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:24.060190 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c0b943ee-4bc6-4c2d-bac6-7eff56af5500 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:24.060899 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c0b943ee-4bc6-4c2d-bac6-7eff56af5500 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:24.063592 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c0b943ee-4bc6-4c2d-bac6-7eff56af5500 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:24.064781 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c0b943ee-4bc6-4c2d-bac6-7eff56af5500 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:24.068230 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c0b943ee-4bc6-4c2d-bac6-7eff56af5500 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:24.071012 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c0b943ee-4bc6-4c2d-bac6-7eff56af5500 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:24.269444 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-616fdec4-6de3-41dd-8dc2-8da453e45fc1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:24.270684 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-616fdec4-6de3-41dd-8dc2-8da453e45fc1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:24.536948 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-616fdec4-6de3-41dd-8dc2-8da453e45fc1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:24.567421 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-616fdec4-6de3-41dd-8dc2-8da453e45fc1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 200 len: 1218 microversion: 2.1 time: 0.302744 Aug 22 17:15:24.569336 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 478/933] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:24 2022] GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 1218 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:24.807863 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c0b943ee-4bc6-4c2d-bac6-7eff56af5500 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:24.817204 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c0b943ee-4bc6-4c2d-bac6-7eff56af5500 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1312 microversion: 2.1 time: 0.776116 Aug 22 17:15:24.821485 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 456/934] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:24 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1312 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:24.902434 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-6b21ab7c-d52a-4de3-b2b1-438c06f6ae33 req-50fc5c7b-cd5b-4639-b4fd-270dcac70bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8507ebf3-26fb-454f-bffb-e3aae22e3e37", "name": "network-vif-plugged", "status": "completed", "tag": "06644b82-5010-4ba1-879b-3c2e1d9e2444"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:24.921250 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-6b21ab7c-d52a-4de3-b2b1-438c06f6ae33 req-50fc5c7b-cd5b-4639-b4fd-270dcac70bf8 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:24.922170 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-6b21ab7c-d52a-4de3-b2b1-438c06f6ae33 req-50fc5c7b-cd5b-4639-b4fd-270dcac70bf8 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:24.923157 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-6b21ab7c-d52a-4de3-b2b1-438c06f6ae33 req-50fc5c7b-cd5b-4639-b4fd-270dcac70bf8 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:24.940103 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-25e04b94-8e72-4255-90f0-5256f4777501 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:24.940744 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-25e04b94-8e72-4255-90f0-5256f4777501 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:24.951399 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-25e04b94-8e72-4255-90f0-5256f4777501 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:24.951834 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-25e04b94-8e72-4255-90f0-5256f4777501 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:24.953541 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-25e04b94-8e72-4255-90f0-5256f4777501 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:24.955709 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-25e04b94-8e72-4255-90f0-5256f4777501 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:24.956782 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-25e04b94-8e72-4255-90f0-5256f4777501 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:24.958137 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-25e04b94-8e72-4255-90f0-5256f4777501 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:24.968474 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-6b21ab7c-d52a-4de3-b2b1-438c06f6ae33 req-50fc5c7b-cd5b-4639-b4fd-270dcac70bf8 service nova] Creating event network-vif-plugged:06644b82-5010-4ba1-879b-3c2e1d9e2444 for instance 8507ebf3-26fb-454f-bffb-e3aae22e3e37 on n-h1-854030-1 Aug 22 17:15:24.995138 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-6b21ab7c-d52a-4de3-b2b1-438c06f6ae33 req-50fc5c7b-cd5b-4639-b4fd-270dcac70bf8 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096171 Aug 22 17:15:25.004760 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 479/935] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:25.487216 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-25e04b94-8e72-4255-90f0-5256f4777501 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:25.499042 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-25e04b94-8e72-4255-90f0-5256f4777501 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1466 microversion: 2.1 time: 0.564789 Aug 22 17:15:25.505849 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 457/936] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:24 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1466 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:15:25.539537 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c90a09fc-145b-4168-b823-994b58402a4a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:25.545756 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-c90a09fc-145b-4168-b823-994b58402a4a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: b9d1e79a-48e9-436e-a233-7a950de59886] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:25.559417 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c90a09fc-145b-4168-b823-994b58402a4a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:25.560390 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c90a09fc-145b-4168-b823-994b58402a4a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:25.561638 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c90a09fc-145b-4168-b823-994b58402a4a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:25.564413 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c90a09fc-145b-4168-b823-994b58402a4a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:25.566820 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c90a09fc-145b-4168-b823-994b58402a4a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:25.567513 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c90a09fc-145b-4168-b823-994b58402a4a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:25.588599 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1e30dad0-71a8-478c-ae3d-c0356a98ef18 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:25.590681 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-1e30dad0-71a8-478c-ae3d-c0356a98ef18 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:25.601041 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1e30dad0-71a8-478c-ae3d-c0356a98ef18 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:25.602611 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1e30dad0-71a8-478c-ae3d-c0356a98ef18 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:25.605238 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1e30dad0-71a8-478c-ae3d-c0356a98ef18 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:25.606878 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1e30dad0-71a8-478c-ae3d-c0356a98ef18 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:25.609130 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1e30dad0-71a8-478c-ae3d-c0356a98ef18 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:25.609753 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1e30dad0-71a8-478c-ae3d-c0356a98ef18 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:25.968650 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-1e30dad0-71a8-478c-ae3d-c0356a98ef18 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:25.993377 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1e30dad0-71a8-478c-ae3d-c0356a98ef18 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 200 len: 1222 microversion: 2.1 time: 0.405341 Aug 22 17:15:25.995459 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 458/937] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:25 2022] GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 1222 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:26.004435 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ad796b3f-4ea1-4560-a83a-f03a9a12c041 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:26.009754 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-ad796b3f-4ea1-4560-a83a-f03a9a12c041 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:26.026072 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ad796b3f-4ea1-4560-a83a-f03a9a12c041 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:26.027051 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ad796b3f-4ea1-4560-a83a-f03a9a12c041 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:26.027663 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ad796b3f-4ea1-4560-a83a-f03a9a12c041 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:26.028629 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ad796b3f-4ea1-4560-a83a-f03a9a12c041 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:26.029891 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ad796b3f-4ea1-4560-a83a-f03a9a12c041 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:26.032485 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ad796b3f-4ea1-4560-a83a-f03a9a12c041 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:26.118724 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c90a09fc-145b-4168-b823-994b58402a4a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:26.136449 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c90a09fc-145b-4168-b823-994b58402a4a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886" status: 200 len: 1467 microversion: 2.1 time: 0.602375 Aug 22 17:15:26.137060 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 480/938] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:25 2022] GET /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886 => generated 1467 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:26.159909 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c9596ac0-a5f5-4030-8d43-9f73313094d9 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1616711552"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:26.162740 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-c9596ac0-a5f5-4030-8d43-9f73313094d9 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: b9d1e79a-48e9-436e-a233-7a950de59886] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:26.175073 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c9596ac0-a5f5-4030-8d43-9f73313094d9 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:26.178751 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c9596ac0-a5f5-4030-8d43-9f73313094d9 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:26.179437 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c9596ac0-a5f5-4030-8d43-9f73313094d9 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:26.180717 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c9596ac0-a5f5-4030-8d43-9f73313094d9 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:26.184673 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c9596ac0-a5f5-4030-8d43-9f73313094d9 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:26.185373 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c9596ac0-a5f5-4030-8d43-9f73313094d9 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:26.643108 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ad796b3f-4ea1-4560-a83a-f03a9a12c041 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:26.654493 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ad796b3f-4ea1-4560-a83a-f03a9a12c041 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1312 microversion: 2.1 time: 0.654521 Aug 22 17:15:26.662749 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 459/939] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:25 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1312 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:27.070655 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e5cbe0fb-5c44-4e77-84ba-40565f8241a0 tempest-AbsoluteLimitsNegativeTestJSON-1960672977 tempest-AbsoluteLimitsNegativeTestJSON-1960672977-project] Calling method '.version_select at 0x7f8009b118b0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:27.095989 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c9596ac0-a5f5-4030-8d43-9f73313094d9 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "POST /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886/action" status: 202 len: 0 microversion: 2.1 time: 0.940436 Aug 22 17:15:27.106893 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 481/940] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:15:26 2022] POST /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886/action => generated 0 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 22 17:15:27.123152 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5cbe0fb-5c44-4e77-84ba-40565f8241a0 tempest-AbsoluteLimitsNegativeTestJSON-1960672977 tempest-AbsoluteLimitsNegativeTestJSON-1960672977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:27.123649 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5cbe0fb-5c44-4e77-84ba-40565f8241a0 tempest-AbsoluteLimitsNegativeTestJSON-1960672977 tempest-AbsoluteLimitsNegativeTestJSON-1960672977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:27.132030 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5cbe0fb-5c44-4e77-84ba-40565f8241a0 tempest-AbsoluteLimitsNegativeTestJSON-1960672977 tempest-AbsoluteLimitsNegativeTestJSON-1960672977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:27.132914 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7d61b450-91b7-4791-b8fe-e2182ad3b7e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:27.133474 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5cbe0fb-5c44-4e77-84ba-40565f8241a0 tempest-AbsoluteLimitsNegativeTestJSON-1960672977 tempest-AbsoluteLimitsNegativeTestJSON-1960672977-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:27.135281 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-7d61b450-91b7-4791-b8fe-e2182ad3b7e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:27.144013 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5cbe0fb-5c44-4e77-84ba-40565f8241a0 tempest-AbsoluteLimitsNegativeTestJSON-1960672977 tempest-AbsoluteLimitsNegativeTestJSON-1960672977-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:27.149023 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5cbe0fb-5c44-4e77-84ba-40565f8241a0 tempest-AbsoluteLimitsNegativeTestJSON-1960672977 tempest-AbsoluteLimitsNegativeTestJSON-1960672977-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:27.151645 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7d61b450-91b7-4791-b8fe-e2182ad3b7e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:27.156602 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7d61b450-91b7-4791-b8fe-e2182ad3b7e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:27.157115 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7d61b450-91b7-4791-b8fe-e2182ad3b7e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:27.157872 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7d61b450-91b7-4791-b8fe-e2182ad3b7e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:27.158347 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7d61b450-91b7-4791-b8fe-e2182ad3b7e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:27.158776 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7d61b450-91b7-4791-b8fe-e2182ad3b7e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:27.274549 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e5cbe0fb-5c44-4e77-84ba-40565f8241a0 tempest-AbsoluteLimitsNegativeTestJSON-1960672977 tempest-AbsoluteLimitsNegativeTestJSON-1960672977-project] 10.222.0.96 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.610195 Aug 22 17:15:27.292814 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 460/941] 10.222.0.96 () {58 vars in 1122 bytes} [Mon Aug 22 17:15:26 2022] GET /compute/v2.1/limits => generated 511 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:27.307585 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d6457f48-91a7-4780-83ba-f934051d30bb tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009eb83a0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:27.427162 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d6457f48-91a7-4780-83ba-f934051d30bb tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a" status: 200 len: 1455 microversion: 2.1 time: 0.127967 Aug 22 17:15:27.428533 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 461/942] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:15:27 2022] GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:27.435036 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-341dfb54-2030-4a29-9911-b0d643af0f14 tempest-AbsoluteLimitsNegativeTestJSON-1960672977 tempest-AbsoluteLimitsNegativeTestJSON-1960672977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1428236879", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:27.459324 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:27.489717 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-7d61b450-91b7-4791-b8fe-e2182ad3b7e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:27.504311 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7d61b450-91b7-4791-b8fe-e2182ad3b7e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 200 len: 1270 microversion: 2.1 time: 0.393395 Aug 22 17:15:27.518497 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 482/943] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:27 2022] GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 1270 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:27.576313 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-341dfb54-2030-4a29-9911-b0d643af0f14 tempest-AbsoluteLimitsNegativeTestJSON-1960672977 tempest-AbsoluteLimitsNegativeTestJSON-1960672977-project] validate_networks() for None {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:15:27.677197 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d16ce033-a7bc-40fd-bf3f-d1b2fb948677 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:27.677933 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d16ce033-a7bc-40fd-bf3f-d1b2fb948677 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:27.696167 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d16ce033-a7bc-40fd-bf3f-d1b2fb948677 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:27.705005 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d16ce033-a7bc-40fd-bf3f-d1b2fb948677 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:27.705922 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d16ce033-a7bc-40fd-bf3f-d1b2fb948677 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:27.706835 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d16ce033-a7bc-40fd-bf3f-d1b2fb948677 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:27.707724 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d16ce033-a7bc-40fd-bf3f-d1b2fb948677 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:27.708334 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d16ce033-a7bc-40fd-bf3f-d1b2fb948677 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:28.310220 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-341dfb54-2030-4a29-9911-b0d643af0f14 tempest-AbsoluteLimitsNegativeTestJSON-1960672977 tempest-AbsoluteLimitsNegativeTestJSON-1960672977-project] Getting quotas for project 48c5d2736c89420f8f95d43edc8a9979. Resources: dict_keys(['metadata_items']) {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:28.319679 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-341dfb54-2030-4a29-9911-b0d643af0f14 tempest-AbsoluteLimitsNegativeTestJSON-1960672977 tempest-AbsoluteLimitsNegativeTestJSON-1960672977-project] Getting quotas for user 8cf7a5f7bda746abae84749aab63bc46 and project 48c5d2736c89420f8f95d43edc8a9979. Resources: dict_keys(['metadata_items']) {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:28.347733 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-341dfb54-2030-4a29-9911-b0d643af0f14 tempest-AbsoluteLimitsNegativeTestJSON-1960672977 tempest-AbsoluteLimitsNegativeTestJSON-1960672977-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-341dfb54-2030-4a29-9911-b0d643af0f14 tempest-AbsoluteLimitsNegativeTestJSON-1960672977 tempest-AbsoluteLimitsNegativeTestJSON-1960672977-project] Request method failure captured: Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 1752 Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7muh1VKd0E56Htx0gD8zkCmG0bdqgwcfhib0oyTbsN4gJB_24Cl-KkSm98arNIwVOeT9g7HT31mnWuFyhf-D1Zb4KHiyOBd-_4gvU1H-JLsf7XW58JJp8xZ7KX1CNN_Mya4Tp_rTzEaH6Qb3SpmVwxJUYhZRWJVJcjnzz12MwhwM3s Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 48c5d2736c89420f8f95d43edc8a9979 Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1960672977 Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/48c5d2736c89420f8f95d43edc8a9979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_48c5d2736c89420f8f95d43edc8a9979", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/48c5d2736c89420f8f95d43edc8a9979"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/48c5d2736c89420f8f95d43edc8a9979"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1960672977 Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 48c5d2736c89420f8f95d43edc8a9979 Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1960672977 Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1960672977-project Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 8cf7a5f7bda746abae84749aab63bc46 Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1960672977-project Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1428236879", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:15:28.350067 n-d-854030-1 devstack@n-api.service[123016]: exception: Maximum number of metadata items exceeds 128 Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1428236879', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 463, in _check_metadata_properties_quota Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1711, in _create_instance Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1003, in _checks_for_create_and_rebuild Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 470, in _check_metadata_properties_quota Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:28.356103 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:28.360063 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:28.360063 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:15:28.360063 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 22 17:15:28.360063 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 22 17:15:28.360063 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 22 17:15:28.360063 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:28.360063 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:28.360063 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:28.360063 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:28.360063 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:28.360063 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:28.360063 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:15:28.360063 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:15:28.360063 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 22 17:15:28.360063 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:28.360063 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-341dfb54-2030-4a29-9911-b0d643af0f14 tempest-AbsoluteLimitsNegativeTestJSON-1960672977 tempest-AbsoluteLimitsNegativeTestJSON-1960672977-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:15:28.360063 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-341dfb54-2030-4a29-9911-b0d643af0f14 tempest-AbsoluteLimitsNegativeTestJSON-1960672977 tempest-AbsoluteLimitsNegativeTestJSON-1960672977-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.922526 Aug 22 17:15:28.360063 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 462/944] 10.222.0.96 () {60 vars in 1148 bytes} [Mon Aug 22 17:15:27 2022] POST /compute/v2.1/servers => generated 87 bytes in 924 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:15:28.443874 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-06f2cb69-8df5-4661-bd6d-3736cee8c3a7 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009eb0dc0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:28.519382 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d16ce033-a7bc-40fd-bf3f-d1b2fb948677 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:28.546804 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-06f2cb69-8df5-4661-bd6d-3736cee8c3a7 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a" status: 200 len: 1455 microversion: 2.1 time: 0.101215 Aug 22 17:15:28.546804 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 463/945] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:15:28 2022] GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:28.547250 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d16ce033-a7bc-40fd-bf3f-d1b2fb948677 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1461 microversion: 2.1 time: 0.854893 Aug 22 17:15:28.549816 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 483/946] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:27 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1461 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:28.563088 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fe191545-04b6-4e9e-bbd7-ac8d5ddd7838 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:28.564053 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-fe191545-04b6-4e9e-bbd7-ac8d5ddd7838 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:28.575259 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1df199f2-c92c-4d2c-bf2e-7e12cc1e91e4 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:28.575962 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-1df199f2-c92c-4d2c-bf2e-7e12cc1e91e4 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:28.586961 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fe191545-04b6-4e9e-bbd7-ac8d5ddd7838 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:28.594027 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fe191545-04b6-4e9e-bbd7-ac8d5ddd7838 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:28.594803 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1df199f2-c92c-4d2c-bf2e-7e12cc1e91e4 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:28.596832 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fe191545-04b6-4e9e-bbd7-ac8d5ddd7838 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:28.597802 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1df199f2-c92c-4d2c-bf2e-7e12cc1e91e4 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:28.602558 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1df199f2-c92c-4d2c-bf2e-7e12cc1e91e4 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:28.603958 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fe191545-04b6-4e9e-bbd7-ac8d5ddd7838 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:28.604936 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1df199f2-c92c-4d2c-bf2e-7e12cc1e91e4 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:28.605698 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fe191545-04b6-4e9e-bbd7-ac8d5ddd7838 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:28.606338 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fe191545-04b6-4e9e-bbd7-ac8d5ddd7838 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:28.607050 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1df199f2-c92c-4d2c-bf2e-7e12cc1e91e4 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:28.612354 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1df199f2-c92c-4d2c-bf2e-7e12cc1e91e4 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:28.906288 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-fe191545-04b6-4e9e-bbd7-ac8d5ddd7838 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:28.931434 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-fe191545-04b6-4e9e-bbd7-ac8d5ddd7838 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 200 len: 1276 microversion: 2.1 time: 0.374951 Aug 22 17:15:28.932996 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 464/947] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:28 2022] GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 1276 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:29.060135 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1df199f2-c92c-4d2c-bf2e-7e12cc1e91e4 tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1612 microversion: 2.1 time: 0.486562 Aug 22 17:15:29.065671 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 484/948] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:28 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1612 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:15:29.084225 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0628e378-7e25-4006-9f41-1f526cb6801f tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:29.084815 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-0628e378-7e25-4006-9f41-1f526cb6801f tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:29.091469 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0628e378-7e25-4006-9f41-1f526cb6801f tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:29.093065 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0628e378-7e25-4006-9f41-1f526cb6801f tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:29.093545 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0628e378-7e25-4006-9f41-1f526cb6801f tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:29.094280 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0628e378-7e25-4006-9f41-1f526cb6801f tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:29.094750 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0628e378-7e25-4006-9f41-1f526cb6801f tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:29.095182 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0628e378-7e25-4006-9f41-1f526cb6801f tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:29.152386 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=100 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-0628e378-7e25-4006-9f41-1f526cb6801f tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4ff7c950-31af-4ded-bd21-bb9dc9a55535) Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:15:29.236719 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4ff7c950-31af-4ded-bd21-bb9dc9a55535) Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-0628e378-7e25-4006-9f41-1f526cb6801f tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0628e378-7e25-4006-9f41-1f526cb6801f tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Request method failure captured: Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37/action HTTP/1.1 Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 15 Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7k-eHTtoh8JT4OY7na4sDNAiFpsEfe3go2M3ox3vL3Yg5jQTcSDGN-bzPc4Jufq2zgz9ZPHyYEAVU5s1JQKere2Lktt-O13MKVepTActz5JqD52chtrFMEg_x4sXfzRrT7GJ8gfG8GlcMClKndtLRBnqjMEy6nL-RMY5jQDVKfFX1s Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 21ea51a81af14b2592a2e0f46be6b778 Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-MigrationsAdminTest-1307498773 Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/21ea51a81af14b2592a2e0f46be6b778"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_21ea51a81af14b2592a2e0f46be6b778", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/21ea51a81af14b2592a2e0f46be6b778"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/21ea51a81af14b2592a2e0f46be6b778"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-MigrationsAdminTest-1307498773 Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 21ea51a81af14b2592a2e0f46be6b778 Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-MigrationsAdminTest-1307498773 Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-MigrationsAdminTest-1307498773-project-admin Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: f0b166e7b8d74473a3a4db88436f284f Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-MigrationsAdminTest-1307498773-project-admin Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: {"migrate": {}} Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '8507ebf3-26fb-454f-bffb-e3aae22e3e37', 'body': {'migrate': {}}} Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 22 17:15:29.240695 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4ff7c950-31af-4ded-bd21-bb9dc9a55535) Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:29.246369 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0628e378-7e25-4006-9f41-1f526cb6801f tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:15:29.250960 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0628e378-7e25-4006-9f41-1f526cb6801f tempest-MigrationsAdminTest-1307498773 tempest-MigrationsAdminTest-1307498773-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37/action" status: 500 len: 214 microversion: 2.1 time: 0.162271 Aug 22 17:15:29.257156 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b6bfa47f-516b-4895-9049-2e6b37f96ffb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:29.258484 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b6bfa47f-516b-4895-9049-2e6b37f96ffb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:29.263057 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 465/949] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:15:29 2022] POST /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37/action => generated 214 bytes in 184 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:15:29.271135 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6bfa47f-516b-4895-9049-2e6b37f96ffb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:29.271630 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6bfa47f-516b-4895-9049-2e6b37f96ffb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:29.278580 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6bfa47f-516b-4895-9049-2e6b37f96ffb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:29.279374 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6bfa47f-516b-4895-9049-2e6b37f96ffb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:29.282820 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6bfa47f-516b-4895-9049-2e6b37f96ffb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:29.284374 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6bfa47f-516b-4895-9049-2e6b37f96ffb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:29.349339 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b6bfa47f-516b-4895-9049-2e6b37f96ffb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Going to try to terminate instance {{(pid=123015) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:15:29.558993 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c5f5539e-43de-4a7c-b5ab-a8858d7f8fdd tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009eb8e50>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:29.648550 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c5f5539e-43de-4a7c-b5ab-a8858d7f8fdd tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a" status: 200 len: 1455 microversion: 2.1 time: 0.093818 Aug 22 17:15:29.656758 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 466/950] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:15:29 2022] GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:15:29.959404 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b6bfa47f-516b-4895-9049-2e6b37f96ffb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "DELETE /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 204 len: 0 microversion: 2.1 time: 0.706318 Aug 22 17:15:29.963191 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 485/951] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:15:29 2022] DELETE /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:15:29.968553 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9d88ff44-06e3-4fd8-b1e4-dfcf4057df9b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:29.969281 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9d88ff44-06e3-4fd8-b1e4-dfcf4057df9b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:29.978440 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9d88ff44-06e3-4fd8-b1e4-dfcf4057df9b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:29.978924 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9d88ff44-06e3-4fd8-b1e4-dfcf4057df9b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:29.979355 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9d88ff44-06e3-4fd8-b1e4-dfcf4057df9b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:29.980060 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9d88ff44-06e3-4fd8-b1e4-dfcf4057df9b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:29.988946 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9d88ff44-06e3-4fd8-b1e4-dfcf4057df9b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:29.989430 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9d88ff44-06e3-4fd8-b1e4-dfcf4057df9b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:30.212449 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-50623927-e2c8-462a-94f5-5746f3301b5c tempest-FloatingIPsAssociationTestJSON-1278253592 tempest-FloatingIPsAssociationTestJSON-1278253592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1874568928", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "58812a9c-ee59-4e4b-b4c8-8769c115003d"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:30.305487 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-50623927-e2c8-462a-94f5-5746f3301b5c tempest-FloatingIPsAssociationTestJSON-1278253592 tempest-FloatingIPsAssociationTestJSON-1278253592-project] validate_networks() for [('58812a9c-ee59-4e4b-b4c8-8769c115003d', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:15:30.337449 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9d88ff44-06e3-4fd8-b1e4-dfcf4057df9b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:30.372287 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9d88ff44-06e3-4fd8-b1e4-dfcf4057df9b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 200 len: 1276 microversion: 2.1 time: 0.407746 Aug 22 17:15:30.376621 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 486/952] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:29 2022] GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 1276 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:30.418674 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-51334fae-1099-4ff2-80cc-8c1a5e3e8f17 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:30.419499 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-51334fae-1099-4ff2-80cc-8c1a5e3e8f17 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:30.426035 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-51334fae-1099-4ff2-80cc-8c1a5e3e8f17 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:30.427646 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-51334fae-1099-4ff2-80cc-8c1a5e3e8f17 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:30.428879 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-51334fae-1099-4ff2-80cc-8c1a5e3e8f17 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:30.430603 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-51334fae-1099-4ff2-80cc-8c1a5e3e8f17 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:30.431243 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-51334fae-1099-4ff2-80cc-8c1a5e3e8f17 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:30.431857 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-51334fae-1099-4ff2-80cc-8c1a5e3e8f17 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:30.453000 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-50623927-e2c8-462a-94f5-5746f3301b5c tempest-FloatingIPsAssociationTestJSON-1278253592 tempest-FloatingIPsAssociationTestJSON-1278253592-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c08ddfb3-04be-486f-a6f1-7e1b641a09f1) Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:15:30.859607 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:15:30.863449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:15:30.863449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:15:30.863449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:15:30.863449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:15:30.863449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:15:30.863449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:15:30.863449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:15:30.863449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:15:30.863449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:15:30.863449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:15:30.863449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:15:30.863449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:15:30.863449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:15:30.863449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:15:30.863449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:15:30.863449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c08ddfb3-04be-486f-a6f1-7e1b641a09f1) Aug 22 17:15:30.863449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:30.866291 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-50623927-e2c8-462a-94f5-5746f3301b5c tempest-FloatingIPsAssociationTestJSON-1278253592 tempest-FloatingIPsAssociationTestJSON-1278253592-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:30.866291 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-50623927-e2c8-462a-94f5-5746f3301b5c tempest-FloatingIPsAssociationTestJSON-1278253592 tempest-FloatingIPsAssociationTestJSON-1278253592-project] Request method failure captured: Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 216 Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7mxXuMvhmw_C26GbewxSNhbKlocVPvZaS2HuBnIoXyDNl8wXqt0tLashoMmbwfYDiF3yZ4LvACnkZtMfNqmrvwEw27ETzXGYXB1pummjqDld7ZqQVyChsXTfEz-HsNAn1HpAaRk4E59h_gqCmrSSc94WIN6nlVYLfybE0eflb8G3RM Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 952f2690e9d3423092b0de865a3538af Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1278253592 Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/952f2690e9d3423092b0de865a3538af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_952f2690e9d3423092b0de865a3538af", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/952f2690e9d3423092b0de865a3538af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/952f2690e9d3423092b0de865a3538af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1278253592 Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 952f2690e9d3423092b0de865a3538af Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1278253592 Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-FloatingIPsAssociationTestJSON-1278253592-project Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 376230fa89c44b40a7e32de5f41e84d7 Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1278253592-project Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1874568928", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "58812a9c-ee59-4e4b-b4c8-8769c115003d"}]}} Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-FloatingIPsAssociationTestJSON-server-1874568928', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '58812a9c-ee59-4e4b-b4c8-8769c115003d'}]}}} Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:15:30.875556 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c08ddfb3-04be-486f-a6f1-7e1b641a09f1) Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:15:30.879718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:15:30.885847 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:30.885847 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:30.885847 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:30.885847 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:30.885847 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:30.885847 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:30.885847 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:30.885847 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:30.885847 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:15:30.885847 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:15:30.885847 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:30.885847 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:30.885847 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:30.885847 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-50623927-e2c8-462a-94f5-5746f3301b5c tempest-FloatingIPsAssociationTestJSON-1278253592 tempest-FloatingIPsAssociationTestJSON-1278253592-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:30.885847 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:15:30.885847 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-50623927-e2c8-462a-94f5-5746f3301b5c tempest-FloatingIPsAssociationTestJSON-1278253592 tempest-FloatingIPsAssociationTestJSON-1278253592-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.938478 Aug 22 17:15:30.885847 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 467/953] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:15:29 2022] POST /compute/v2.1/servers => generated 214 bytes in 940 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:15:30.905657 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-57e170a6-4b6b-4a17-8490-bbe8d5b2196f tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009e4e4c0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:30.998277 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-57e170a6-4b6b-4a17-8490-bbe8d5b2196f tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a" status: 200 len: 1455 microversion: 2.1 time: 0.110252 Aug 22 17:15:31.006305 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 468/954] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:15:30 2022] GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:31.407255 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-383d1c4d-1ded-4023-8e4c-e03140f9b5d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:31.408222 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-383d1c4d-1ded-4023-8e4c-e03140f9b5d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:31.422932 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-383d1c4d-1ded-4023-8e4c-e03140f9b5d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:31.423797 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-383d1c4d-1ded-4023-8e4c-e03140f9b5d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:31.425447 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-383d1c4d-1ded-4023-8e4c-e03140f9b5d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:31.430631 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-383d1c4d-1ded-4023-8e4c-e03140f9b5d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:31.432636 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-383d1c4d-1ded-4023-8e4c-e03140f9b5d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:31.433338 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-383d1c4d-1ded-4023-8e4c-e03140f9b5d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:31.571976 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-51334fae-1099-4ff2-80cc-8c1a5e3e8f17 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:31.589303 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-51334fae-1099-4ff2-80cc-8c1a5e3e8f17 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1467 microversion: 2.1 time: 1.182243 Aug 22 17:15:31.592885 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 487/955] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:30 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1467 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:32.015687 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-72505990-9f29-48b5-89d6-e4bea70f6f69 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80096bd9d0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:32.223809 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=6 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:33.024557 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-383d1c4d-1ded-4023-8e4c-e03140f9b5d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:33.039863 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-383d1c4d-1ded-4023-8e4c-e03140f9b5d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 200 len: 1318 microversion: 2.1 time: 1.636404 Aug 22 17:15:33.052110 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 469/956] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:31 2022] GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 1318 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:33.069158 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-bcfbefa6-9f5d-4405-b784-f25415dcaf51 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:33.070497 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-bcfbefa6-9f5d-4405-b784-f25415dcaf51 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:33.096521 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bcfbefa6-9f5d-4405-b784-f25415dcaf51 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:33.097020 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bcfbefa6-9f5d-4405-b784-f25415dcaf51 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:33.097482 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bcfbefa6-9f5d-4405-b784-f25415dcaf51 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:33.104077 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bcfbefa6-9f5d-4405-b784-f25415dcaf51 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:33.109827 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bcfbefa6-9f5d-4405-b784-f25415dcaf51 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:33.110801 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bcfbefa6-9f5d-4405-b784-f25415dcaf51 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:34.302100 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-bcfbefa6-9f5d-4405-b784-f25415dcaf51 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:34.316587 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-bcfbefa6-9f5d-4405-b784-f25415dcaf51 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1467 microversion: 2.1 time: 1.263337 Aug 22 17:15:34.325797 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 470/957] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:33 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1467 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:34.342425 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ea6f2112-c986-4f27-9a77-ca719916c8b4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:34.344924 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-ea6f2112-c986-4f27-9a77-ca719916c8b4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:34.370473 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ea6f2112-c986-4f27-9a77-ca719916c8b4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:34.374794 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ea6f2112-c986-4f27-9a77-ca719916c8b4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:34.375282 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ea6f2112-c986-4f27-9a77-ca719916c8b4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:34.376039 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ea6f2112-c986-4f27-9a77-ca719916c8b4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:34.376505 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ea6f2112-c986-4f27-9a77-ca719916c8b4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:34.376928 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ea6f2112-c986-4f27-9a77-ca719916c8b4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:34.567559 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=46 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:34.951157 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ea6f2112-c986-4f27-9a77-ca719916c8b4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:34.966606 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ea6f2112-c986-4f27-9a77-ca719916c8b4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 200 len: 1318 microversion: 2.1 time: 0.639562 Aug 22 17:15:34.977207 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 471/958] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:34 2022] GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 1318 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:35.347982 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-18fab5f7-c244-41d5-bb36-31c1c056a0ce tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:35.348633 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-18fab5f7-c244-41d5-bb36-31c1c056a0ce tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:35.363682 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-18fab5f7-c244-41d5-bb36-31c1c056a0ce tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:35.364184 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-18fab5f7-c244-41d5-bb36-31c1c056a0ce tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:35.364626 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-18fab5f7-c244-41d5-bb36-31c1c056a0ce tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:35.365379 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-18fab5f7-c244-41d5-bb36-31c1c056a0ce tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:35.366699 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-18fab5f7-c244-41d5-bb36-31c1c056a0ce tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:35.367308 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-18fab5f7-c244-41d5-bb36-31c1c056a0ce tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:35.591710 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-18fab5f7-c244-41d5-bb36-31c1c056a0ce tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:35.606705 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-18fab5f7-c244-41d5-bb36-31c1c056a0ce tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1425 microversion: 2.1 time: 0.260191 Aug 22 17:15:35.610135 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 472/959] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:35 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1425 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:15:35.623837 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-532f3ea8-3ad6-4030-9c60-9e9a8f3fa633 req-79633593-c23f-4cf4-b2f8-a23ff8a7e820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8507ebf3-26fb-454f-bffb-e3aae22e3e37", "name": "network-vif-deleted", "tag": "06644b82-5010-4ba1-879b-3c2e1d9e2444"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:35.651945 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-532f3ea8-3ad6-4030-9c60-9e9a8f3fa633 req-79633593-c23f-4cf4-b2f8-a23ff8a7e820 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:35.652975 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-532f3ea8-3ad6-4030-9c60-9e9a8f3fa633 req-79633593-c23f-4cf4-b2f8-a23ff8a7e820 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:35.654130 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-532f3ea8-3ad6-4030-9c60-9e9a8f3fa633 req-79633593-c23f-4cf4-b2f8-a23ff8a7e820 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:35.713053 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-532f3ea8-3ad6-4030-9c60-9e9a8f3fa633 req-79633593-c23f-4cf4-b2f8-a23ff8a7e820 service nova] Creating event network-vif-deleted:06644b82-5010-4ba1-879b-3c2e1d9e2444 for instance 8507ebf3-26fb-454f-bffb-e3aae22e3e37 on n-h1-854030-1 Aug 22 17:15:35.725265 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-532f3ea8-3ad6-4030-9c60-9e9a8f3fa633 req-79633593-c23f-4cf4-b2f8-a23ff8a7e820 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113305 Aug 22 17:15:35.726619 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 473/960] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:36.021298 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-90ff91e7-82fe-485b-82d6-2be006de9245 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:36.022090 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-90ff91e7-82fe-485b-82d6-2be006de9245 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:36.074574 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90ff91e7-82fe-485b-82d6-2be006de9245 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:36.075839 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90ff91e7-82fe-485b-82d6-2be006de9245 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:36.077760 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90ff91e7-82fe-485b-82d6-2be006de9245 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:36.081843 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90ff91e7-82fe-485b-82d6-2be006de9245 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:36.082976 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90ff91e7-82fe-485b-82d6-2be006de9245 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:36.083909 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90ff91e7-82fe-485b-82d6-2be006de9245 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:36.646455 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-90ff91e7-82fe-485b-82d6-2be006de9245 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:36.662339 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-90ff91e7-82fe-485b-82d6-2be006de9245 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 200 len: 1318 microversion: 2.1 time: 0.667466 Aug 22 17:15:36.663868 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 474/961] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:35 2022] GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 1318 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:15:36.671955 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-3bf70c52-3260-4255-b170-4751aad2baa4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:36.689655 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-3bf70c52-3260-4255-b170-4751aad2baa4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:36.714311 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3bf70c52-3260-4255-b170-4751aad2baa4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:36.714578 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3bf70c52-3260-4255-b170-4751aad2baa4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:36.717031 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3bf70c52-3260-4255-b170-4751aad2baa4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:36.720847 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3bf70c52-3260-4255-b170-4751aad2baa4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:36.721754 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3bf70c52-3260-4255-b170-4751aad2baa4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:36.728706 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3bf70c52-3260-4255-b170-4751aad2baa4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:36.817387 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3bf70c52-3260-4255-b170-4751aad2baa4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:36.817902 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3bf70c52-3260-4255-b170-4751aad2baa4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:36.821223 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3bf70c52-3260-4255-b170-4751aad2baa4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:36.821223 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-3bf70c52-3260-4255-b170-4751aad2baa4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lazy-loading 'fault' on Instance uuid 8507ebf3-26fb-454f-bffb-e3aae22e3e37 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:15:37.214336 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:37.456171 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-3bf70c52-3260-4255-b170-4751aad2baa4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:37.468805 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-3bf70c52-3260-4255-b170-4751aad2baa4 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 200 len: 1302 microversion: 2.1 time: 0.800636 Aug 22 17:15:37.472050 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 475/962] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:36 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 1302 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:37.687349 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f6a80f22-630e-463f-a75a-b5ac69c0a4aa tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:37.688016 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-f6a80f22-630e-463f-a75a-b5ac69c0a4aa tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:37.706306 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6a80f22-630e-463f-a75a-b5ac69c0a4aa tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:37.710737 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6a80f22-630e-463f-a75a-b5ac69c0a4aa tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:37.711238 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6a80f22-630e-463f-a75a-b5ac69c0a4aa tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:37.716457 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6a80f22-630e-463f-a75a-b5ac69c0a4aa tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:37.716457 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6a80f22-630e-463f-a75a-b5ac69c0a4aa tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:37.716457 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6a80f22-630e-463f-a75a-b5ac69c0a4aa tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:38.333316 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=42 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:39.071820 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-f6a80f22-630e-463f-a75a-b5ac69c0a4aa tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:39.103891 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f6a80f22-630e-463f-a75a-b5ac69c0a4aa tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 200 len: 1318 microversion: 2.1 time: 1.418927 Aug 22 17:15:39.106942 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 476/963] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:37 2022] GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 1318 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:39.136265 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-058e2e68-3b5f-4a91-91cf-7ca11353bac3 req-ab8b3026-4d95-4c6a-a3d5-52ad38816491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd453f5-ed66-49c4-8877-f48c09aff5a9", "tag": "005ecac8-82fc-4593-a587-67d69aab6761"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:39.237827 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-058e2e68-3b5f-4a91-91cf-7ca11353bac3 req-ab8b3026-4d95-4c6a-a3d5-52ad38816491 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:39.244336 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-058e2e68-3b5f-4a91-91cf-7ca11353bac3 req-ab8b3026-4d95-4c6a-a3d5-52ad38816491 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:39.244336 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-058e2e68-3b5f-4a91-91cf-7ca11353bac3 req-ab8b3026-4d95-4c6a-a3d5-52ad38816491 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:39.284480 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-058e2e68-3b5f-4a91-91cf-7ca11353bac3 req-ab8b3026-4d95-4c6a-a3d5-52ad38816491 service nova] Creating event network-changed:005ecac8-82fc-4593-a587-67d69aab6761 for instance dfd453f5-ed66-49c4-8877-f48c09aff5a9 on n-h2-854030-1 Aug 22 17:15:39.314964 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-058e2e68-3b5f-4a91-91cf-7ca11353bac3 req-ab8b3026-4d95-4c6a-a3d5-52ad38816491 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203274 Aug 22 17:15:39.325911 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 477/964] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:39.345830 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-7524feaf-cc7c-42f8-8fa6-2d9cfc5c3375 req-5772fbd0-7c04-4a12-ae91-d770d6c4588d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d1e79a-48e9-436e-a233-7a950de59886", "name": "network-vif-plugged", "status": "completed", "tag": "6f8bb3a8-685e-4d62-8584-0402c1743657"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:39.395302 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-7524feaf-cc7c-42f8-8fa6-2d9cfc5c3375 req-5772fbd0-7c04-4a12-ae91-d770d6c4588d service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:39.402082 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-7524feaf-cc7c-42f8-8fa6-2d9cfc5c3375 req-5772fbd0-7c04-4a12-ae91-d770d6c4588d service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:39.403280 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-7524feaf-cc7c-42f8-8fa6-2d9cfc5c3375 req-5772fbd0-7c04-4a12-ae91-d770d6c4588d service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:39.461201 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-7524feaf-cc7c-42f8-8fa6-2d9cfc5c3375 req-5772fbd0-7c04-4a12-ae91-d770d6c4588d service nova] Creating event network-vif-plugged:6f8bb3a8-685e-4d62-8584-0402c1743657 for instance b9d1e79a-48e9-436e-a233-7a950de59886 on n-h2-854030-1 Aug 22 17:15:39.476330 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-7524feaf-cc7c-42f8-8fa6-2d9cfc5c3375 req-5772fbd0-7c04-4a12-ae91-d770d6c4588d service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148412 Aug 22 17:15:39.482649 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 478/965] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:39.497713 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-41f73503-38a7-42a0-867c-7f44898d294a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:39.504693 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-41f73503-38a7-42a0-867c-7f44898d294a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 8507ebf3-26fb-454f-bffb-e3aae22e3e37] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:39.519838 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-41f73503-38a7-42a0-867c-7f44898d294a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:39.520775 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-41f73503-38a7-42a0-867c-7f44898d294a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:39.523584 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-41f73503-38a7-42a0-867c-7f44898d294a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:39.524850 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-41f73503-38a7-42a0-867c-7f44898d294a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:39.525680 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-41f73503-38a7-42a0-867c-7f44898d294a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:39.527849 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-41f73503-38a7-42a0-867c-7f44898d294a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:39.570728 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-41f73503-38a7-42a0-867c-7f44898d294a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] HTTP exception thrown: Instance 8507ebf3-26fb-454f-bffb-e3aae22e3e37 could not be found. Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-41f73503-38a7-42a0-867c-7f44898d294a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Request method failure captured: Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 HTTP/1.1 Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7k87sm7WV03FM7bZ8JjHyvQfPnVPLjS8igb88BLXVKmU_5cWSQLGEJGPSdMyWuitZn_vyOfy_MRB5UuFQaoEkCRZuXZwqy6IGsGpeN98b6g_VAprshPTrzwmmZdhYp3OkQB85942qKskPxRA_FIoWgy2xmo-4iwmpVti-FLjmF-gDI Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: c3d5a2fb6b4440168a7e84d03007a6fb Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-MigrationsAdminTest-1971141865 Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c3d5a2fb6b4440168a7e84d03007a6fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_c3d5a2fb6b4440168a7e84d03007a6fb", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c3d5a2fb6b4440168a7e84d03007a6fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/c3d5a2fb6b4440168a7e84d03007a6fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-MigrationsAdminTest-1971141865 Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: c3d5a2fb6b4440168a7e84d03007a6fb Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-MigrationsAdminTest-1971141865 Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-MigrationsAdminTest-1971141865-project Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: dafa41865864461fa0e0dbc4a0188e4b Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-MigrationsAdminTest-1971141865-project Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance 8507ebf3-26fb-454f-bffb-e3aae22e3e37 could not be found. Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '8507ebf3-26fb-454f-bffb-e3aae22e3e37'} Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8507ebf3-26fb-454f-bffb-e3aae22e3e37 could not be found. Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8507ebf3-26fb-454f-bffb-e3aae22e3e37 could not be found. Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:39.580542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:39.586595 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:39.586595 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:39.586595 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:39.586595 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:15:39.586595 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:15:39.586595 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8507ebf3-26fb-454f-bffb-e3aae22e3e37 could not be found. Aug 22 17:15:39.586595 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:15:39.588759 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-41f73503-38a7-42a0-867c-7f44898d294a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Returning 404 to user: Instance 8507ebf3-26fb-454f-bffb-e3aae22e3e37 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:15:39.590223 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-41f73503-38a7-42a0-867c-7f44898d294a tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37" status: 404 len: 111 microversion: 2.1 time: 0.102401 Aug 22 17:15:39.592264 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 479/966] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:39 2022] GET /compute/v2.1/servers/8507ebf3-26fb-454f-bffb-e3aae22e3e37 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:15:39.607516 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-27e1a81a-fa9d-4bc6-ad30-91c1c67c6eac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:39.608492 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-27e1a81a-fa9d-4bc6-ad30-91c1c67c6eac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:39.627263 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-27e1a81a-fa9d-4bc6-ad30-91c1c67c6eac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:39.630409 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-27e1a81a-fa9d-4bc6-ad30-91c1c67c6eac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:39.632684 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-27e1a81a-fa9d-4bc6-ad30-91c1c67c6eac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:39.634058 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-27e1a81a-fa9d-4bc6-ad30-91c1c67c6eac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:39.636044 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-27e1a81a-fa9d-4bc6-ad30-91c1c67c6eac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:39.640090 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-27e1a81a-fa9d-4bc6-ad30-91c1c67c6eac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:39.746132 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-27e1a81a-fa9d-4bc6-ad30-91c1c67c6eac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Going to try to terminate instance {{(pid=123016) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:15:40.426044 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:41.112551 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-27e1a81a-fa9d-4bc6-ad30-91c1c67c6eac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "DELETE /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 204 len: 0 microversion: 2.1 time: 1.515532 Aug 22 17:15:41.117191 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 480/967] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:15:39 2022] DELETE /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 0 bytes in 1517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:15:41.119324 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e09625a5-d5f3-4f6b-80fb-2812ee733efe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:41.121422 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e09625a5-d5f3-4f6b-80fb-2812ee733efe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:41.142459 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e09625a5-d5f3-4f6b-80fb-2812ee733efe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:41.142980 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e09625a5-d5f3-4f6b-80fb-2812ee733efe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:41.143428 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e09625a5-d5f3-4f6b-80fb-2812ee733efe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:41.144165 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e09625a5-d5f3-4f6b-80fb-2812ee733efe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:41.144717 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e09625a5-d5f3-4f6b-80fb-2812ee733efe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:41.157687 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e09625a5-d5f3-4f6b-80fb-2812ee733efe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:42.214607 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e09625a5-d5f3-4f6b-80fb-2812ee733efe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:42.228597 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e09625a5-d5f3-4f6b-80fb-2812ee733efe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 200 len: 1318 microversion: 2.1 time: 1.113477 Aug 22 17:15:42.232553 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 481/968] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:41 2022] GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 1318 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:42.245741 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8338349e-3d1f-4914-8676-e8ad936e6dac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:42.246868 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-8338349e-3d1f-4914-8676-e8ad936e6dac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:42.266539 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8338349e-3d1f-4914-8676-e8ad936e6dac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:42.267386 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8338349e-3d1f-4914-8676-e8ad936e6dac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:42.269641 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8338349e-3d1f-4914-8676-e8ad936e6dac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:42.273063 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8338349e-3d1f-4914-8676-e8ad936e6dac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:42.275814 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8338349e-3d1f-4914-8676-e8ad936e6dac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:42.279878 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8338349e-3d1f-4914-8676-e8ad936e6dac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:42.953235 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-8338349e-3d1f-4914-8676-e8ad936e6dac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:42.967396 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8338349e-3d1f-4914-8676-e8ad936e6dac tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 200 len: 1533 microversion: 2.1 time: 0.733333 Aug 22 17:15:42.968217 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 482/969] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:42 2022] GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 1533 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:42.985964 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-ae2e9709-eba7-4424-be22-786abf650ea0 req-5b25dfdc-bce7-4493-a23b-8f3db61b3657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdf44444-5aec-46a8-a23a-d9d6621684a6", "tag": "2a775859-4ec3-400e-838a-c3566ff49e77"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:43.018822 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-ae2e9709-eba7-4424-be22-786abf650ea0 req-5b25dfdc-bce7-4493-a23b-8f3db61b3657 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:43.029929 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-ae2e9709-eba7-4424-be22-786abf650ea0 req-5b25dfdc-bce7-4493-a23b-8f3db61b3657 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:43.037843 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-ae2e9709-eba7-4424-be22-786abf650ea0 req-5b25dfdc-bce7-4493-a23b-8f3db61b3657 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:43.058989 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-ae2e9709-eba7-4424-be22-786abf650ea0 req-5b25dfdc-bce7-4493-a23b-8f3db61b3657 service nova] Creating event network-changed:2a775859-4ec3-400e-838a-c3566ff49e77 for instance fdf44444-5aec-46a8-a23a-d9d6621684a6 on n-h1-854030-1 Aug 22 17:15:43.070483 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-ae2e9709-eba7-4424-be22-786abf650ea0 req-5b25dfdc-bce7-4493-a23b-8f3db61b3657 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100033 Aug 22 17:15:43.086508 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 483/970] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:43.312930 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:43.422710 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a88e5c91-dd8c-4346-a159-2c0ac6bda15d tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:43.451736 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a88e5c91-dd8c-4346-a159-2c0ac6bda15d tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] 10.222.0.96 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.358993 Aug 22 17:15:43.454506 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 484/971] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:15:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:43.482013 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c04755a8-9ec3-4b9f-921c-7030a1113a7c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:43.488453 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c04755a8-9ec3-4b9f-921c-7030a1113a7c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:43.503470 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c04755a8-9ec3-4b9f-921c-7030a1113a7c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:43.507498 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c04755a8-9ec3-4b9f-921c-7030a1113a7c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:43.514759 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c04755a8-9ec3-4b9f-921c-7030a1113a7c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:43.515600 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c04755a8-9ec3-4b9f-921c-7030a1113a7c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:43.525923 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c04755a8-9ec3-4b9f-921c-7030a1113a7c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:43.526582 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c04755a8-9ec3-4b9f-921c-7030a1113a7c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:44.378049 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c04755a8-9ec3-4b9f-921c-7030a1113a7c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:44.412368 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c04755a8-9ec3-4b9f-921c-7030a1113a7c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 200 len: 1318 microversion: 2.1 time: 0.954798 Aug 22 17:15:44.416755 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 485/972] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:43 2022] GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 1318 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:44.440188 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d7627bc8-d29a-4c0e-ba8c-9407f9a8557e tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:44.545881 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d7627bc8-d29a-4c0e-ba8c-9407f9a8557e tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] 10.222.0.96 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.126313 Aug 22 17:15:44.561336 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 486/973] 10.222.0.96 () {58 vars in 1125 bytes} [Mon Aug 22 17:15:44 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:44.582615 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5cf4486f-3950-4b6b-8e02-1edde2c98a6c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:44.583133 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5cf4486f-3950-4b6b-8e02-1edde2c98a6c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:44.600290 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5cf4486f-3950-4b6b-8e02-1edde2c98a6c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:44.600740 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5cf4486f-3950-4b6b-8e02-1edde2c98a6c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:44.601207 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5cf4486f-3950-4b6b-8e02-1edde2c98a6c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:44.601940 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5cf4486f-3950-4b6b-8e02-1edde2c98a6c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:44.602402 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5cf4486f-3950-4b6b-8e02-1edde2c98a6c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:44.602832 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5cf4486f-3950-4b6b-8e02-1edde2c98a6c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:45.028001 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-5cf4486f-3950-4b6b-8e02-1edde2c98a6c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:45.041203 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5cf4486f-3950-4b6b-8e02-1edde2c98a6c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 200 len: 1533 microversion: 2.1 time: 0.476130 Aug 22 17:15:45.044990 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 487/974] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:44 2022] GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 1533 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:45.062013 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7a7c2d63-fd23-4bb0-b50d-31e08c69d520 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:45.091205 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7a7c2d63-fd23-4bb0-b50d-31e08c69d520 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] 10.222.0.96 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034521 Aug 22 17:15:45.100895 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 488/975] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:15:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:45.127246 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a6f519b7-f505-4784-8b48-8b44aade91ce tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:45.142729 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a6f519b7-f505-4784-8b48-8b44aade91ce tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] 10.222.0.96 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031703 Aug 22 17:15:45.151394 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 489/976] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:15:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:45.157480 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-639db4da-2da9-4e7b-a964-38e3c0586b2a tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:45.220924 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-639db4da-2da9-4e7b-a964-38e3c0586b2a tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] 10.222.0.96 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.068053 Aug 22 17:15:45.222154 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 490/977] 10.222.0.96 () {58 vars in 1165 bytes} [Mon Aug 22 17:15:45 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:45.273074 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9916ba80-9dda-406a-b09e-ea1d1ea52ede tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:45.327860 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9916ba80-9dda-406a-b09e-ea1d1ea52ede tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] 10.222.0.96 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.082701 Aug 22 17:15:45.330928 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 491/978] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:15:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:45.357982 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-45dab8ef-98f1-4b0b-a43b-7266c32943f8 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:45.466530 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-45dab8ef-98f1-4b0b-a43b-7266c32943f8 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] 10.222.0.96 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.125314 Aug 22 17:15:45.484382 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 492/979] 10.222.0.96 () {58 vars in 1169 bytes} [Mon Aug 22 17:15:45 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:45.510033 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c25bc4a3-d647-4c1c-92df-9d39c631e031 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:45.510496 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c25bc4a3-d647-4c1c-92df-9d39c631e031 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:45.539652 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c25bc4a3-d647-4c1c-92df-9d39c631e031 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:45.541175 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c25bc4a3-d647-4c1c-92df-9d39c631e031 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:45.541175 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c25bc4a3-d647-4c1c-92df-9d39c631e031 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:45.555848 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c25bc4a3-d647-4c1c-92df-9d39c631e031 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:45.556736 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c25bc4a3-d647-4c1c-92df-9d39c631e031 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:45.561737 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c25bc4a3-d647-4c1c-92df-9d39c631e031 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:46.478539 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c25bc4a3-d647-4c1c-92df-9d39c631e031 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:46.482567 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:46.499154 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c25bc4a3-d647-4c1c-92df-9d39c631e031 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 200 len: 1318 microversion: 2.1 time: 1.007063 Aug 22 17:15:46.499756 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 493/980] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:45 2022] GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 1318 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:46.511756 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-da0bc999-0224-4f5f-ac10-44991dc3f8f7 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:46.567066 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-da0bc999-0224-4f5f-ac10-44991dc3f8f7 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] 10.222.0.96 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.066151 Aug 22 17:15:46.567685 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 494/981] 10.222.0.96 () {58 vars in 1161 bytes} [Mon Aug 22 17:15:46 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:46.598105 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-0f890d11-47f4-482c-bf57-352040ac4eaf req-6a079078-5c19-4704-a335-cbc6750e03a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94de208f-edff-400d-840d-1cb7eafb3913", "name": "network-vif-deleted", "tag": "cf9aa49c-6ca6-427a-b18b-f185e8006fca"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:46.622701 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-0f890d11-47f4-482c-bf57-352040ac4eaf req-6a079078-5c19-4704-a335-cbc6750e03a2 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:46.622701 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-0f890d11-47f4-482c-bf57-352040ac4eaf req-6a079078-5c19-4704-a335-cbc6750e03a2 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:46.623082 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-0f890d11-47f4-482c-bf57-352040ac4eaf req-6a079078-5c19-4704-a335-cbc6750e03a2 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:46.666196 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-0f890d11-47f4-482c-bf57-352040ac4eaf req-6a079078-5c19-4704-a335-cbc6750e03a2 service nova] Creating event network-vif-deleted:cf9aa49c-6ca6-427a-b18b-f185e8006fca for instance 94de208f-edff-400d-840d-1cb7eafb3913 on n-h2-854030-1 Aug 22 17:15:46.674294 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-0f890d11-47f4-482c-bf57-352040ac4eaf req-6a079078-5c19-4704-a335-cbc6750e03a2 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097509 Aug 22 17:15:46.682822 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 495/982] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:46.705127 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-095f84f8-7842-4674-8b1b-1982b749e0fb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:46.709292 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-095f84f8-7842-4674-8b1b-1982b749e0fb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:46.734592 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-095f84f8-7842-4674-8b1b-1982b749e0fb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:46.737840 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-095f84f8-7842-4674-8b1b-1982b749e0fb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:46.746890 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-095f84f8-7842-4674-8b1b-1982b749e0fb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:46.746890 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-095f84f8-7842-4674-8b1b-1982b749e0fb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:46.746890 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-095f84f8-7842-4674-8b1b-1982b749e0fb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:46.746890 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-095f84f8-7842-4674-8b1b-1982b749e0fb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:46.828687 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-095f84f8-7842-4674-8b1b-1982b749e0fb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:46.831210 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-095f84f8-7842-4674-8b1b-1982b749e0fb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:46.833325 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-095f84f8-7842-4674-8b1b-1982b749e0fb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:46.835590 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-095f84f8-7842-4674-8b1b-1982b749e0fb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lazy-loading 'fault' on Instance uuid 94de208f-edff-400d-840d-1cb7eafb3913 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:15:47.163744 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-72505990-9f29-48b5-89d6-e4bea70f6f69 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a" status: 200 len: 1455 microversion: 2.1 time: 15.149833 Aug 22 17:15:47.165174 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 488/983] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:15:32 2022] GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a => generated 1455 bytes in 15155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:47.196603 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-dc3ca979-6d33-4b05-8512-0ecbcea9f406 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:47.247953 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-dc3ca979-6d33-4b05-8512-0ecbcea9f406 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] 10.222.0.96 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.077451 Aug 22 17:15:47.253128 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 489/984] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:15:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:47.485816 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-095f84f8-7842-4674-8b1b-1982b749e0fb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:47.496738 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-095f84f8-7842-4674-8b1b-1982b749e0fb tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 200 len: 1369 microversion: 2.1 time: 0.811453 Aug 22 17:15:47.500394 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 496/985] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:46 2022] GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 1369 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:47.512277 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9d435e3c-48ce-40fc-9c63-33f1ad05ecf7 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:47.589241 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9d435e3c-48ce-40fc-9c63-33f1ad05ecf7 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] 10.222.0.96 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.087436 Aug 22 17:15:47.613192 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 497/986] 10.222.0.96 () {58 vars in 1167 bytes} [Mon Aug 22 17:15:47 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:47.613192 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6063b4c3-63b0-45a3-a2a9-299e872e7f8f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:47.613192 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-6063b4c3-63b0-45a3-a2a9-299e872e7f8f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:47.619202 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6063b4c3-63b0-45a3-a2a9-299e872e7f8f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:47.619928 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6063b4c3-63b0-45a3-a2a9-299e872e7f8f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:47.620699 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6063b4c3-63b0-45a3-a2a9-299e872e7f8f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:47.622395 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6063b4c3-63b0-45a3-a2a9-299e872e7f8f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:47.623179 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6063b4c3-63b0-45a3-a2a9-299e872e7f8f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:47.623777 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6063b4c3-63b0-45a3-a2a9-299e872e7f8f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:47.692975 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9b84fbda-1acb-4d2a-995d-a9450070c248 tempest-AttachSCSIVolumeTestJSON-645105604 tempest-AttachSCSIVolumeTestJSON-645105604-project] Action: 'create', calling method: .version_select at 0x7f8009945a60>, body: {"keypair": {"name": "tempest-keypair-1912407289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHm0ytKtpq5t/JR8pSQQiHjgpywSuUNfBpEtT0PaBSvEPR8yHJwckRyaCkzi6TpZNYCf3qszte/12qnaUZ0qQYzMhOXlxo/lx38yDobjT4Lmk/PcoluPpWjdft/Ee7dzQ=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:47.766200 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-9b84fbda-1acb-4d2a-995d-a9450070c248 tempest-AttachSCSIVolumeTestJSON-645105604 tempest-AttachSCSIVolumeTestJSON-645105604-project] Getting quotas for project f47afa16295c47d8817631e77478e561. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:47.820974 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-9b84fbda-1acb-4d2a-995d-a9450070c248 tempest-AttachSCSIVolumeTestJSON-645105604 tempest-AttachSCSIVolumeTestJSON-645105604-project] Getting quotas for user c364f76e875d428e8a88b07e1f49e09a and project f47afa16295c47d8817631e77478e561. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:48.056984 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9b84fbda-1acb-4d2a-995d-a9450070c248 tempest-AttachSCSIVolumeTestJSON-645105604 tempest-AttachSCSIVolumeTestJSON-645105604-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.798486 Aug 22 17:15:48.058609 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 490/987] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:15:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:48.066656 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2680c7d6-e108-4e4a-b65c-c345ad93dd93 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:48.099231 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2680c7d6-e108-4e4a-b65c-c345ad93dd93 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] 10.222.0.96 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037006 Aug 22 17:15:48.101577 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 491/988] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:15:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:48.108644 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-8d6513e0-f2b8-4eae-8e38-4456e69d7ac7 req-4fd922a5-85da-4be5-b423-bb83f0ea3080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd453f5-ed66-49c4-8877-f48c09aff5a9", "name": "network-vif-plugged", "status": "completed", "tag": "005ecac8-82fc-4593-a587-67d69aab6761"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:48.127540 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-8d6513e0-f2b8-4eae-8e38-4456e69d7ac7 req-4fd922a5-85da-4be5-b423-bb83f0ea3080 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:48.128384 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-8d6513e0-f2b8-4eae-8e38-4456e69d7ac7 req-4fd922a5-85da-4be5-b423-bb83f0ea3080 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:48.128986 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-8d6513e0-f2b8-4eae-8e38-4456e69d7ac7 req-4fd922a5-85da-4be5-b423-bb83f0ea3080 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:48.153063 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-8d6513e0-f2b8-4eae-8e38-4456e69d7ac7 req-4fd922a5-85da-4be5-b423-bb83f0ea3080 service nova] Creating event network-vif-plugged:005ecac8-82fc-4593-a587-67d69aab6761 for instance dfd453f5-ed66-49c4-8877-f48c09aff5a9 on n-h2-854030-1 Aug 22 17:15:48.162401 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-8d6513e0-f2b8-4eae-8e38-4456e69d7ac7 req-4fd922a5-85da-4be5-b423-bb83f0ea3080 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058035 Aug 22 17:15:48.164282 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 492/989] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:48.178930 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-bc1ba317-3edc-4336-ac17-b9287dc8027c tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:48.239718 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-bc1ba317-3edc-4336-ac17-b9287dc8027c tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] 10.222.0.96 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.073321 Aug 22 17:15:48.240319 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 493/990] 10.222.0.96 () {58 vars in 1144 bytes} [Mon Aug 22 17:15:48 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:48.248271 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-bbb25de9-8a17-4d20-83a8-39c6a1e8e8fa tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009d1d4c0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:48.323164 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-bbb25de9-8a17-4d20-83a8-39c6a1e8e8fa tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a" status: 200 len: 1455 microversion: 2.1 time: 0.079420 Aug 22 17:15:48.327740 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 494/991] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:15:48 2022] GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:48.334157 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-74ee5a67-0cb6-499e-85d5-cc0851b63700 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:48.347602 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-74ee5a67-0cb6-499e-85d5-cc0851b63700 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] 10.222.0.96 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017741 Aug 22 17:15:48.349339 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 495/992] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:15:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:48.376515 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-99ddb25c-1eec-4fdf-9a45-c8910dc08712 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:48.469414 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-99ddb25c-1eec-4fdf-9a45-c8910dc08712 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] 10.222.0.96 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.090496 Aug 22 17:15:48.474252 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 496/993] 10.222.0.96 () {58 vars in 1148 bytes} [Mon Aug 22 17:15:48 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:48.488746 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a007f373-005b-4474-8ead-adf9c7f20dc4 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:48.504337 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a007f373-005b-4474-8ead-adf9c7f20dc4 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] 10.222.0.96 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.020340 Aug 22 17:15:48.515405 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 497/994] 10.222.0.96 () {58 vars in 1140 bytes} [Mon Aug 22 17:15:48 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:48.523537 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d6847295-94ac-46c3-9834-ec0d39e2b3de tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:48.549376 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d6847295-94ac-46c3-9834-ec0d39e2b3de tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] 10.222.0.96 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032656 Aug 22 17:15:48.557657 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 498/995] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:15:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:48.562820 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d5f7ef7e-67c4-471c-ba1e-1e9c6141a76f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:48.563184 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d5f7ef7e-67c4-471c-ba1e-1e9c6141a76f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 94de208f-edff-400d-840d-1cb7eafb3913] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:48.581903 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d5f7ef7e-67c4-471c-ba1e-1e9c6141a76f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:48.589436 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d5f7ef7e-67c4-471c-ba1e-1e9c6141a76f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:48.590142 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d5f7ef7e-67c4-471c-ba1e-1e9c6141a76f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:48.591105 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d5f7ef7e-67c4-471c-ba1e-1e9c6141a76f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:48.591729 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d5f7ef7e-67c4-471c-ba1e-1e9c6141a76f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:48.592335 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d5f7ef7e-67c4-471c-ba1e-1e9c6141a76f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:48.624387 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-d5f7ef7e-67c4-471c-ba1e-1e9c6141a76f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] HTTP exception thrown: Instance 94de208f-edff-400d-840d-1cb7eafb3913 could not be found. Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d5f7ef7e-67c4-471c-ba1e-1e9c6141a76f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Request method failure captured: Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 HTTP/1.1 Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7k87sm7WV03FM7bZ8JjHyvQfPnVPLjS8igb88BLXVKmU_5cWSQLGEJGPSdMyWuitZn_vyOfy_MRB5UuFQaoEkCRZuXZwqy6IGsGpeN98b6g_VAprshPTrzwmmZdhYp3OkQB85942qKskPxRA_FIoWgy2xmo-4iwmpVti-FLjmF-gDI Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: c3d5a2fb6b4440168a7e84d03007a6fb Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-MigrationsAdminTest-1971141865 Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c3d5a2fb6b4440168a7e84d03007a6fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_c3d5a2fb6b4440168a7e84d03007a6fb", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c3d5a2fb6b4440168a7e84d03007a6fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/c3d5a2fb6b4440168a7e84d03007a6fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-MigrationsAdminTest-1971141865 Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: c3d5a2fb6b4440168a7e84d03007a6fb Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-MigrationsAdminTest-1971141865 Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-MigrationsAdminTest-1971141865-project Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: dafa41865864461fa0e0dbc4a0188e4b Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-MigrationsAdminTest-1971141865-project Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance 94de208f-edff-400d-840d-1cb7eafb3913 could not be found. Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '94de208f-edff-400d-840d-1cb7eafb3913'} Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94de208f-edff-400d-840d-1cb7eafb3913 could not be found. Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94de208f-edff-400d-840d-1cb7eafb3913 could not be found. Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:48.638619 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:48.644624 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:48.644624 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:48.644624 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:48.644624 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:15:48.644624 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:15:48.644624 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94de208f-edff-400d-840d-1cb7eafb3913 could not be found. Aug 22 17:15:48.644624 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:48.644624 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d5f7ef7e-67c4-471c-ba1e-1e9c6141a76f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Returning 404 to user: Instance 94de208f-edff-400d-840d-1cb7eafb3913 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:15:48.644624 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d5f7ef7e-67c4-471c-ba1e-1e9c6141a76f tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913" status: 404 len: 111 microversion: 2.1 time: 0.081534 Aug 22 17:15:48.644624 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 499/996] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:48 2022] GET /compute/v2.1/servers/94de208f-edff-400d-840d-1cb7eafb3913 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:15:48.655562 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-796ff163-1366-4bed-85c9-4f0f51550162 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:48.747940 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-796ff163-1366-4bed-85c9-4f0f51550162 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] 10.222.0.96 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.102207 Aug 22 17:15:48.762142 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-6063b4c3-63b0-45a3-a2a9-299e872e7f8f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:48.774366 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-6063b4c3-63b0-45a3-a2a9-299e872e7f8f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 200 len: 1318 microversion: 2.1 time: 1.170115 Aug 22 17:15:48.790506 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 498/997] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:47 2022] GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 1318 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:48.800146 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 500/998] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:15:48 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:48.803780 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b20edfee-4162-43e5-8334-8676cdb08dd7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:48.804342 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b20edfee-4162-43e5-8334-8676cdb08dd7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:48.810203 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-53bf1e7d-e6f5-4c80-a5d6-c7b8eac05144 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:48.830272 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b20edfee-4162-43e5-8334-8676cdb08dd7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:48.830272 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b20edfee-4162-43e5-8334-8676cdb08dd7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:48.830272 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b20edfee-4162-43e5-8334-8676cdb08dd7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:48.830272 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b20edfee-4162-43e5-8334-8676cdb08dd7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:48.830272 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b20edfee-4162-43e5-8334-8676cdb08dd7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:48.831093 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b20edfee-4162-43e5-8334-8676cdb08dd7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:48.868421 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-53bf1e7d-e6f5-4c80-a5d6-c7b8eac05144 tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066983 Aug 22 17:15:48.885356 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 501/999] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:15:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:48.896984 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5b805b3c-d49f-47b9-b8bd-8e564746b42a tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:48.908518 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b20edfee-4162-43e5-8334-8676cdb08dd7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Going to try to terminate instance {{(pid=123016) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:15:48.915614 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5b805b3c-d49f-47b9-b8bd-8e564746b42a tempest-FlavorsV2TestJSON-1185486175 tempest-FlavorsV2TestJSON-1185486175-project] 10.222.0.96 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028810 Aug 22 17:15:48.936718 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 502/1000] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:15:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:49.342023 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-846dd1e1-80b6-4129-8ef8-050b569f3e6b tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80099e75e0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:49.352681 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b20edfee-4162-43e5-8334-8676cdb08dd7 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "DELETE /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 204 len: 0 microversion: 2.1 time: 0.560752 Aug 22 17:15:49.353386 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 499/1001] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:15:48 2022] DELETE /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:15:49.362008 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fa6873e8-acc8-4eca-abb5-6d1f3b175249 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:49.362995 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-fa6873e8-acc8-4eca-abb5-6d1f3b175249 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:49.379650 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa6873e8-acc8-4eca-abb5-6d1f3b175249 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:49.380440 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa6873e8-acc8-4eca-abb5-6d1f3b175249 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:49.381653 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa6873e8-acc8-4eca-abb5-6d1f3b175249 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:49.382768 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa6873e8-acc8-4eca-abb5-6d1f3b175249 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:49.383610 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa6873e8-acc8-4eca-abb5-6d1f3b175249 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:49.384222 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa6873e8-acc8-4eca-abb5-6d1f3b175249 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:49.498638 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-846dd1e1-80b6-4129-8ef8-050b569f3e6b tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a" status: 200 len: 1455 microversion: 2.1 time: 0.155855 Aug 22 17:15:49.498638 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 503/1002] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:15:49 2022] GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:49.795071 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9bb69a0a-07e9-4577-8e17-d8f5632db376 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:49.795948 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9bb69a0a-07e9-4577-8e17-d8f5632db376 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:49.810610 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9bb69a0a-07e9-4577-8e17-d8f5632db376 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:49.813924 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9bb69a0a-07e9-4577-8e17-d8f5632db376 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:49.816892 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9bb69a0a-07e9-4577-8e17-d8f5632db376 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:49.820570 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9bb69a0a-07e9-4577-8e17-d8f5632db376 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:49.823746 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9bb69a0a-07e9-4577-8e17-d8f5632db376 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:49.825001 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9bb69a0a-07e9-4577-8e17-d8f5632db376 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:50.492812 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-fa6873e8-acc8-4eca-abb5-6d1f3b175249 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:50.502093 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-fa6873e8-acc8-4eca-abb5-6d1f3b175249 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 200 len: 1468 microversion: 2.1 time: 1.144304 Aug 22 17:15:50.508720 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 500/1003] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:49 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 1468 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:15:50.580049 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e1b2385e-8d1d-421a-b9cf-e3998c3e8360 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f800a0ff700>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:50.580302 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9bb69a0a-07e9-4577-8e17-d8f5632db376 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:50.580302 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9bb69a0a-07e9-4577-8e17-d8f5632db376 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 200 len: 1318 microversion: 2.1 time: 0.746685 Aug 22 17:15:50.580302 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 504/1004] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:49 2022] GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 1318 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:50.600978 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e1b2385e-8d1d-421a-b9cf-e3998c3e8360 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a" status: 200 len: 1455 microversion: 2.1 time: 0.090746 Aug 22 17:15:50.601610 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 501/1005] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:15:50 2022] GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:51.541830 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e05a4b2a-8e8d-4b67-95bb-8bf8b087d58d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:51.542749 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-e05a4b2a-8e8d-4b67-95bb-8bf8b087d58d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:51.560311 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9b82d550-4ccb-43b0-9266-4ef579638fe6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:51.561645 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-9b82d550-4ccb-43b0-9266-4ef579638fe6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:51.600332 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e05a4b2a-8e8d-4b67-95bb-8bf8b087d58d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:51.601445 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b82d550-4ccb-43b0-9266-4ef579638fe6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:51.606289 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b82d550-4ccb-43b0-9266-4ef579638fe6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:51.607058 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b82d550-4ccb-43b0-9266-4ef579638fe6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:51.617394 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e05a4b2a-8e8d-4b67-95bb-8bf8b087d58d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:51.619645 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b82d550-4ccb-43b0-9266-4ef579638fe6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:51.623434 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b82d550-4ccb-43b0-9266-4ef579638fe6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:51.626682 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e05a4b2a-8e8d-4b67-95bb-8bf8b087d58d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:51.627877 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e05a4b2a-8e8d-4b67-95bb-8bf8b087d58d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:51.628749 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b82d550-4ccb-43b0-9266-4ef579638fe6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:51.633816 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e05a4b2a-8e8d-4b67-95bb-8bf8b087d58d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:51.635184 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e05a4b2a-8e8d-4b67-95bb-8bf8b087d58d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:51.962944 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e05a4b2a-8e8d-4b67-95bb-8bf8b087d58d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:51.975205 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e05a4b2a-8e8d-4b67-95bb-8bf8b087d58d tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 200 len: 1468 microversion: 2.1 time: 0.438327 Aug 22 17:15:51.978370 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 505/1006] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:51 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 1468 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:51.988912 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-37d614a6-7025-40c7-8c57-f8b7943ad274 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80099f7790>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:52.062173 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-37d614a6-7025-40c7-8c57-f8b7943ad274 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a" status: 200 len: 1455 microversion: 2.1 time: 0.082342 Aug 22 17:15:52.063769 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 506/1007] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:15:51 2022] GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:52.365684 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9b82d550-4ccb-43b0-9266-4ef579638fe6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:52.377801 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9b82d550-4ccb-43b0-9266-4ef579638fe6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 200 len: 1468 microversion: 2.1 time: 0.822368 Aug 22 17:15:52.403111 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 502/1008] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:51 2022] GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 1468 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:15:52.407879 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-94552b3c-04bb-4327-b9d5-87131376af51 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:52.408768 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-94552b3c-04bb-4327-b9d5-87131376af51 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: fdf44444-5aec-46a8-a23a-d9d6621684a6] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:52.423986 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94552b3c-04bb-4327-b9d5-87131376af51 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:52.424755 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94552b3c-04bb-4327-b9d5-87131376af51 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:52.425443 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94552b3c-04bb-4327-b9d5-87131376af51 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:52.426586 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94552b3c-04bb-4327-b9d5-87131376af51 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:52.427240 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94552b3c-04bb-4327-b9d5-87131376af51 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:52.429771 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94552b3c-04bb-4327-b9d5-87131376af51 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:52.949737 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-94552b3c-04bb-4327-b9d5-87131376af51 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:52.967050 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-94552b3c-04bb-4327-b9d5-87131376af51 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6" status: 200 len: 1318 microversion: 2.1 time: 0.563932 Aug 22 17:15:52.970220 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 507/1009] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:52 2022] GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6 => generated 1318 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:52.996918 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-109983aa-ed84-4470-9939-70ff0dbfefd3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:53.001781 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-109983aa-ed84-4470-9939-70ff0dbfefd3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:53.007929 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:15:53.009671 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-109983aa-ed84-4470-9939-70ff0dbfefd3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:53.016444 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-109983aa-ed84-4470-9939-70ff0dbfefd3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:53.017318 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-109983aa-ed84-4470-9939-70ff0dbfefd3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:53.018311 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-109983aa-ed84-4470-9939-70ff0dbfefd3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:53.019004 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-109983aa-ed84-4470-9939-70ff0dbfefd3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:53.019662 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-109983aa-ed84-4470-9939-70ff0dbfefd3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:53.077671 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3b6acc48-6a0d-4b4f-b8e3-2503dca29a65 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80099e7ca0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:53.151253 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3b6acc48-6a0d-4b4f-b8e3-2503dca29a65 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a" status: 200 len: 1455 microversion: 2.1 time: 0.077395 Aug 22 17:15:53.152475 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 508/1010] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:15:53 2022] GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:15:53.993830 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-aaf9e2b7-6267-48e2-a145-1f08811763ca tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:53.994775 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-aaf9e2b7-6267-48e2-a145-1f08811763ca tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: fdf44444-5aec-46a8-a23a-d9d6621684a6] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:54.019457 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-aaf9e2b7-6267-48e2-a145-1f08811763ca tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:54.024143 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-aaf9e2b7-6267-48e2-a145-1f08811763ca tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:54.024618 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-aaf9e2b7-6267-48e2-a145-1f08811763ca tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:54.027940 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-aaf9e2b7-6267-48e2-a145-1f08811763ca tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:54.028425 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-aaf9e2b7-6267-48e2-a145-1f08811763ca tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:54.033618 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-aaf9e2b7-6267-48e2-a145-1f08811763ca tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:54.682112 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-aaf9e2b7-6267-48e2-a145-1f08811763ca tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:54.696990 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-aaf9e2b7-6267-48e2-a145-1f08811763ca tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6" status: 200 len: 1318 microversion: 2.1 time: 0.709473 Aug 22 17:15:54.704829 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 509/1011] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:53 2022] GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6 => generated 1318 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:15:54.725485 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-efa0ec5d-ec3a-42cd-951f-05fa0e95e564 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80099f7af0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:54.847271 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-efa0ec5d-ec3a-42cd-951f-05fa0e95e564 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a" status: 200 len: 1455 microversion: 2.1 time: 0.140405 Aug 22 17:15:54.847271 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 510/1012] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:15:54 2022] GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a => generated 1455 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:54.856747 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-f9a559f6-6f6f-4be4-a5f8-d62076568855 req-ca388059-a8e7-4fc0-a251-574a52a030e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf44444-5aec-46a8-a23a-d9d6621684a6", "name": "network-vif-plugged", "status": "completed", "tag": "2a775859-4ec3-400e-838a-c3566ff49e77"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:54.894980 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-f9a559f6-6f6f-4be4-a5f8-d62076568855 req-ca388059-a8e7-4fc0-a251-574a52a030e1 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:54.895642 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-f9a559f6-6f6f-4be4-a5f8-d62076568855 req-ca388059-a8e7-4fc0-a251-574a52a030e1 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:54.896191 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-f9a559f6-6f6f-4be4-a5f8-d62076568855 req-ca388059-a8e7-4fc0-a251-574a52a030e1 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:54.962789 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-f9a559f6-6f6f-4be4-a5f8-d62076568855 req-ca388059-a8e7-4fc0-a251-574a52a030e1 service nova] Creating event network-vif-plugged:2a775859-4ec3-400e-838a-c3566ff49e77 for instance fdf44444-5aec-46a8-a23a-d9d6621684a6 on n-h1-854030-1 Aug 22 17:15:54.989858 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-f9a559f6-6f6f-4be4-a5f8-d62076568855 req-ca388059-a8e7-4fc0-a251-574a52a030e1 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135900 Aug 22 17:15:54.991497 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 511/1013] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:55.105781 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-6db3ba7e-87a9-4c61-953f-9df685938fac req-44c1e080-351e-48f6-a93a-29cc0e95e199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30fb117d-2950-4ba7-98a0-fd8874ad006c", "name": "network-vif-deleted", "tag": "10a64f19-cca9-4d20-a741-bd1661b9f4ba"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:55.144367 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-6db3ba7e-87a9-4c61-953f-9df685938fac req-44c1e080-351e-48f6-a93a-29cc0e95e199 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:55.149267 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-6db3ba7e-87a9-4c61-953f-9df685938fac req-44c1e080-351e-48f6-a93a-29cc0e95e199 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:55.151127 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-6db3ba7e-87a9-4c61-953f-9df685938fac req-44c1e080-351e-48f6-a93a-29cc0e95e199 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:55.200646 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-6db3ba7e-87a9-4c61-953f-9df685938fac req-44c1e080-351e-48f6-a93a-29cc0e95e199 service nova] Creating event network-vif-deleted:10a64f19-cca9-4d20-a741-bd1661b9f4ba for instance 30fb117d-2950-4ba7-98a0-fd8874ad006c on n-h1-854030-1 Aug 22 17:15:55.213883 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-6db3ba7e-87a9-4c61-953f-9df685938fac req-44c1e080-351e-48f6-a93a-29cc0e95e199 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112479 Aug 22 17:15:55.215116 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 512/1014] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:15:55.222167 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-109983aa-ed84-4470-9939-70ff0dbfefd3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:55.243842 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-109983aa-ed84-4470-9939-70ff0dbfefd3 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 200 len: 1468 microversion: 2.1 time: 2.249645 Aug 22 17:15:55.263138 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 503/1015] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:52 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 1468 bytes in 2271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:55.730374 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f59c54f6-88c8-4919-bb7d-4e59bf2c037b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:55.735185 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f59c54f6-88c8-4919-bb7d-4e59bf2c037b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: fdf44444-5aec-46a8-a23a-d9d6621684a6] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:55.774788 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f59c54f6-88c8-4919-bb7d-4e59bf2c037b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:55.780651 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f59c54f6-88c8-4919-bb7d-4e59bf2c037b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:55.781524 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f59c54f6-88c8-4919-bb7d-4e59bf2c037b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:55.788703 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f59c54f6-88c8-4919-bb7d-4e59bf2c037b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:55.791755 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f59c54f6-88c8-4919-bb7d-4e59bf2c037b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:55.793752 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f59c54f6-88c8-4919-bb7d-4e59bf2c037b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:55.857623 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-88645926-275b-4002-a56f-17fa0de64a11 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009dccc10>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:56.191877 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f59c54f6-88c8-4919-bb7d-4e59bf2c037b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:56.204567 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f59c54f6-88c8-4919-bb7d-4e59bf2c037b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6" status: 200 len: 1318 microversion: 2.1 time: 0.485709 Aug 22 17:15:56.210997 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 513/1016] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:55 2022] GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6 => generated 1318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:56.552399 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9b530a2a-55ea-42a1-a6c5-becb8152ec24 tempest-ServersTestJSON-596067669 tempest-ServersTestJSON-596067669-project] Action: 'create', calling method: .version_select at 0x7f8009b31e50>, body: {"keypair": {"name": "tempest-keypair-2105019018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2BICAClyNVcPO33tjWMJuUrkvmTYYAQduDCnY6vKJRYy4qDJGUXtS6BWNTp+Ory46GkYTYdMT7brH2IzzjGHf08D0MklgcaNITTHeVxd1kRSkjaRcLLPTdKpxw2uWM3A=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:56.623935 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-9b530a2a-55ea-42a1-a6c5-becb8152ec24 tempest-ServersTestJSON-596067669 tempest-ServersTestJSON-596067669-project] Getting quotas for project 414e9ca965ec4fb7ba9b00484cf6a934. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:56.655378 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-9b530a2a-55ea-42a1-a6c5-becb8152ec24 tempest-ServersTestJSON-596067669 tempest-ServersTestJSON-596067669-project] Getting quotas for user d059f8dc3710447988a995024a13be72 and project 414e9ca965ec4fb7ba9b00484cf6a934. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:56.793720 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9b530a2a-55ea-42a1-a6c5-becb8152ec24 tempest-ServersTestJSON-596067669 tempest-ServersTestJSON-596067669-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.553952 Aug 22 17:15:56.811018 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 514/1017] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:15:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:56.816283 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-17828ba7-1e92-4ea2-88bc-f9704cf53b9c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:56.818223 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-17828ba7-1e92-4ea2-88bc-f9704cf53b9c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:56.844859 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-17828ba7-1e92-4ea2-88bc-f9704cf53b9c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:56.845455 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-17828ba7-1e92-4ea2-88bc-f9704cf53b9c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:56.845893 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-17828ba7-1e92-4ea2-88bc-f9704cf53b9c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:56.855571 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-17828ba7-1e92-4ea2-88bc-f9704cf53b9c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:56.857377 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-17828ba7-1e92-4ea2-88bc-f9704cf53b9c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:56.859039 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-17828ba7-1e92-4ea2-88bc-f9704cf53b9c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:56.922593 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-17828ba7-1e92-4ea2-88bc-f9704cf53b9c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:56.923475 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-17828ba7-1e92-4ea2-88bc-f9704cf53b9c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:56.924167 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-17828ba7-1e92-4ea2-88bc-f9704cf53b9c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:56.930408 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-17828ba7-1e92-4ea2-88bc-f9704cf53b9c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lazy-loading 'fault' on Instance uuid 30fb117d-2950-4ba7-98a0-fd8874ad006c {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:15:56.990596 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-17828ba7-1e92-4ea2-88bc-f9704cf53b9c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:56.998487 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-17828ba7-1e92-4ea2-88bc-f9704cf53b9c tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 200 len: 1303 microversion: 2.1 time: 0.186289 Aug 22 17:15:56.999728 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 515/1018] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:56 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 1303 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:57.005070 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8ca7b33c-9bec-41e1-a6c3-4ca946f85edc tempest-AttachSCSIVolumeTestJSON-645105604 tempest-AttachSCSIVolumeTestJSON-645105604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1731994032", "imageRef": "7aa57f83-23d6-412a-b211-2298ba192356", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "faac485f-e8e5-4e23-b104-e81acec615e8"}], "security_groups": [{"name": "tempest-securitygroup--1315637452"}], "key_name": "tempest-keypair-1912407289", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:57.479413 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-88645926-275b-4002-a56f-17fa0de64a11 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a" status: 200 len: 1455 microversion: 2.1 time: 1.627250 Aug 22 17:15:57.480023 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 504/1019] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:15:55 2022] GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a => generated 1455 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:15:57.617053 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-795af3bc-038c-4d18-a7c3-5cd998a6b807 tempest-ServersTestManualDisk-1647917615 tempest-ServersTestManualDisk-1647917615-project] Action: 'create', calling method: .version_select at 0x7f800a04e1f0>, body: {"keypair": {"name": "tempest-keypair-770755495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDp3I7iEc78Cv+7Nksz6jDPbw224kfZy4VbgVDztcpT4NJry6b4z5o7dP/iKW4yvjrnG2Jod1EPd8RcDhYY1Gn1zP2waKrB90Ala1OPYISf2q6jP/2oZnhCFhHcDlZNmg=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:57.650312 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-795af3bc-038c-4d18-a7c3-5cd998a6b807 tempest-ServersTestManualDisk-1647917615 tempest-ServersTestManualDisk-1647917615-project] Getting quotas for project 309ebb7af19d4c779afe50821b6d9913. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:57.655468 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-8ca7b33c-9bec-41e1-a6c3-4ca946f85edc tempest-AttachSCSIVolumeTestJSON-645105604 tempest-AttachSCSIVolumeTestJSON-645105604-project] validate_networks() for [('faac485f-e8e5-4e23-b104-e81acec615e8', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:15:57.674462 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-795af3bc-038c-4d18-a7c3-5cd998a6b807 tempest-ServersTestManualDisk-1647917615 tempest-ServersTestManualDisk-1647917615-project] Getting quotas for user 530ecc1482094183ac2f2c8de0e97eba and project 309ebb7af19d4c779afe50821b6d9913. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:57.822936 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-795af3bc-038c-4d18-a7c3-5cd998a6b807 tempest-ServersTestManualDisk-1647917615 tempest-ServersTestManualDisk-1647917615-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.340549 Aug 22 17:15:57.824124 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 505/1020] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:15:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:57.831084 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9396fca4-957d-47d4-9676-0ec673f167b6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:57.832327 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-9396fca4-957d-47d4-9676-0ec673f167b6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: fdf44444-5aec-46a8-a23a-d9d6621684a6] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:57.849032 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9396fca4-957d-47d4-9676-0ec673f167b6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:57.850680 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9396fca4-957d-47d4-9676-0ec673f167b6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:57.851455 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9396fca4-957d-47d4-9676-0ec673f167b6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:57.852392 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9396fca4-957d-47d4-9676-0ec673f167b6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:57.853027 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9396fca4-957d-47d4-9676-0ec673f167b6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:57.858065 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9396fca4-957d-47d4-9676-0ec673f167b6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-8ca7b33c-9bec-41e1-a6c3-4ca946f85edc tempest-AttachSCSIVolumeTestJSON-645105604 tempest-AttachSCSIVolumeTestJSON-645105604-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5f603584-c799-4032-858b-32940ddae10b) Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:15:58.068135 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:15:58.072406 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:15:58.072406 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:15:58.072406 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:15:58.072406 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:15:58.072406 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:15:58.072406 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:15:58.072406 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:15:58.072406 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:15:58.072406 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:15:58.072406 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:15:58.072406 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:15:58.072406 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:15:58.072406 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:15:58.072406 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:15:58.072406 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:15:58.072406 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5f603584-c799-4032-858b-32940ddae10b) Aug 22 17:15:58.072406 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:58.074526 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-8ca7b33c-9bec-41e1-a6c3-4ca946f85edc tempest-AttachSCSIVolumeTestJSON-645105604 tempest-AttachSCSIVolumeTestJSON-645105604-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:58.074526 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8ca7b33c-9bec-41e1-a6c3-4ca946f85edc tempest-AttachSCSIVolumeTestJSON-645105604 tempest-AttachSCSIVolumeTestJSON-645105604-project] Request method failure captured: Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 487 Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7l_UmLl-moS4PZBpK6a8IqWXeWMn2jMzqgCio-TLA9j9AHTTcGOp0dUGGK89pjxPlmj7csEu8l1gAamR7JufFON03odk8XZ9httQMIyQzq19HSjJyrhBVaCoRoSwBOpzJ-K3h7NYnUyBlTsfusueFJbnsPyuTdr-uMGVFCqZZFHDMo Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: f47afa16295c47d8817631e77478e561 Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-645105604 Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/f47afa16295c47d8817631e77478e561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_f47afa16295c47d8817631e77478e561", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/f47afa16295c47d8817631e77478e561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/f47afa16295c47d8817631e77478e561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-645105604 Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: f47afa16295c47d8817631e77478e561 Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-645105604 Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-AttachSCSIVolumeTestJSON-645105604-project Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: c364f76e875d428e8a88b07e1f49e09a Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-645105604-project Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1731994032", "imageRef": "7aa57f83-23d6-412a-b211-2298ba192356", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "faac485f-e8e5-4e23-b104-e81acec615e8"}], "security_groups": [{"name": "tempest-securitygroup--1315637452"}], "key_name": "tempest-keypair-1912407289", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-AttachSCSIVolumeTestJSON-server-1731994032', 'imageRef': '7aa57f83-23d6-412a-b211-2298ba192356', 'flavorRef': '452', 'config_drive': True, 'networks': [{'uuid': 'faac485f-e8e5-4e23-b104-e81acec615e8'}], 'security_groups': [{'name': 'tempest-securitygroup--1315637452'}], 'key_name': 'tempest-keypair-1912407289', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:15:58.079936 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5f603584-c799-4032-858b-32940ddae10b) Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:58.085002 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8ca7b33c-9bec-41e1-a6c3-4ca946f85edc tempest-AttachSCSIVolumeTestJSON-645105604 tempest-AttachSCSIVolumeTestJSON-645105604-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8ca7b33c-9bec-41e1-a6c3-4ca946f85edc tempest-AttachSCSIVolumeTestJSON-645105604 tempest-AttachSCSIVolumeTestJSON-645105604-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.086768 Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 516/1021] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:15:56 2022] POST /compute/v2.1/servers => generated 214 bytes in 1088 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:15:58.113835 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b738b949-5562-4f7e-8893-d21814795a3a tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Calling method '.version_select at 0x7f80096bdc10>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:58.182386 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b738b949-5562-4f7e-8893-d21814795a3a tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] 10.222.0.96 "GET /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a" status: 200 len: 637 microversion: 2.1 time: 0.091940 Aug 22 17:15:58.195756 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 517/1022] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:15:58 2022] GET /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a => generated 637 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:15:58.206571 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-94dca5b5-d148-4674-8c06-7acce3b31d73 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:58.207258 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-94dca5b5-d148-4674-8c06-7acce3b31d73 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: 30fb117d-2950-4ba7-98a0-fd8874ad006c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:58.223115 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94dca5b5-d148-4674-8c06-7acce3b31d73 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:58.225109 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94dca5b5-d148-4674-8c06-7acce3b31d73 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:58.225611 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94dca5b5-d148-4674-8c06-7acce3b31d73 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:58.226861 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94dca5b5-d148-4674-8c06-7acce3b31d73 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:58.228459 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94dca5b5-d148-4674-8c06-7acce3b31d73 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:58.228910 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-94dca5b5-d148-4674-8c06-7acce3b31d73 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:58.261625 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-94dca5b5-d148-4674-8c06-7acce3b31d73 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] HTTP exception thrown: Instance 30fb117d-2950-4ba7-98a0-fd8874ad006c could not be found. Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-94dca5b5-d148-4674-8c06-7acce3b31d73 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Request method failure captured: Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c HTTP/1.1 Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7k87sm7WV03FM7bZ8JjHyvQfPnVPLjS8igb88BLXVKmU_5cWSQLGEJGPSdMyWuitZn_vyOfy_MRB5UuFQaoEkCRZuXZwqy6IGsGpeN98b6g_VAprshPTrzwmmZdhYp3OkQB85942qKskPxRA_FIoWgy2xmo-4iwmpVti-FLjmF-gDI Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: c3d5a2fb6b4440168a7e84d03007a6fb Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-MigrationsAdminTest-1971141865 Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c3d5a2fb6b4440168a7e84d03007a6fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_c3d5a2fb6b4440168a7e84d03007a6fb", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c3d5a2fb6b4440168a7e84d03007a6fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/c3d5a2fb6b4440168a7e84d03007a6fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-MigrationsAdminTest-1971141865 Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: c3d5a2fb6b4440168a7e84d03007a6fb Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-MigrationsAdminTest-1971141865 Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-MigrationsAdminTest-1971141865-project Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: dafa41865864461fa0e0dbc4a0188e4b Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-MigrationsAdminTest-1971141865-project Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance 30fb117d-2950-4ba7-98a0-fd8874ad006c could not be found. Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '30fb117d-2950-4ba7-98a0-fd8874ad006c'} Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30fb117d-2950-4ba7-98a0-fd8874ad006c could not be found. Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30fb117d-2950-4ba7-98a0-fd8874ad006c could not be found. Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:15:58.263255 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:58.267458 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:15:58.267458 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:15:58.267458 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:15:58.267458 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:15:58.267458 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:15:58.267458 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30fb117d-2950-4ba7-98a0-fd8874ad006c could not be found. Aug 22 17:15:58.267458 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:15:58.267458 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-94dca5b5-d148-4674-8c06-7acce3b31d73 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Returning 404 to user: Instance 30fb117d-2950-4ba7-98a0-fd8874ad006c could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:15:58.267458 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-94dca5b5-d148-4674-8c06-7acce3b31d73 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c" status: 404 len: 111 microversion: 2.1 time: 0.067861 Aug 22 17:15:58.272791 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 518/1023] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:58 2022] GET /compute/v2.1/servers/30fb117d-2950-4ba7-98a0-fd8874ad006c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:15:58.283752 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-50eb7898-4c96-432d-8bce-984a4fb2136b tempest-AttachSCSIVolumeTestJSON-645105604 tempest-AttachSCSIVolumeTestJSON-645105604-project] Calling method '.version_select at 0x7f80099451f0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:58.418944 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-50eb7898-4c96-432d-8bce-984a4fb2136b tempest-AttachSCSIVolumeTestJSON-645105604 tempest-AttachSCSIVolumeTestJSON-645105604-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1912407289" status: 202 len: 0 microversion: 2.1 time: 0.141095 Aug 22 17:15:58.422682 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 519/1024] 10.222.0.96 () {58 vars in 1221 bytes} [Mon Aug 22 17:15:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1912407289 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:15:58.439944 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-87260efe-268f-4da8-9e85-e04f06624caf tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Action: 'update_all', calling method: .version_select at 0x7f80096e0310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:15:58.525492 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9396fca4-957d-47d4-9676-0ec673f167b6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:15:58.543803 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9396fca4-957d-47d4-9676-0ec673f167b6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6" status: 200 len: 1318 microversion: 2.1 time: 0.718335 Aug 22 17:15:58.544422 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 506/1025] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:57 2022] GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6 => generated 1318 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:58.558661 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8a764f43-178f-43ae-863b-4a2aa3048c32 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:58.559291 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-8a764f43-178f-43ae-863b-4a2aa3048c32 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:58.570859 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-87260efe-268f-4da8-9e85-e04f06624caf tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Getting quotas for project 3369ce66df59436ba024b3a1c14c221d. Resources: dict_keys(['metadata_items']) {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:15:58.621308 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-87260efe-268f-4da8-9e85-e04f06624caf tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Getting quotas for user 1545222f75fd44e6996de68aed405f14 and project 3369ce66df59436ba024b3a1c14c221d. Resources: dict_keys(['metadata_items']) {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:15:58.621689 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8a764f43-178f-43ae-863b-4a2aa3048c32 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:58.621689 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8a764f43-178f-43ae-863b-4a2aa3048c32 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:58.621689 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8a764f43-178f-43ae-863b-4a2aa3048c32 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:58.621689 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8a764f43-178f-43ae-863b-4a2aa3048c32 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:58.621689 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8a764f43-178f-43ae-863b-4a2aa3048c32 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:58.621689 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8a764f43-178f-43ae-863b-4a2aa3048c32 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:58.705963 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-8a764f43-178f-43ae-863b-4a2aa3048c32 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Going to try to terminate instance {{(pid=123016) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:15:59.575079 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-87260efe-268f-4da8-9e85-e04f06624caf tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] 10.222.0.96 "PUT /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata" status: 200 len: 61 microversion: 2.1 time: 1.154096 Aug 22 17:15:59.587541 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 520/1026] 10.222.0.96 () {60 vars in 1280 bytes} [Mon Aug 22 17:15:58 2022] PUT /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata => generated 61 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:15:59.593035 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f516b2cf-ae5a-4106-9478-a096e808615f tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80099454c0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:59.682762 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f516b2cf-ae5a-4106-9478-a096e808615f tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a" status: 200 len: 1455 microversion: 2.1 time: 0.093413 Aug 22 17:15:59.689522 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 521/1027] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:15:59 2022] GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:15:59.699211 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8ef90e93-801e-4e11-94aa-7231214f0d9e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:15:59.701788 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8ef90e93-801e-4e11-94aa-7231214f0d9e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: fdf44444-5aec-46a8-a23a-d9d6621684a6] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:15:59.718489 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8ef90e93-801e-4e11-94aa-7231214f0d9e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:59.718489 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8ef90e93-801e-4e11-94aa-7231214f0d9e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:59.718489 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8ef90e93-801e-4e11-94aa-7231214f0d9e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:59.719031 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8ef90e93-801e-4e11-94aa-7231214f0d9e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:15:59.723696 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8ef90e93-801e-4e11-94aa-7231214f0d9e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:15:59.726180 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8ef90e93-801e-4e11-94aa-7231214f0d9e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:15:59.793484 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8a764f43-178f-43ae-863b-4a2aa3048c32 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "DELETE /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 204 len: 0 microversion: 2.1 time: 1.247681 Aug 22 17:15:59.794089 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 507/1028] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:15:58 2022] DELETE /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 0 bytes in 1249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:15:59.800858 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ef94c8f2-fcc0-41fc-bb9a-5563dd25d32c tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Calling method '.version_select at 0x7f8009fbdf70>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:00.474233 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8ef90e93-801e-4e11-94aa-7231214f0d9e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:00.497236 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8ef90e93-801e-4e11-94aa-7231214f0d9e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6" status: 200 len: 1468 microversion: 2.1 time: 0.804899 Aug 22 17:16:00.528933 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 522/1029] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:15:59 2022] GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6 => generated 1468 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:00.542175 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ef94c8f2-fcc0-41fc-bb9a-5563dd25d32c tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] 10.222.0.96 "DELETE /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.746589 Aug 22 17:16:00.543672 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 508/1030] 10.222.0.96 () {58 vars in 1296 bytes} [Mon Aug 22 17:15:59 2022] DELETE /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata/os_version => generated 0 bytes in 749 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:16:00.554901 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fa545b75-3b1b-4d32-83ee-ea5083d3e2f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:00.556493 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8c66d08e-a888-4830-a615-aef11cbcb4e2 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:00.563585 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8c66d08e-a888-4830-a615-aef11cbcb4e2 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:00.575935 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-fa545b75-3b1b-4d32-83ee-ea5083d3e2f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:00.578086 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-fa545b75-3b1b-4d32-83ee-ea5083d3e2f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Searching by: {'reservation_id': 'r-r3sxkzd0', 'deleted': False, 'project_id': 'd789047469894e1fbe5af3a109a95b4c'} {{(pid=123016) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 22 17:16:00.591997 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8c66d08e-a888-4830-a615-aef11cbcb4e2 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:00.597376 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8c66d08e-a888-4830-a615-aef11cbcb4e2 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:00.600154 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8c66d08e-a888-4830-a615-aef11cbcb4e2 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:00.603409 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8c66d08e-a888-4830-a615-aef11cbcb4e2 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:00.605847 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8c66d08e-a888-4830-a615-aef11cbcb4e2 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:00.613803 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8c66d08e-a888-4830-a615-aef11cbcb4e2 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:00.614065 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa545b75-3b1b-4d32-83ee-ea5083d3e2f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:00.615334 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa545b75-3b1b-4d32-83ee-ea5083d3e2f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:00.616011 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa545b75-3b1b-4d32-83ee-ea5083d3e2f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:00.616816 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa545b75-3b1b-4d32-83ee-ea5083d3e2f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:00.627619 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa545b75-3b1b-4d32-83ee-ea5083d3e2f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:00.628613 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa545b75-3b1b-4d32-83ee-ea5083d3e2f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:00.946950 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.multi_cell_list [None req-fa545b75-3b1b-4d32-83ee-ea5083d3e2f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 22 17:16:01.152116 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-fa545b75-3b1b-4d32-83ee-ea5083d3e2f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:01.183479 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa545b75-3b1b-4d32-83ee-ea5083d3e2f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:01.184030 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa545b75-3b1b-4d32-83ee-ea5083d3e2f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:01.188270 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa545b75-3b1b-4d32-83ee-ea5083d3e2f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:01.519432 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8c66d08e-a888-4830-a615-aef11cbcb4e2 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:01.533745 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8c66d08e-a888-4830-a615-aef11cbcb4e2 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1466 microversion: 2.1 time: 1.002053 Aug 22 17:16:01.534509 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 523/1031] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:00 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1466 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:01.542430 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b5abf18c-f2d2-4394-b940-135ccd2eee70 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Calling method '.version_select at 0x7f8009692b80>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:01.643842 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b5abf18c-f2d2-4394-b940-135ccd2eee70 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] 10.222.0.96 "GET /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata" status: 200 len: 37 microversion: 2.1 time: 0.108046 Aug 22 17:16:01.645183 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 524/1032] 10.222.0.96 () {58 vars in 1260 bytes} [Mon Aug 22 17:16:01 2022] GET /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata => generated 37 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:16:01.650159 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-175fb05a-f055-4839-8bb4-c627f9e86326 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f800972c9d0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:01.666290 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-fa545b75-3b1b-4d32-83ee-ea5083d3e2f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/detail?reservation_id=r-r3sxkzd0" status: 200 len: 2929 microversion: 2.1 time: 1.121076 Aug 22 17:16:01.667449 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 509/1033] 10.222.0.96 () {58 vars in 1197 bytes} [Mon Aug 22 17:16:00 2022] GET /compute/v2.1/servers/detail?reservation_id=r-r3sxkzd0 => generated 2929 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:01.688696 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d49fe9e2-06fa-410e-b7a4-d0c26bd38a26 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Action: 'update_all', calling method: .version_select at 0x7f800a4e8700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:01.808082 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-175fb05a-f055-4839-8bb4-c627f9e86326 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a" status: 200 len: 1455 microversion: 2.1 time: 0.159208 Aug 22 17:16:01.817492 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 525/1034] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:01 2022] GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a => generated 1455 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:01.832044 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-eb933bc0-2532-492d-b2f5-ca09fe181072 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:01.835962 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-d49fe9e2-06fa-410e-b7a4-d0c26bd38a26 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Getting quotas for project 3369ce66df59436ba024b3a1c14c221d. Resources: dict_keys(['metadata_items']) {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:01.857942 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-d49fe9e2-06fa-410e-b7a4-d0c26bd38a26 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Getting quotas for user 1545222f75fd44e6996de68aed405f14 and project 3369ce66df59436ba024b3a1c14c221d. Resources: dict_keys(['metadata_items']) {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:01.883345 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.compute.server_groups [None req-eb933bc0-2532-492d-b2f5-ca09fe181072 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Querying cell 0e788ee0-d5b8-44d6-b202-c201e1b338b4(cell1) for 2 instances {{(pid=123015) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 22 17:16:01.884543 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eb933bc0-2532-492d-b2f5-ca09fe181072 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:01.885318 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eb933bc0-2532-492d-b2f5-ca09fe181072 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:01.887765 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eb933bc0-2532-492d-b2f5-ca09fe181072 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:01.913423 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-eb933bc0-2532-492d-b2f5-ca09fe181072 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/os-server-groups/22e6357f-c720-4967-967a-94f0a2aafff8" status: 200 len: 271 microversion: 2.1 time: 0.092774 Aug 22 17:16:01.914546 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 526/1035] 10.222.0.96 () {58 vars in 1263 bytes} [Mon Aug 22 17:16:01 2022] GET /compute/v2.1/os-server-groups/22e6357f-c720-4967-967a-94f0a2aafff8 => generated 271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:16:01.928036 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-13e69302-60d8-43bf-8c84-1dafff80027d tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:01.928979 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-13e69302-60d8-43bf-8c84-1dafff80027d tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:01.943315 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-13e69302-60d8-43bf-8c84-1dafff80027d tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:01.944417 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-13e69302-60d8-43bf-8c84-1dafff80027d tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:01.945028 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-13e69302-60d8-43bf-8c84-1dafff80027d tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:01.945997 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-13e69302-60d8-43bf-8c84-1dafff80027d tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:01.946631 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-13e69302-60d8-43bf-8c84-1dafff80027d tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:01.947360 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-13e69302-60d8-43bf-8c84-1dafff80027d tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:02.435404 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d49fe9e2-06fa-410e-b7a4-d0c26bd38a26 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] 10.222.0.96 "PUT /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.766647 Aug 22 17:16:02.439459 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 510/1036] 10.222.0.96 () {60 vars in 1280 bytes} [Mon Aug 22 17:16:01 2022] PUT /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata => generated 61 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:16:02.450108 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-51b627fb-575b-422e-84ee-7fa2956db84a tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Calling method '.version_select at 0x7f8009fb0430>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:02.508422 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-51b627fb-575b-422e-84ee-7fa2956db84a tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] 10.222.0.96 "GET /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.062506 Aug 22 17:16:02.512187 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 511/1037] 10.222.0.96 () {58 vars in 1290 bytes} [Mon Aug 22 17:16:02 2022] GET /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata/os_distro => generated 33 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 22 17:16:02.524928 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-459f98c7-7bc0-441c-b232-6d28900ead3b tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Action: 'update_all', calling method: .version_select at 0x7f8009ddea60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:02.572917 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-13e69302-60d8-43bf-8c84-1dafff80027d tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 200 len: 1619 microversion: 2.1 time: 0.651404 Aug 22 17:16:02.577126 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 527/1038] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:01 2022] GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 1619 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:02.592337 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-926800dd-1806-4da1-9af4-71b88a2ee110 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:02.593782 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-926800dd-1806-4da1-9af4-71b88a2ee110 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:02.608453 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-926800dd-1806-4da1-9af4-71b88a2ee110 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:02.611333 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-459f98c7-7bc0-441c-b232-6d28900ead3b tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Getting quotas for project 3369ce66df59436ba024b3a1c14c221d. Resources: dict_keys(['metadata_items']) {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:02.618058 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-926800dd-1806-4da1-9af4-71b88a2ee110 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:02.618058 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-926800dd-1806-4da1-9af4-71b88a2ee110 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:02.618058 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-926800dd-1806-4da1-9af4-71b88a2ee110 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:02.621569 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-926800dd-1806-4da1-9af4-71b88a2ee110 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:02.622382 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-926800dd-1806-4da1-9af4-71b88a2ee110 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:02.624453 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-459f98c7-7bc0-441c-b232-6d28900ead3b tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Getting quotas for user 1545222f75fd44e6996de68aed405f14 and project 3369ce66df59436ba024b3a1c14c221d. Resources: dict_keys(['metadata_items']) {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:02.866204 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-459f98c7-7bc0-441c-b232-6d28900ead3b tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] 10.222.0.96 "PUT /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.345404 Aug 22 17:16:02.866829 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 512/1039] 10.222.0.96 () {60 vars in 1280 bytes} [Mon Aug 22 17:16:02 2022] PUT /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata => generated 61 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 22 17:16:02.875342 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b5f49a51-8982-4e9d-830b-f71a970bc432 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:02.882518 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b5f49a51-8982-4e9d-830b-f71a970bc432 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] [instance: fdf44444-5aec-46a8-a23a-d9d6621684a6] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:02.901759 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b5f49a51-8982-4e9d-830b-f71a970bc432 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:02.901759 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b5f49a51-8982-4e9d-830b-f71a970bc432 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:02.901759 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b5f49a51-8982-4e9d-830b-f71a970bc432 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:02.902086 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b5f49a51-8982-4e9d-830b-f71a970bc432 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:02.902593 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b5f49a51-8982-4e9d-830b-f71a970bc432 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:02.903208 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b5f49a51-8982-4e9d-830b-f71a970bc432 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:03.270476 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-926800dd-1806-4da1-9af4-71b88a2ee110 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:03.280571 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-926800dd-1806-4da1-9af4-71b88a2ee110 tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1466 microversion: 2.1 time: 0.698523 Aug 22 17:16:03.301185 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 528/1040] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:02 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1466 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:03.307564 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7106df6c-ced3-458f-a9a3-8f92777131fa tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80096e0700>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:03.433322 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7106df6c-ced3-458f-a9a3-8f92777131fa tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a" status: 200 len: 1464 microversion: 2.1 time: 0.130630 Aug 22 17:16:03.434501 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 529/1041] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:03 2022] GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a => generated 1464 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:03.441480 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6f679221-71a6-4a19-aed7-d8c2eaa231cb tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Calling method '.version_select at 0x7f8009d1d1f0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:03.508215 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b5f49a51-8982-4e9d-830b-f71a970bc432 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6" status: 200 len: 1619 microversion: 2.1 time: 0.636985 Aug 22 17:16:03.511826 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 513/1042] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:02 2022] GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6 => generated 1619 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:03.522417 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d0b94d05-c789-4108-9a87-66c66ab333af tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009fbddc0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:03.543811 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6f679221-71a6-4a19-aed7-d8c2eaa231cb tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] 10.222.0.96 "GET /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.105919 Aug 22 17:16:03.545024 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 530/1043] 10.222.0.96 () {58 vars in 1260 bytes} [Mon Aug 22 17:16:03 2022] GET /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata => generated 61 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:16:03.556672 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-795a12a8-e245-4f73-b90a-6f356e4fab8d tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Action: 'update_all', calling method: .version_select at 0x7f8009e67670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:03.765067 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d0b94d05-c789-4108-9a87-66c66ab333af tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a" status: 200 len: 1464 microversion: 2.1 time: 0.248873 Aug 22 17:16:03.769556 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 514/1044] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:03 2022] GET /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a => generated 1464 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:03.772170 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-795a12a8-e245-4f73-b90a-6f356e4fab8d tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Getting quotas for project 3369ce66df59436ba024b3a1c14c221d. Resources: dict_keys(['metadata_items']) {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:03.797137 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-52a4bdeb-d4ec-44ec-835e-2e9c7bde7212 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1594794620", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "de1802ae-582c-4cc0-bda9-86b08d26493f"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:03.801281 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:03.806941 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-795a12a8-e245-4f73-b90a-6f356e4fab8d tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Getting quotas for user 1545222f75fd44e6996de68aed405f14 and project 3369ce66df59436ba024b3a1c14c221d. Resources: dict_keys(['metadata_items']) {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:03.948857 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-52a4bdeb-d4ec-44ec-835e-2e9c7bde7212 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] validate_networks() for None {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:16:04.151422 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-795a12a8-e245-4f73-b90a-6f356e4fab8d tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] 10.222.0.96 "PUT /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.599421 Aug 22 17:16:04.152726 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 531/1045] 10.222.0.96 () {60 vars in 1280 bytes} [Mon Aug 22 17:16:03 2022] PUT /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata => generated 61 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 22 17:16:04.173875 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-30fd5f82-8838-468c-ac91-a425da18a464 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:04.174790 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-30fd5f82-8838-468c-ac91-a425da18a464 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: b9d1e79a-48e9-436e-a233-7a950de59886] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:04.185906 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-30fd5f82-8838-468c-ac91-a425da18a464 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:04.186617 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-30fd5f82-8838-468c-ac91-a425da18a464 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:04.187154 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-30fd5f82-8838-468c-ac91-a425da18a464 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:04.188875 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-30fd5f82-8838-468c-ac91-a425da18a464 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:04.190385 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-30fd5f82-8838-468c-ac91-a425da18a464 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:04.222451 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-30fd5f82-8838-468c-ac91-a425da18a464 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:04.626450 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-52a4bdeb-d4ec-44ec-835e-2e9c7bde7212 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:16:04.627078 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-52a4bdeb-d4ec-44ec-835e-2e9c7bde7212 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:16:04.627341 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-52a4bdeb-d4ec-44ec-835e-2e9c7bde7212 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:16:04.628258 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-52a4bdeb-d4ec-44ec-835e-2e9c7bde7212 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:16:04.628845 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-52a4bdeb-d4ec-44ec-835e-2e9c7bde7212 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:16:04.645665 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-30fd5f82-8838-468c-ac91-a425da18a464 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:04.649787 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-52a4bdeb-d4ec-44ec-835e-2e9c7bde7212 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:04.650358 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-52a4bdeb-d4ec-44ec-835e-2e9c7bde7212 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:04.650809 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-52a4bdeb-d4ec-44ec-835e-2e9c7bde7212 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:04.651611 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-52a4bdeb-d4ec-44ec-835e-2e9c7bde7212 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:04.652073 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-52a4bdeb-d4ec-44ec-835e-2e9c7bde7212 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:04.652504 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-52a4bdeb-d4ec-44ec-835e-2e9c7bde7212 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:04.660479 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-30fd5f82-8838-468c-ac91-a425da18a464 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886" status: 200 len: 1467 microversion: 2.1 time: 0.506437 Aug 22 17:16:04.662381 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 532/1046] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:04 2022] GET /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886 => generated 1467 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:04.675860 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-aa82d0c8-4b1d-4c25-8c58-e64cc7802335 req-bf057d5a-82ec-474d-9ce2-deaca521d358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd420da2-ec4b-4d15-82d1-0f09c4072a7f", "name": "network-vif-deleted", "tag": "369ba085-ae5d-43b8-9cdb-93f3e47cedd5"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:04.698609 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-aa82d0c8-4b1d-4c25-8c58-e64cc7802335 req-bf057d5a-82ec-474d-9ce2-deaca521d358 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:04.700019 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-aa82d0c8-4b1d-4c25-8c58-e64cc7802335 req-bf057d5a-82ec-474d-9ce2-deaca521d358 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:04.700647 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-aa82d0c8-4b1d-4c25-8c58-e64cc7802335 req-bf057d5a-82ec-474d-9ce2-deaca521d358 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:04.714280 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-aa82d0c8-4b1d-4c25-8c58-e64cc7802335 req-bf057d5a-82ec-474d-9ce2-deaca521d358 service nova] Creating event network-vif-deleted:369ba085-ae5d-43b8-9cdb-93f3e47cedd5 for instance fd420da2-ec4b-4d15-82d1-0f09c4072a7f on n-h2-854030-1 Aug 22 17:16:04.719334 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-52a4bdeb-d4ec-44ec-835e-2e9c7bde7212 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for project d789047469894e1fbe5af3a109a95b4c. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:04.721981 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-aa82d0c8-4b1d-4c25-8c58-e64cc7802335 req-bf057d5a-82ec-474d-9ce2-deaca521d358 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057969 Aug 22 17:16:04.723598 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 533/1047] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:16:04.726971 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-52a4bdeb-d4ec-44ec-835e-2e9c7bde7212 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for user 43188026fda44118ad642b7065108966 and project d789047469894e1fbe5af3a109a95b4c. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:04.730790 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f8fd1779-b6e8-470c-92f8-703bc4fdf839 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Action: 'update_all', calling method: .version_select at 0x7f80095fc9d0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:04.773607 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-52a4bdeb-d4ec-44ec-835e-2e9c7bde7212 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Going to run 1 instances... {{(pid=123016) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:16:04.778233 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-52a4bdeb-d4ec-44ec-835e-2e9c7bde7212 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:16:04.801550 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-f8fd1779-b6e8-470c-92f8-703bc4fdf839 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Getting quotas for project 3369ce66df59436ba024b3a1c14c221d. Resources: dict_keys(['metadata_items']) {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:04.820679 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-f8fd1779-b6e8-470c-92f8-703bc4fdf839 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Getting quotas for user 1545222f75fd44e6996de68aed405f14 and project 3369ce66df59436ba024b3a1c14c221d. Resources: dict_keys(['metadata_items']) {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:04.986737 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-52a4bdeb-d4ec-44ec-835e-2e9c7bde7212 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.212960 Aug 22 17:16:04.993929 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 515/1048] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:16:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:16:05.012172 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-200fe16f-c4ba-4b03-b514-2c8e0ef45447 tempest-ServersTestJSON-596067669 tempest-ServersTestJSON-596067669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1473927363", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "181d4f4a-8ad4-4c70-9ee0-04672fac81b8"}], "security_groups": [{"name": "tempest-securitygroup--1512689878"}], "key_name": "tempest-keypair-2105019018", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:05.382045 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f8fd1779-b6e8-470c-92f8-703bc4fdf839 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] 10.222.0.96 "PUT /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata" status: 200 len: 64 microversion: 2.1 time: 0.656302 Aug 22 17:16:05.383076 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 534/1049] 10.222.0.96 () {60 vars in 1280 bytes} [Mon Aug 22 17:16:04 2022] PUT /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata => generated 64 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:16:05.397014 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d74e032f-bc73-4f05-bad4-e607191aa95e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:05.398260 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d74e032f-bc73-4f05-bad4-e607191aa95e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:05.407672 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d74e032f-bc73-4f05-bad4-e607191aa95e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:05.409290 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d74e032f-bc73-4f05-bad4-e607191aa95e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:05.409290 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d74e032f-bc73-4f05-bad4-e607191aa95e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:05.410208 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d74e032f-bc73-4f05-bad4-e607191aa95e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:05.410888 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d74e032f-bc73-4f05-bad4-e607191aa95e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:05.411695 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d74e032f-bc73-4f05-bad4-e607191aa95e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:05.466594 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-200fe16f-c4ba-4b03-b514-2c8e0ef45447 tempest-ServersTestJSON-596067669 tempest-ServersTestJSON-596067669-project] validate_networks() for [('181d4f4a-8ad4-4c70-9ee0-04672fac81b8', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:16:05.468435 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d74e032f-bc73-4f05-bad4-e607191aa95e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:05.468934 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d74e032f-bc73-4f05-bad4-e607191aa95e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:05.473382 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d74e032f-bc73-4f05-bad4-e607191aa95e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:05.473382 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-d74e032f-bc73-4f05-bad4-e607191aa95e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lazy-loading 'fault' on Instance uuid fd420da2-ec4b-4d15-82d1-0f09c4072a7f {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:16:05.559276 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d74e032f-bc73-4f05-bad4-e607191aa95e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafa41865864461fa0e0dbc4a0188e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5a2fb6b4440168a7e84d03007a6fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:05.570150 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d74e032f-bc73-4f05-bad4-e607191aa95e tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 200 len: 1301 microversion: 2.1 time: 0.184994 Aug 22 17:16:05.587468 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 535/1050] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:05 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 1301 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:05.599914 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d90550d3-c9d3-4e86-a5b8-ffd72b724d8d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1141292563"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:05.609195 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d90550d3-c9d3-4e86-a5b8-ffd72b724d8d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:05.627071 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d90550d3-c9d3-4e86-a5b8-ffd72b724d8d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:05.627579 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d90550d3-c9d3-4e86-a5b8-ffd72b724d8d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:05.634101 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d90550d3-c9d3-4e86-a5b8-ffd72b724d8d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:05.634101 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d90550d3-c9d3-4e86-a5b8-ffd72b724d8d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:05.634101 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d90550d3-c9d3-4e86-a5b8-ffd72b724d8d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:05.634101 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d90550d3-c9d3-4e86-a5b8-ffd72b724d8d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:06.050268 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=100 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-200fe16f-c4ba-4b03-b514-2c8e0ef45447 tempest-ServersTestJSON-596067669 tempest-ServersTestJSON-596067669-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-97d34010-1ab0-4aec-a733-13f8cf5261fd) Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:16:06.124571 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:16:06.132742 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:16:06.132742 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:16:06.132742 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:16:06.132742 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:16:06.132742 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:16:06.132742 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:16:06.132742 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:16:06.132742 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:16:06.132742 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:16:06.132742 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:16:06.132742 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:16:06.132742 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:16:06.132742 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:16:06.132742 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:16:06.132742 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-97d34010-1ab0-4aec-a733-13f8cf5261fd) Aug 22 17:16:06.132742 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:06.132742 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-200fe16f-c4ba-4b03-b514-2c8e0ef45447 tempest-ServersTestJSON-596067669 tempest-ServersTestJSON-596067669-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:06.132742 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-200fe16f-c4ba-4b03-b514-2c8e0ef45447 tempest-ServersTestJSON-596067669 tempest-ServersTestJSON-596067669-project] Request method failure captured: Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 633 Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7nMvQ_OJuREaPs9C3bUIQmVnwLF6DtkVWGx8ClMSwVN2e6lLIIC9dB8jqq7pUM80wmYo5vd0VddOrxFFzMwOGQTdL6kGZSzlzYxqr_7xubZy6GO0wte_De6j00CWgAa-nNarLGTMdNci2qnntc0A6gWQ0PJaa64sWjcnhbm8a2ZXUA Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 414e9ca965ec4fb7ba9b00484cf6a934 Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServersTestJSON-596067669 Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/414e9ca965ec4fb7ba9b00484cf6a934"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_414e9ca965ec4fb7ba9b00484cf6a934", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/414e9ca965ec4fb7ba9b00484cf6a934"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/414e9ca965ec4fb7ba9b00484cf6a934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServersTestJSON-596067669 Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 414e9ca965ec4fb7ba9b00484cf6a934 Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServersTestJSON-596067669 Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServersTestJSON-596067669-project Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: d059f8dc3710447988a995024a13be72 Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServersTestJSON-596067669-project Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-ServersTestJSON-server-1473927363", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "J8!g6++z=!Ykus_", "networks": [{"uuid": "181d4f4a-8ad4-4c70-9ee0-04672fac81b8"}], "security_groups": [{"name": "tempest-securitygroup--1512689878"}], "key_name": "tempest-keypair-2105019018", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "AUTO"}} Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-1473927363', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'metadata': {'hello': 'world'}, 'adminPass': 'J8!g6++z=!Ykus_', 'networks': [{'uuid': '181d4f4a-8ad4-4c70-9ee0-04672fac81b8'}], 'security_groups': [{'name': 'tempest-securitygroup--1512689878'}], 'key_name': 'tempest-keypair-2105019018', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:16:06.137035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-97d34010-1ab0-4aec-a733-13f8cf5261fd) Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:06.147372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-200fe16f-c4ba-4b03-b514-2c8e0ef45447 tempest-ServersTestJSON-596067669 tempest-ServersTestJSON-596067669-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-200fe16f-c4ba-4b03-b514-2c8e0ef45447 tempest-ServersTestJSON-596067669 tempest-ServersTestJSON-596067669-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.139993 Aug 22 17:16:06.153027 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 516/1051] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:16:04 2022] POST /compute/v2.1/servers => generated 214 bytes in 1143 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:16:06.158877 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-745fe1f3-e0b0-46c3-8fe9-3a85663994d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:06.158877 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-745fe1f3-e0b0-46c3-8fe9-3a85663994d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:06.291235 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-745fe1f3-e0b0-46c3-8fe9-3a85663994d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:06.311732 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-745fe1f3-e0b0-46c3-8fe9-3a85663994d7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef" status: 200 len: 1217 microversion: 2.1 time: 0.167737 Aug 22 17:16:06.314268 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 517/1052] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:06 2022] GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:06.342804 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d90550d3-c9d3-4e86-a5b8-ffd72b724d8d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "POST /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838/action" status: 202 len: 0 microversion: 2.1 time: 0.746605 Aug 22 17:16:06.352579 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 536/1053] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:16:05 2022] POST /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838/action => generated 0 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 22 17:16:06.358735 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f3430cf8-36c0-466c-ac88-6a14a19fb368 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Calling method '.version_select at 0x7f8009dde3a0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:06.380113 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-82644db8-816f-4a20-9103-8c2bd036736f req-11bfd8ce-2537-46b1-94a2-932f7e83b36c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d1e79a-48e9-436e-a233-7a950de59886", "name": "network-vif-unplugged", "status": "completed", "tag": "6f8bb3a8-685e-4d62-8584-0402c1743657"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:06.405876 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-82644db8-816f-4a20-9103-8c2bd036736f req-11bfd8ce-2537-46b1-94a2-932f7e83b36c service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:06.406532 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-82644db8-816f-4a20-9103-8c2bd036736f req-11bfd8ce-2537-46b1-94a2-932f7e83b36c service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:06.410647 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-82644db8-816f-4a20-9103-8c2bd036736f req-11bfd8ce-2537-46b1-94a2-932f7e83b36c service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:06.439551 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f3430cf8-36c0-466c-ac88-6a14a19fb368 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] 10.222.0.96 "GET /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata" status: 200 len: 64 microversion: 2.1 time: 0.122679 Aug 22 17:16:06.440375 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 518/1054] 10.222.0.96 () {58 vars in 1260 bytes} [Mon Aug 22 17:16:06 2022] GET /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata => generated 64 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:16:06.466104 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-add875c5-9dce-4bfa-a777-bdbf83608413 tempest-ServersTestJSON-596067669 tempest-ServersTestJSON-596067669-project] Calling method '.version_select at 0x7f8009da9160>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:06.467994 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-82644db8-816f-4a20-9103-8c2bd036736f req-11bfd8ce-2537-46b1-94a2-932f7e83b36c service nova] Creating event network-vif-unplugged:6f8bb3a8-685e-4d62-8584-0402c1743657 for instance b9d1e79a-48e9-436e-a233-7a950de59886 on n-h2-854030-1 Aug 22 17:16:06.479095 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-82644db8-816f-4a20-9103-8c2bd036736f req-11bfd8ce-2537-46b1-94a2-932f7e83b36c service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124637 Aug 22 17:16:06.487695 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 537/1055] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:16:06.507167 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-92b75f21-8bb8-49d3-bd5e-55ae8fa564d0 tempest-ServersTestManualDisk-1647917615 tempest-ServersTestManualDisk-1647917615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1457231762", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7306950a-86ac-4c77-8e20-25b398f01bd3"}], "security_groups": [{"name": "tempest-securitygroup--1002002052"}], "key_name": "tempest-keypair-770755495", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:06.585511 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-add875c5-9dce-4bfa-a777-bdbf83608413 tempest-ServersTestJSON-596067669 tempest-ServersTestJSON-596067669-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105019018" status: 202 len: 0 microversion: 2.1 time: 0.141161 Aug 22 17:16:06.586380 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 519/1056] 10.222.0.96 () {58 vars in 1221 bytes} [Mon Aug 22 17:16:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105019018 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:16:06.600578 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-cf5ab769-0840-4734-bb2f-6d48d0dad7e6 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f800a075160>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:06.654763 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-cf5ab769-0840-4734-bb2f-6d48d0dad7e6 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.067454 Aug 22 17:16:06.655609 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 520/1057] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:06 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:06.660530 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e6ca79d9-2110-479b-b120-4ba87e58facf tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Action: 'update_all', calling method: .version_select at 0x7f8009aa8550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:06.719367 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-e6ca79d9-2110-479b-b120-4ba87e58facf tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Getting quotas for project 3369ce66df59436ba024b3a1c14c221d. Resources: dict_keys(['metadata_items']) {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:06.728320 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-e6ca79d9-2110-479b-b120-4ba87e58facf tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Getting quotas for user 1545222f75fd44e6996de68aed405f14 and project 3369ce66df59436ba024b3a1c14c221d. Resources: dict_keys(['metadata_items']) {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:06.935466 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-92b75f21-8bb8-49d3-bd5e-55ae8fa564d0 tempest-ServersTestManualDisk-1647917615 tempest-ServersTestManualDisk-1647917615-project] validate_networks() for [('7306950a-86ac-4c77-8e20-25b398f01bd3', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:16:07.184313 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e6ca79d9-2110-479b-b120-4ba87e58facf tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] 10.222.0.96 "PUT /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.527326 Aug 22 17:16:07.185715 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 521/1058] 10.222.0.96 () {60 vars in 1280 bytes} [Mon Aug 22 17:16:06 2022] PUT /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata => generated 61 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:16:07.191196 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1650804b-b43a-411a-ba77-fb725a7e61cd tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:07.192666 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-1650804b-b43a-411a-ba77-fb725a7e61cd tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] [instance: fd420da2-ec4b-4d15-82d1-0f09c4072a7f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:07.212397 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1650804b-b43a-411a-ba77-fb725a7e61cd tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:07.222999 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1650804b-b43a-411a-ba77-fb725a7e61cd tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:07.222999 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1650804b-b43a-411a-ba77-fb725a7e61cd tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:07.222999 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1650804b-b43a-411a-ba77-fb725a7e61cd tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:07.222999 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1650804b-b43a-411a-ba77-fb725a7e61cd tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:07.222999 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1650804b-b43a-411a-ba77-fb725a7e61cd tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:07.235427 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-1650804b-b43a-411a-ba77-fb725a7e61cd tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] HTTP exception thrown: Instance fd420da2-ec4b-4d15-82d1-0f09c4072a7f could not be found. Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1650804b-b43a-411a-ba77-fb725a7e61cd tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Request method failure captured: Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f HTTP/1.1 Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7k87sm7WV03FM7bZ8JjHyvQfPnVPLjS8igb88BLXVKmU_5cWSQLGEJGPSdMyWuitZn_vyOfy_MRB5UuFQaoEkCRZuXZwqy6IGsGpeN98b6g_VAprshPTrzwmmZdhYp3OkQB85942qKskPxRA_FIoWgy2xmo-4iwmpVti-FLjmF-gDI Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: c3d5a2fb6b4440168a7e84d03007a6fb Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-MigrationsAdminTest-1971141865 Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c3d5a2fb6b4440168a7e84d03007a6fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_c3d5a2fb6b4440168a7e84d03007a6fb", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c3d5a2fb6b4440168a7e84d03007a6fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/c3d5a2fb6b4440168a7e84d03007a6fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-MigrationsAdminTest-1971141865 Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: c3d5a2fb6b4440168a7e84d03007a6fb Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-MigrationsAdminTest-1971141865 Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-MigrationsAdminTest-1971141865-project Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: dafa41865864461fa0e0dbc4a0188e4b Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-MigrationsAdminTest-1971141865-project Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance fd420da2-ec4b-4d15-82d1-0f09c4072a7f could not be found. Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'fd420da2-ec4b-4d15-82d1-0f09c4072a7f'} Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd420da2-ec4b-4d15-82d1-0f09c4072a7f could not be found. Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd420da2-ec4b-4d15-82d1-0f09c4072a7f could not be found. Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:16:07.239308 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:07.247022 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:07.247022 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:16:07.247022 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:16:07.247022 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:16:07.247022 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:16:07.247022 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd420da2-ec4b-4d15-82d1-0f09c4072a7f could not be found. Aug 22 17:16:07.247022 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:07.250117 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1650804b-b43a-411a-ba77-fb725a7e61cd tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] Returning 404 to user: Instance fd420da2-ec4b-4d15-82d1-0f09c4072a7f could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:16:07.252246 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1650804b-b43a-411a-ba77-fb725a7e61cd tempest-MigrationsAdminTest-1971141865 tempest-MigrationsAdminTest-1971141865-project] 10.222.0.96 "GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f" status: 404 len: 111 microversion: 2.1 time: 0.065075 Aug 22 17:16:07.253492 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 522/1059] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:07 2022] GET /compute/v2.1/servers/fd420da2-ec4b-4d15-82d1-0f09c4072a7f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:16:07.297351 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f7637147-3af3-4861-b76e-a7b4da0f9dbf tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Action: 'update', calling method: .version_select at 0x7f800a15b940>, body: {"meta": {"os_version": "alt"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:07.442607 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-f7637147-3af3-4861-b76e-a7b4da0f9dbf tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Getting quotas for project 3369ce66df59436ba024b3a1c14c221d. Resources: dict_keys(['metadata_items']) {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:07.454380 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-f7637147-3af3-4861-b76e-a7b4da0f9dbf tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Getting quotas for user 1545222f75fd44e6996de68aed405f14 and project 3369ce66df59436ba024b3a1c14c221d. Resources: dict_keys(['metadata_items']) {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-92b75f21-8bb8-49d3-bd5e-55ae8fa564d0 tempest-ServersTestManualDisk-1647917615 tempest-ServersTestManualDisk-1647917615-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b10ba067-423b-42fc-9aff-8b794f06638f) Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:16:07.471538 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b10ba067-423b-42fc-9aff-8b794f06638f) Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-92b75f21-8bb8-49d3-bd5e-55ae8fa564d0 tempest-ServersTestManualDisk-1647917615 tempest-ServersTestManualDisk-1647917615-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-92b75f21-8bb8-49d3-bd5e-55ae8fa564d0 tempest-ServersTestManualDisk-1647917615 tempest-ServersTestManualDisk-1647917615-project] Request method failure captured: Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 640 Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7nMcS8WbHuJnDjuoTSzAuDlUAqxTkpLVgDVHfHg90aO2miysgymX_hBIb5-3GqsUWpCYqpiBTtCDyvOxCiMvKUehLQIBmF3EmJWNOgLvCuMiua4W-a8T9_KfZrqbk0vK75TrP5ijgDDax8VkpAlr05orUBPEA4OmFnfPtrPmE5NMiE Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 309ebb7af19d4c779afe50821b6d9913 Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersTestManualDisk-1647917615 Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/309ebb7af19d4c779afe50821b6d9913"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_309ebb7af19d4c779afe50821b6d9913", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/309ebb7af19d4c779afe50821b6d9913"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/309ebb7af19d4c779afe50821b6d9913"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersTestManualDisk-1647917615 Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 309ebb7af19d4c779afe50821b6d9913 Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersTestManualDisk-1647917615 Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersTestManualDisk-1647917615-project Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 530ecc1482094183ac2f2c8de0e97eba Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersTestManualDisk-1647917615-project Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ServersTestManualDisk-server-1457231762", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "R6%k1UFJbAylLo0", "networks": [{"uuid": "7306950a-86ac-4c77-8e20-25b398f01bd3"}], "security_groups": [{"name": "tempest-securitygroup--1002002052"}], "key_name": "tempest-keypair-770755495", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "MANUAL"}} Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:16:07.476618 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ServersTestManualDisk-server-1457231762', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'metadata': {'hello': 'world'}, 'adminPass': 'R6%k1UFJbAylLo0', 'networks': [{'uuid': '7306950a-86ac-4c77-8e20-25b398f01bd3'}], 'security_groups': [{'name': 'tempest-securitygroup--1002002052'}], 'key_name': 'tempest-keypair-770755495', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:16:07.485577 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b10ba067-423b-42fc-9aff-8b794f06638f) Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-92b75f21-8bb8-49d3-bd5e-55ae8fa564d0 tempest-ServersTestManualDisk-1647917615 tempest-ServersTestManualDisk-1647917615-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-92b75f21-8bb8-49d3-bd5e-55ae8fa564d0 tempest-ServersTestManualDisk-1647917615 tempest-ServersTestManualDisk-1647917615-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.005692 Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 538/1060] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:16:06 2022] POST /compute/v2.1/servers => generated 214 bytes in 1010 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:16:07.504241 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2620e1ab-23e1-4e95-b64d-387f429bb381 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:07.514632 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-2620e1ab-23e1-4e95-b64d-387f429bb381 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:07.527393 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2620e1ab-23e1-4e95-b64d-387f429bb381 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:07.527883 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2620e1ab-23e1-4e95-b64d-387f429bb381 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:07.528314 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2620e1ab-23e1-4e95-b64d-387f429bb381 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:07.529014 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2620e1ab-23e1-4e95-b64d-387f429bb381 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:07.538851 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2620e1ab-23e1-4e95-b64d-387f429bb381 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:07.539316 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2620e1ab-23e1-4e95-b64d-387f429bb381 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:07.700844 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-2620e1ab-23e1-4e95-b64d-387f429bb381 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:07.717873 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2620e1ab-23e1-4e95-b64d-387f429bb381 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef" status: 200 len: 1269 microversion: 2.1 time: 0.217773 Aug 22 17:16:07.718782 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 539/1061] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:07 2022] GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef => generated 1269 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:07.723516 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-aae0e6da-0160-4573-8f20-e6eedde1d5ca tempest-ServersTestManualDisk-1647917615 tempest-ServersTestManualDisk-1647917615-project] Calling method '.version_select at 0x7f8009d1d4c0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:07.832686 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-aae0e6da-0160-4573-8f20-e6eedde1d5ca tempest-ServersTestManualDisk-1647917615 tempest-ServersTestManualDisk-1647917615-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-770755495" status: 202 len: 0 microversion: 2.1 time: 0.112741 Aug 22 17:16:07.833303 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 540/1062] 10.222.0.96 () {58 vars in 1218 bytes} [Mon Aug 22 17:16:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-770755495 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:16:07.839800 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-340ff04f-c437-44bb-9985-0b3ec6de8f6e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009945a60>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:07.939232 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f7637147-3af3-4861-b76e-a7b4da0f9dbf tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] 10.222.0.96 "PUT /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.678102 Aug 22 17:16:07.939232 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 523/1063] 10.222.0.96 () {60 vars in 1313 bytes} [Mon Aug 22 17:16:07 2022] PUT /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata/os_version => generated 31 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:16:07.940543 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-340ff04f-c437-44bb-9985-0b3ec6de8f6e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.105424 Aug 22 17:16:07.941340 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 541/1064] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:07 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:07.945576 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0b9ad574-ba33-4511-bfe7-72a8aa295b0c tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Calling method '.version_select at 0x7f800a075040>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:07.990578 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0b9ad574-ba33-4511-bfe7-72a8aa295b0c tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] 10.222.0.96 "GET /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata" status: 200 len: 58 microversion: 2.1 time: 0.048489 Aug 22 17:16:07.991942 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 524/1065] 10.222.0.96 () {58 vars in 1260 bytes} [Mon Aug 22 17:16:07 2022] GET /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata => generated 58 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 22 17:16:08.004482 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5a493706-b90f-4844-a364-625c93d84392 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Action: 'update_all', calling method: .version_select at 0x7f80099f7af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:08.063014 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-5a493706-b90f-4844-a364-625c93d84392 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Getting quotas for project 3369ce66df59436ba024b3a1c14c221d. Resources: dict_keys(['metadata_items']) {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:08.071285 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-5a493706-b90f-4844-a364-625c93d84392 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Getting quotas for user 1545222f75fd44e6996de68aed405f14 and project 3369ce66df59436ba024b3a1c14c221d. Resources: dict_keys(['metadata_items']) {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:08.720039 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f2881d13-4020-40dc-b3d2-763833191c20 tempest-FloatingIPDetailsNegativeTestJSON-12355897 tempest-FloatingIPDetailsNegativeTestJSON-12355897-project] Calling method '.version_select at 0x7f8009eb01f0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:08.795264 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5a493706-b90f-4844-a364-625c93d84392 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] 10.222.0.96 "PUT /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.794566 Aug 22 17:16:08.800520 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 542/1066] 10.222.0.96 () {60 vars in 1280 bytes} [Mon Aug 22 17:16:07 2022] PUT /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata => generated 61 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:16:08.806120 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c64bc7c1-ab48-4f24-8508-f48a84c42db6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:08.806992 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-c64bc7c1-ab48-4f24-8508-f48a84c42db6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:08.813609 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c64bc7c1-ab48-4f24-8508-f48a84c42db6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:08.814412 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c64bc7c1-ab48-4f24-8508-f48a84c42db6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:08.815089 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c64bc7c1-ab48-4f24-8508-f48a84c42db6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:08.816005 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c64bc7c1-ab48-4f24-8508-f48a84c42db6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:08.816666 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c64bc7c1-ab48-4f24-8508-f48a84c42db6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:08.817326 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c64bc7c1-ab48-4f24-8508-f48a84c42db6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:08.884318 n-d-854030-1 devstack@n-api.service[123016]: DEBUG neutronclient.v2_0.client [None req-f2881d13-4020-40dc-b3d2-763833191c20 tempest-FloatingIPDetailsNegativeTestJSON-12355897 tempest-FloatingIPDetailsNegativeTestJSON-12355897-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a18f6266-26c1-4e05-bfe0-e8b1604bfb2b could not be found", "detail": ""}} {{(pid=123016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-f2881d13-4020-40dc-b3d2-763833191c20 tempest-FloatingIPDetailsNegativeTestJSON-12355897 tempest-FloatingIPDetailsNegativeTestJSON-12355897-project] HTTP exception thrown: Floating IP not found for ID a18f6266-26c1-4e05-bfe0-e8b1604bfb2b Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f2881d13-4020-40dc-b3d2-763833191c20 tempest-FloatingIPDetailsNegativeTestJSON-12355897 tempest-FloatingIPDetailsNegativeTestJSON-12355897-project] Request method failure captured: Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-floating-ips/a18f6266-26c1-4e05-bfe0-e8b1604bfb2b HTTP/1.1 Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7nYADwXDYXEpVb_GkGd3XyV_2n7EhVgXGcsVT2RQMUjaKef-ygpFcqeN-Wx9YB3dVVT2Svyr3uPgH5EXMoBzEPl6jdWJN3HRAlU2yunl-poH6WejV-If_IRfwCL_l6EUbtJgiA4c_uDbZR6hH1ciLhddP2FhLHtis3BacrCk_a9R2A Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 7bf9413a93bb41bda82f2f62ccd889e0 Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-12355897 Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7bf9413a93bb41bda82f2f62ccd889e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7bf9413a93bb41bda82f2f62ccd889e0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7bf9413a93bb41bda82f2f62ccd889e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7bf9413a93bb41bda82f2f62ccd889e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-12355897 Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 7bf9413a93bb41bda82f2f62ccd889e0 Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-12355897 Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-12355897-project Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 8616e9fa7454470b9c33ecd42e2c895e Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-12355897-project Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: exception: Floating IP not found for ID a18f6266-26c1-4e05-bfe0-e8b1604bfb2b Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'a18f6266-26c1-4e05-bfe0-e8b1604bfb2b'} Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 22 17:16:08.889610 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a18f6266-26c1-4e05-bfe0-e8b1604bfb2b could not be found Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e546b93-c03b-4fee-afb7-96156133bde7'] Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a18f6266-26c1-4e05-bfe0-e8b1604bfb2b. Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a18f6266-26c1-4e05-bfe0-e8b1604bfb2b Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a18f6266-26c1-4e05-bfe0-e8b1604bfb2b Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f2881d13-4020-40dc-b3d2-763833191c20 tempest-FloatingIPDetailsNegativeTestJSON-12355897 tempest-FloatingIPDetailsNegativeTestJSON-12355897-project] Returning 404 to user: Floating IP not found for ID a18f6266-26c1-4e05-bfe0-e8b1604bfb2b {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:16:08.894591 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f2881d13-4020-40dc-b3d2-763833191c20 tempest-FloatingIPDetailsNegativeTestJSON-12355897 tempest-FloatingIPDetailsNegativeTestJSON-12355897-project] 10.222.0.96 "GET /compute/v2.1/os-floating-ips/a18f6266-26c1-4e05-bfe0-e8b1604bfb2b" status: 404 len: 111 microversion: 2.1 time: 0.415480 Aug 22 17:16:08.897983 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 525/1067] 10.222.0.96 () {58 vars in 1260 bytes} [Mon Aug 22 17:16:08 2022] GET /compute/v2.1/os-floating-ips/a18f6266-26c1-4e05-bfe0-e8b1604bfb2b => generated 111 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:16:08.909901 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8d9e8879-103b-44af-8330-7fd5fc65a909 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Action: 'create', calling method: .version_select at 0x7f8009eb05e0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:08.994249 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-8d9e8879-103b-44af-8330-7fd5fc65a909 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Getting quotas for project 3369ce66df59436ba024b3a1c14c221d. Resources: dict_keys(['metadata_items']) {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:09.000858 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-8d9e8879-103b-44af-8330-7fd5fc65a909 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Getting quotas for user 1545222f75fd44e6996de68aed405f14 and project 3369ce66df59436ba024b3a1c14c221d. Resources: dict_keys(['metadata_items']) {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:09.375424 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c64bc7c1-ab48-4f24-8508-f48a84c42db6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:09.384628 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c64bc7c1-ab48-4f24-8508-f48a84c42db6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef" status: 200 len: 1287 microversion: 2.1 time: 0.582928 Aug 22 17:16:09.385412 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 543/1068] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:08 2022] GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef => generated 1287 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:09.390584 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d8aa90f8-6690-43cb-a3b8-48593527b3dd tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009945040>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:09.475936 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d8aa90f8-6690-43cb-a3b8-48593527b3dd tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.087236 Aug 22 17:16:09.482410 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8d9e8879-103b-44af-8330-7fd5fc65a909 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] 10.222.0.96 "POST /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata" status: 200 len: 85 microversion: 2.1 time: 0.584152 Aug 22 17:16:09.487603 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 526/1069] 10.222.0.96 () {60 vars in 1281 bytes} [Mon Aug 22 17:16:08 2022] POST /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata => generated 85 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:16:09.494141 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 544/1070] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:09 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:09.495462 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e3cb8748-c93f-49c6-ad99-d12a4a3f7163 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] Calling method '.version_select at 0x7f800a0754c0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:09.558131 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e3cb8748-c93f-49c6-ad99-d12a4a3f7163 tempest-ImagesMetadataTestJSON-938056317 tempest-ImagesMetadataTestJSON-938056317-project] 10.222.0.96 "GET /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata" status: 200 len: 85 microversion: 2.1 time: 0.069186 Aug 22 17:16:09.559965 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 527/1071] 10.222.0.96 () {58 vars in 1260 bytes} [Mon Aug 22 17:16:09 2022] GET /compute/v2.1/images/ced26548-bfdd-4b70-9d6d-a5ee0c7f1e4a/metadata => generated 85 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:16:10.416042 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a514108f-b24e-4719-92fe-84200afaa371 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:10.418078 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a514108f-b24e-4719-92fe-84200afaa371 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:10.438515 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a514108f-b24e-4719-92fe-84200afaa371 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:10.439774 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a514108f-b24e-4719-92fe-84200afaa371 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:10.444529 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a514108f-b24e-4719-92fe-84200afaa371 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:10.446160 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a514108f-b24e-4719-92fe-84200afaa371 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:10.447027 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a514108f-b24e-4719-92fe-84200afaa371 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:10.448039 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a514108f-b24e-4719-92fe-84200afaa371 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:10.492303 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b442040b-2151-4013-b62e-e42e74088a9d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009eb09d0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:10.655756 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b442040b-2151-4013-b62e-e42e74088a9d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.168578 Aug 22 17:16:10.656413 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 528/1072] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:10 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:11.191958 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a514108f-b24e-4719-92fe-84200afaa371 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:11.202766 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a514108f-b24e-4719-92fe-84200afaa371 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef" status: 200 len: 1317 microversion: 2.1 time: 0.793667 Aug 22 17:16:11.219246 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 545/1073] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:10 2022] GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef => generated 1317 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:11.676205 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5d5d0a73-8777-4598-ab21-96245027c77c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f800a193e50>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:11.760099 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5d5d0a73-8777-4598-ab21-96245027c77c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.090743 Aug 22 17:16:11.764690 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 529/1074] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:11 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:12.233406 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f0ae1811-7b49-4106-a77b-73d6966aa8f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:12.234107 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f0ae1811-7b49-4106-a77b-73d6966aa8f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:12.253616 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f0ae1811-7b49-4106-a77b-73d6966aa8f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:12.254117 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f0ae1811-7b49-4106-a77b-73d6966aa8f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:12.254612 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f0ae1811-7b49-4106-a77b-73d6966aa8f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:12.255356 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f0ae1811-7b49-4106-a77b-73d6966aa8f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:12.255817 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f0ae1811-7b49-4106-a77b-73d6966aa8f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:12.256243 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f0ae1811-7b49-4106-a77b-73d6966aa8f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:12.565769 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-7415ee7b-b9cf-45c5-9ad9-e4f835428b56 req-45e5c1b7-8c16-4366-b7cf-8a30e76654e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef", "tag": "b352d2eb-caa0-497b-9514-da6f7dd81bb0"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:12.576984 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:12.587690 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-7415ee7b-b9cf-45c5-9ad9-e4f835428b56 req-45e5c1b7-8c16-4366-b7cf-8a30e76654e4 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:12.597622 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-7415ee7b-b9cf-45c5-9ad9-e4f835428b56 req-45e5c1b7-8c16-4366-b7cf-8a30e76654e4 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:12.599286 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-7415ee7b-b9cf-45c5-9ad9-e4f835428b56 req-45e5c1b7-8c16-4366-b7cf-8a30e76654e4 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:12.648746 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-7415ee7b-b9cf-45c5-9ad9-e4f835428b56 req-45e5c1b7-8c16-4366-b7cf-8a30e76654e4 service nova] Creating event network-changed:b352d2eb-caa0-497b-9514-da6f7dd81bb0 for instance 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef on n-h1-854030-1 Aug 22 17:16:12.667358 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-7415ee7b-b9cf-45c5-9ad9-e4f835428b56 req-45e5c1b7-8c16-4366-b7cf-8a30e76654e4 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101084 Aug 22 17:16:12.668448 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 530/1075] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:16:12.780814 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-64d1e083-e822-42e7-bf14-fa09324effdf tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009aa8ee0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:13.223562 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-64d1e083-e822-42e7-bf14-fa09324effdf tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.447366 Aug 22 17:16:13.224916 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 531/1076] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:12 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:16:13.718354 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f0ae1811-7b49-4106-a77b-73d6966aa8f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:13.774862 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f0ae1811-7b49-4106-a77b-73d6966aa8f3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef" status: 200 len: 1317 microversion: 2.1 time: 1.546872 Aug 22 17:16:13.785731 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 546/1077] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:12 2022] GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef => generated 1317 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:14.240327 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-3393223b-bba3-4daf-982f-363b3e3162f2 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f800a04eaf0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:14.397110 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-3393223b-bba3-4daf-982f-363b3e3162f2 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.161503 Aug 22 17:16:14.399277 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 532/1078] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:14 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:14.805839 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-669dbf8f-c0f1-46da-b0fb-6ea0bb89a88d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:14.817668 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-669dbf8f-c0f1-46da-b0fb-6ea0bb89a88d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:14.823957 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-669dbf8f-c0f1-46da-b0fb-6ea0bb89a88d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:14.826913 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-669dbf8f-c0f1-46da-b0fb-6ea0bb89a88d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:14.827821 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-669dbf8f-c0f1-46da-b0fb-6ea0bb89a88d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:14.830589 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-669dbf8f-c0f1-46da-b0fb-6ea0bb89a88d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:14.831635 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-669dbf8f-c0f1-46da-b0fb-6ea0bb89a88d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:14.832514 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-669dbf8f-c0f1-46da-b0fb-6ea0bb89a88d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:14.956675 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:14.964432 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-bede5251-3b9b-4610-84f6-390f2aff4322 req-a4368b58-f8d2-4f96-ad0a-94e1fa0064aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9699e0-8054-4491-91a6-2d8e34898838", "name": "network-vif-plugged", "status": "completed", "tag": "0bc75a5b-a857-42d1-be9e-f441f5aad90b"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:15.003677 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-bede5251-3b9b-4610-84f6-390f2aff4322 req-a4368b58-f8d2-4f96-ad0a-94e1fa0064aa service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:15.011355 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-bede5251-3b9b-4610-84f6-390f2aff4322 req-a4368b58-f8d2-4f96-ad0a-94e1fa0064aa service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:15.018312 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-bede5251-3b9b-4610-84f6-390f2aff4322 req-a4368b58-f8d2-4f96-ad0a-94e1fa0064aa service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:15.074721 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-bede5251-3b9b-4610-84f6-390f2aff4322 req-a4368b58-f8d2-4f96-ad0a-94e1fa0064aa service nova] Creating event network-vif-plugged:0bc75a5b-a857-42d1-be9e-f441f5aad90b for instance 8a9699e0-8054-4491-91a6-2d8e34898838 on n-h2-854030-1 Aug 22 17:16:15.099284 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-bede5251-3b9b-4610-84f6-390f2aff4322 req-a4368b58-f8d2-4f96-ad0a-94e1fa0064aa service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143252 Aug 22 17:16:15.100168 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 533/1079] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:16:15.417773 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e516bf3c-a420-4176-89b9-6f6329853282 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f800a04e0d0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:15.530521 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e516bf3c-a420-4176-89b9-6f6329853282 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.120459 Aug 22 17:16:15.535948 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 534/1080] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:15 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:16.557579 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-26d535da-95e2-49e5-bc1b-7546ab89a618 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009dde1f0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:16.622426 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-26d535da-95e2-49e5-bc1b-7546ab89a618 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.075996 Aug 22 17:16:16.625105 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 535/1081] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:16 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:17.154680 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-669dbf8f-c0f1-46da-b0fb-6ea0bb89a88d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:17.165568 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-669dbf8f-c0f1-46da-b0fb-6ea0bb89a88d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef" status: 200 len: 1317 microversion: 2.1 time: 2.366071 Aug 22 17:16:17.166161 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 547/1082] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:14 2022] GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef => generated 1317 bytes in 2368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:17.212973 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-56385ca6-6e4b-4876-a7c5-fdcbb07cae08 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1610147021", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:17.369551 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-56385ca6-6e4b-4876-a7c5-fdcbb07cae08 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] validate_networks() for None {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:16:17.638884 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-48d09f06-7310-4ea7-8086-70a4a45a1bd7 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009692d30>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:17.725724 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-48d09f06-7310-4ea7-8086-70a4a45a1bd7 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.091056 Aug 22 17:16:17.734310 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 548/1083] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:17 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:16:18.083666 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=24 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:18.106672 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e84d7c4d-1fd3-479b-911e-f457ff61b445 tempest-QuotaClassesAdminTestJSON-1302496366 tempest-QuotaClassesAdminTestJSON-1302496366-project-admin] Calling method '.version_select at 0x7f80099e75e0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:18.107755 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:16:18.107755 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:16:18.136947 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e84d7c4d-1fd3-479b-911e-f457ff61b445 tempest-QuotaClassesAdminTestJSON-1302496366 tempest-QuotaClassesAdminTestJSON-1302496366-project-admin] 10.222.0.96 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.283461 Aug 22 17:16:18.137581 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 549/1084] 10.222.0.96 () {58 vars in 1185 bytes} [Mon Aug 22 17:16:17 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:16:18.150835 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-aa5b8dad-b665-4a61-bd47-868ea60fb785 tempest-QuotaClassesAdminTestJSON-1302496366 tempest-QuotaClassesAdminTestJSON-1302496366-project-admin] Action: 'update', calling method: .version_select at 0x7f800972c9d0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:18.160721 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:16:18.160721 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:16:19.013594 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=34 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:19.094588 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-56385ca6-6e4b-4876-a7c5-fdcbb07cae08 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:16:19.097320 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-56385ca6-6e4b-4876-a7c5-fdcbb07cae08 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:16:19.098379 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-56385ca6-6e4b-4876-a7c5-fdcbb07cae08 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:16:19.099953 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-56385ca6-6e4b-4876-a7c5-fdcbb07cae08 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:16:19.109335 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-56385ca6-6e4b-4876-a7c5-fdcbb07cae08 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:16:19.147105 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-56385ca6-6e4b-4876-a7c5-fdcbb07cae08 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:19.147838 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-56385ca6-6e4b-4876-a7c5-fdcbb07cae08 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:19.149044 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-56385ca6-6e4b-4876-a7c5-fdcbb07cae08 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:19.160952 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-56385ca6-6e4b-4876-a7c5-fdcbb07cae08 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:19.160952 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-56385ca6-6e4b-4876-a7c5-fdcbb07cae08 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:19.162770 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-56385ca6-6e4b-4876-a7c5-fdcbb07cae08 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:19.188416 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:19.207000 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-56385ca6-6e4b-4876-a7c5-fdcbb07cae08 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Getting quotas for project 81a86484222946699be05f1087e2d005. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:19.213848 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-56385ca6-6e4b-4876-a7c5-fdcbb07cae08 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Getting quotas for user c2367b6e03a249b69e17156366ebbb53 and project 81a86484222946699be05f1087e2d005. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:19.228329 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-56385ca6-6e4b-4876-a7c5-fdcbb07cae08 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Going to run 1 instances... {{(pid=123016) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:16:19.250370 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-56385ca6-6e4b-4876-a7c5-fdcbb07cae08 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:16:19.447714 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-56385ca6-6e4b-4876-a7c5-fdcbb07cae08 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.765831 Aug 22 17:16:19.448404 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 536/1085] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:16:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:16:19.463684 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fe350d2a-e41a-4cb6-839e-b265737fbc20 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:19.468500 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-fe350d2a-e41a-4cb6-839e-b265737fbc20 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:19.484012 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fe350d2a-e41a-4cb6-839e-b265737fbc20 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:19.484510 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fe350d2a-e41a-4cb6-839e-b265737fbc20 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:19.484948 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fe350d2a-e41a-4cb6-839e-b265737fbc20 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:19.488303 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fe350d2a-e41a-4cb6-839e-b265737fbc20 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:19.488806 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fe350d2a-e41a-4cb6-839e-b265737fbc20 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:19.489310 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fe350d2a-e41a-4cb6-839e-b265737fbc20 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:19.934924 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:UPDATE=12,nova_api:INSERT=7 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:19.962916 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-aa5b8dad-b665-4a61-bd47-868ea60fb785 tempest-QuotaClassesAdminTestJSON-1302496366 tempest-QuotaClassesAdminTestJSON-1302496366-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.812125 Aug 22 17:16:19.974432 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 550/1086] 10.222.0.96 () {60 vars in 1206 bytes} [Mon Aug 22 17:16:18 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:16:19.983298 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0e64fcb3-b2c8-4c40-b4cd-1a9fb186ee45 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80096e00d0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:19.993437 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-fe350d2a-e41a-4cb6-839e-b265737fbc20 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:20.006810 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-fe350d2a-e41a-4cb6-839e-b265737fbc20 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef" status: 200 len: 1317 microversion: 2.1 time: 0.554589 Aug 22 17:16:20.026043 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 537/1087] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:19 2022] GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:20.033219 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-348e38cd-039f-402a-9f07-539bb78bf87b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:20.034507 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-348e38cd-039f-402a-9f07-539bb78bf87b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:20.089674 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0e64fcb3-b2c8-4c40-b4cd-1a9fb186ee45 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.113482 Aug 22 17:16:20.092846 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 551/1088] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:19 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:20.104617 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-70a68311-76bf-4a4c-a512-0bfe85f778bd tempest-QuotaClassesAdminTestJSON-1302496366 tempest-QuotaClassesAdminTestJSON-1302496366-project-admin] Calling method '.version_select at 0x7f80099f7af0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:20.123711 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-70a68311-76bf-4a4c-a512-0bfe85f778bd tempest-QuotaClassesAdminTestJSON-1302496366 tempest-QuotaClassesAdminTestJSON-1302496366-project-admin] 10.222.0.96 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.029604 Aug 22 17:16:20.134220 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 552/1089] 10.222.0.96 () {58 vars in 1185 bytes} [Mon Aug 22 17:16:20 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:16:20.146083 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-348e38cd-039f-402a-9f07-539bb78bf87b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:20.154183 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d0ece80f-867b-456a-843e-8d6baa0723e6 tempest-QuotaClassesAdminTestJSON-1302496366 tempest-QuotaClassesAdminTestJSON-1302496366-project-admin] Action: 'update', calling method: .version_select at 0x7f80096923a0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:20.160681 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-348e38cd-039f-402a-9f07-539bb78bf87b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1217 microversion: 2.1 time: 0.128350 Aug 22 17:16:20.164487 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 538/1090] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:20 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1217 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:21.245338 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-abd0a223-4748-4343-9dce-c7f63ebf204e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:21.245338 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-abd0a223-4748-4343-9dce-c7f63ebf204e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:21.245338 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-abd0a223-4748-4343-9dce-c7f63ebf204e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:21.245338 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-abd0a223-4748-4343-9dce-c7f63ebf204e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:21.245338 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-abd0a223-4748-4343-9dce-c7f63ebf204e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:21.245338 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-abd0a223-4748-4343-9dce-c7f63ebf204e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:21.245338 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-abd0a223-4748-4343-9dce-c7f63ebf204e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:21.245338 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-abd0a223-4748-4343-9dce-c7f63ebf204e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:21.245338 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-abd0a223-4748-4343-9dce-c7f63ebf204e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:21.245338 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-abd0a223-4748-4343-9dce-c7f63ebf204e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef" status: 200 len: 1317 microversion: 2.1 time: 0.162978 Aug 22 17:16:21.245338 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 539/1091] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:21 2022] GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:21.245338 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c277fb6e-463a-48f2-88b1-f70b308ba96d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009be84c0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:21.255557 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c277fb6e-463a-48f2-88b1-f70b308ba96d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.059804 Aug 22 17:16:21.256366 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 540/1092] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:21 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:21.261785 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2352cdeb-ae6a-4963-80a0-0b09924f8107 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:21.262684 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-2352cdeb-ae6a-4963-80a0-0b09924f8107 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:21.321205 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-2352cdeb-ae6a-4963-80a0-0b09924f8107 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:21.328606 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2352cdeb-ae6a-4963-80a0-0b09924f8107 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1217 microversion: 2.1 time: 0.071169 Aug 22 17:16:21.333481 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 541/1093] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:21 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:22.257265 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-11ef218c-47bf-44de-8eb9-d3f0aaa1d059 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:22.258715 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-11ef218c-47bf-44de-8eb9-d3f0aaa1d059 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:22.270837 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-11ef218c-47bf-44de-8eb9-d3f0aaa1d059 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:22.271689 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-11ef218c-47bf-44de-8eb9-d3f0aaa1d059 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:22.273346 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-11ef218c-47bf-44de-8eb9-d3f0aaa1d059 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:22.274708 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-11ef218c-47bf-44de-8eb9-d3f0aaa1d059 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:22.275405 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-11ef218c-47bf-44de-8eb9-d3f0aaa1d059 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:22.276145 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-11ef218c-47bf-44de-8eb9-d3f0aaa1d059 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:22.436978 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d0ece80f-867b-456a-843e-8d6baa0723e6 tempest-QuotaClassesAdminTestJSON-1302496366 tempest-QuotaClassesAdminTestJSON-1302496366-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 2.301048 Aug 22 17:16:22.445711 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 553/1094] 10.222.0.96 () {60 vars in 1206 bytes} [Mon Aug 22 17:16:20 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 2310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:16:22.464373 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-56c25e70-51af-4659-ad59-8ea741214c0d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009945d30>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:22.562550 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-56c25e70-51af-4659-ad59-8ea741214c0d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.113732 Aug 22 17:16:22.563308 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 554/1095] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:22 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:22.582042 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fa0da0bc-1ef0-4b7a-9c8a-a72ddbf9dec3 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:22.586027 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-fa0da0bc-1ef0-4b7a-9c8a-a72ddbf9dec3 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:22.602100 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fa0da0bc-1ef0-4b7a-9c8a-a72ddbf9dec3 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:22.603624 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fa0da0bc-1ef0-4b7a-9c8a-a72ddbf9dec3 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:22.604279 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fa0da0bc-1ef0-4b7a-9c8a-a72ddbf9dec3 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:22.605249 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fa0da0bc-1ef0-4b7a-9c8a-a72ddbf9dec3 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:22.605953 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fa0da0bc-1ef0-4b7a-9c8a-a72ddbf9dec3 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:22.606910 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fa0da0bc-1ef0-4b7a-9c8a-a72ddbf9dec3 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:22.715612 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-fa0da0bc-1ef0-4b7a-9c8a-a72ddbf9dec3 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:22.725372 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fa0da0bc-1ef0-4b7a-9c8a-a72ddbf9dec3 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1221 microversion: 2.1 time: 0.156103 Aug 22 17:16:22.729189 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 555/1096] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:22 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1221 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:22.933336 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-11ef218c-47bf-44de-8eb9-d3f0aaa1d059 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:22.951842 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-11ef218c-47bf-44de-8eb9-d3f0aaa1d059 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef" status: 200 len: 1317 microversion: 2.1 time: 0.692360 Aug 22 17:16:22.962686 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 542/1097] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:22 2022] GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef => generated 1317 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:23.580122 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-99c3bd4f-9e36-4cfb-ad38-11d10a9b2d55 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f800a2ed1f0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:23.695296 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-99c3bd4f-9e36-4cfb-ad38-11d10a9b2d55 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.116850 Aug 22 17:16:23.696086 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 556/1098] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:23 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:23.753761 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8a4450d5-9fe3-4569-98b7-3069c67abdf4 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:23.755271 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-8a4450d5-9fe3-4569-98b7-3069c67abdf4 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:23.780977 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8a4450d5-9fe3-4569-98b7-3069c67abdf4 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:23.784678 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8a4450d5-9fe3-4569-98b7-3069c67abdf4 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:23.799782 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8a4450d5-9fe3-4569-98b7-3069c67abdf4 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:23.799782 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8a4450d5-9fe3-4569-98b7-3069c67abdf4 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:23.800370 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8a4450d5-9fe3-4569-98b7-3069c67abdf4 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:23.800888 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8a4450d5-9fe3-4569-98b7-3069c67abdf4 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:23.809787 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-bd409550-4411-4307-a0aa-4f5dfc0e8d9e req-a12dbed8-b7a8-42aa-b7e6-ba5814b7184f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef", "name": "network-vif-plugged", "status": "completed", "tag": "b352d2eb-caa0-497b-9514-da6f7dd81bb0"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:23.842179 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-bd409550-4411-4307-a0aa-4f5dfc0e8d9e req-a12dbed8-b7a8-42aa-b7e6-ba5814b7184f service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:23.842796 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-bd409550-4411-4307-a0aa-4f5dfc0e8d9e req-a12dbed8-b7a8-42aa-b7e6-ba5814b7184f service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:23.843322 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-bd409550-4411-4307-a0aa-4f5dfc0e8d9e req-a12dbed8-b7a8-42aa-b7e6-ba5814b7184f service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:23.887281 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-bd409550-4411-4307-a0aa-4f5dfc0e8d9e req-a12dbed8-b7a8-42aa-b7e6-ba5814b7184f service nova] Creating event network-vif-plugged:b352d2eb-caa0-497b-9514-da6f7dd81bb0 for instance 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef on n-h1-854030-1 Aug 22 17:16:23.902990 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-bd409550-4411-4307-a0aa-4f5dfc0e8d9e req-a12dbed8-b7a8-42aa-b7e6-ba5814b7184f service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096928 Aug 22 17:16:23.907524 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 557/1099] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:16:23.986779 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ae5c6028-2a49-4471-aa93-6699b8f82d6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:23.987619 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ae5c6028-2a49-4471-aa93-6699b8f82d6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:24.011254 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ae5c6028-2a49-4471-aa93-6699b8f82d6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:24.012049 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ae5c6028-2a49-4471-aa93-6699b8f82d6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:24.012751 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ae5c6028-2a49-4471-aa93-6699b8f82d6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:24.013838 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ae5c6028-2a49-4471-aa93-6699b8f82d6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:24.014530 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ae5c6028-2a49-4471-aa93-6699b8f82d6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:24.015166 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ae5c6028-2a49-4471-aa93-6699b8f82d6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:24.589186 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-8a4450d5-9fe3-4569-98b7-3069c67abdf4 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:24.603146 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8a4450d5-9fe3-4569-98b7-3069c67abdf4 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1269 microversion: 2.1 time: 0.855086 Aug 22 17:16:24.608120 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 543/1100] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:23 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1269 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:24.712899 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-74459309-2717-487b-8895-b3358c563ace tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009be81f0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:24.845365 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-74459309-2717-487b-8895-b3358c563ace tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.137519 Aug 22 17:16:24.857880 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 544/1101] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:24 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:25.069192 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ae5c6028-2a49-4471-aa93-6699b8f82d6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:25.087655 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ae5c6028-2a49-4471-aa93-6699b8f82d6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef" status: 200 len: 1317 microversion: 2.1 time: 1.107505 Aug 22 17:16:25.088624 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 558/1102] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:23 2022] GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef => generated 1317 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:16:25.638708 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-de112bf3-1e7f-428a-859a-59eb1e5d80c5 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:25.639342 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-de112bf3-1e7f-428a-859a-59eb1e5d80c5 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:25.662399 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-de112bf3-1e7f-428a-859a-59eb1e5d80c5 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:25.662399 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-de112bf3-1e7f-428a-859a-59eb1e5d80c5 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:25.662399 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-de112bf3-1e7f-428a-859a-59eb1e5d80c5 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:25.662399 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-de112bf3-1e7f-428a-859a-59eb1e5d80c5 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:25.662399 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-de112bf3-1e7f-428a-859a-59eb1e5d80c5 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:25.662399 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-de112bf3-1e7f-428a-859a-59eb1e5d80c5 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:25.867139 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0fe34624-1ef7-4a16-9c1c-4358d65a6e28 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80095fc9d0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:25.964139 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0fe34624-1ef7-4a16-9c1c-4358d65a6e28 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.101701 Aug 22 17:16:25.968478 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 559/1103] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:25 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:26.087050 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-de112bf3-1e7f-428a-859a-59eb1e5d80c5 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:26.106613 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-de112bf3-1e7f-428a-859a-59eb1e5d80c5 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1275 microversion: 2.1 time: 0.473553 Aug 22 17:16:26.118849 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b80af5c2-0bc9-464e-bf55-4786c523c6d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:26.122654 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b80af5c2-0bc9-464e-bf55-4786c523c6d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:26.131909 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 545/1104] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:25 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1275 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:26.151857 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b80af5c2-0bc9-464e-bf55-4786c523c6d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:26.153927 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b80af5c2-0bc9-464e-bf55-4786c523c6d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:26.155116 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b80af5c2-0bc9-464e-bf55-4786c523c6d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:26.157125 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b80af5c2-0bc9-464e-bf55-4786c523c6d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:26.158147 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b80af5c2-0bc9-464e-bf55-4786c523c6d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:26.160579 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b80af5c2-0bc9-464e-bf55-4786c523c6d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:26.985130 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0eec1944-f753-4431-8877-aa33d0e0f5e0 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009a7c5e0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:27.058921 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0eec1944-f753-4431-8877-aa33d0e0f5e0 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.077753 Aug 22 17:16:27.060307 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 546/1105] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:26 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:16:27.090087 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b80af5c2-0bc9-464e-bf55-4786c523c6d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:27.100520 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b80af5c2-0bc9-464e-bf55-4786c523c6d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef" status: 200 len: 1317 microversion: 2.1 time: 0.987984 Aug 22 17:16:27.125573 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 560/1106] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:26 2022] GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef => generated 1317 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:16:27.150953 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b10d2882-6240-495c-94ff-43ff6b635ac9 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:27.151572 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b10d2882-6240-495c-94ff-43ff6b635ac9 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:27.166809 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b10d2882-6240-495c-94ff-43ff6b635ac9 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:27.170177 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b10d2882-6240-495c-94ff-43ff6b635ac9 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:27.170177 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b10d2882-6240-495c-94ff-43ff6b635ac9 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:27.170177 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b10d2882-6240-495c-94ff-43ff6b635ac9 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:27.170177 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b10d2882-6240-495c-94ff-43ff6b635ac9 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:27.170177 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b10d2882-6240-495c-94ff-43ff6b635ac9 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:27.467870 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b10d2882-6240-495c-94ff-43ff6b635ac9 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:27.479651 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b10d2882-6240-495c-94ff-43ff6b635ac9 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1275 microversion: 2.1 time: 0.332593 Aug 22 17:16:27.480261 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 547/1107] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:27 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1275 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:28.075965 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-76703efd-7e8a-44fd-980d-abaf83639fe4 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f800a0754c0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:28.159080 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-76703efd-7e8a-44fd-980d-abaf83639fe4 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.088228 Aug 22 17:16:28.170056 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 548/1108] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:28 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:16:28.210029 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a7354450-f56c-46a9-a03e-a6726b880d1e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:28.213898 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-a7354450-f56c-46a9-a03e-a6726b880d1e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:28.272893 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a7354450-f56c-46a9-a03e-a6726b880d1e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:28.274534 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a7354450-f56c-46a9-a03e-a6726b880d1e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:28.287115 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a7354450-f56c-46a9-a03e-a6726b880d1e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:28.287115 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a7354450-f56c-46a9-a03e-a6726b880d1e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:28.287115 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a7354450-f56c-46a9-a03e-a6726b880d1e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:28.287115 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a7354450-f56c-46a9-a03e-a6726b880d1e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:28.574016 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9768bba3-1956-43a0-90b5-dca1230b67ce tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Action: 'create', calling method: .version_select at 0x7f8009d1d940>, body: {"keypair": {"name": "tempest-keypair-1572129397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbYDR3jlAQlu3Eok9Qrfq0W/Jkb/MhnPToTj5aoBL3OeSKBpxcbdtrfc4b6We3nBASSGdrdeMMg2rmmObHJwShwWT5apXFmI9/HLOw3Xp7Ig5C5yShLcDvreEAb467x3A=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:28.593663 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-9768bba3-1956-43a0-90b5-dca1230b67ce tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Getting quotas for project 4a01c829d4314d95b851925c7ec358a6. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:28.607665 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-9768bba3-1956-43a0-90b5-dca1230b67ce tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Getting quotas for user b2ce5476c2874b30b3881dc63640206a and project 4a01c829d4314d95b851925c7ec358a6. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:28.819357 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a7354450-f56c-46a9-a03e-a6726b880d1e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:28.830836 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a7354450-f56c-46a9-a03e-a6726b880d1e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef" status: 200 len: 1465 microversion: 2.1 time: 0.639841 Aug 22 17:16:28.831799 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 549/1109] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:28 2022] GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef => generated 1465 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:28.853579 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9aa1645b-8754-4bdd-9114-a71e48fbe387 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:28.854647 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-9aa1645b-8754-4bdd-9114-a71e48fbe387 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:28.861599 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9aa1645b-8754-4bdd-9114-a71e48fbe387 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:28.862192 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9aa1645b-8754-4bdd-9114-a71e48fbe387 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:28.863095 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9aa1645b-8754-4bdd-9114-a71e48fbe387 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:28.864965 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9aa1645b-8754-4bdd-9114-a71e48fbe387 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:28.865704 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9aa1645b-8754-4bdd-9114-a71e48fbe387 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:28.866664 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9aa1645b-8754-4bdd-9114-a71e48fbe387 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:28.944455 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9aa1645b-8754-4bdd-9114-a71e48fbe387 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:28.961199 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9aa1645b-8754-4bdd-9114-a71e48fbe387 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1275 microversion: 2.1 time: 0.114051 Aug 22 17:16:28.961788 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 550/1110] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:28 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1275 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:28.966264 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b6db47c1-43a7-4686-a899-73c09f9da1b0 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:28.966861 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b6db47c1-43a7-4686-a899-73c09f9da1b0 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:28.972946 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b6db47c1-43a7-4686-a899-73c09f9da1b0 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:28.973584 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b6db47c1-43a7-4686-a899-73c09f9da1b0 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:28.974335 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b6db47c1-43a7-4686-a899-73c09f9da1b0 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:28.975047 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b6db47c1-43a7-4686-a899-73c09f9da1b0 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:28.975500 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b6db47c1-43a7-4686-a899-73c09f9da1b0 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:28.975921 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b6db47c1-43a7-4686-a899-73c09f9da1b0 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:29.069310 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9768bba3-1956-43a0-90b5-dca1230b67ce tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.199447 Aug 22 17:16:29.079742 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 561/1111] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:16:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:16:29.088110 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6ed763fc-e2c7-446c-be36-1a9f06db09b2 tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Calling method '.version_select at 0x7f80095fc8b0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:29.108771 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6ed763fc-e2c7-446c-be36-1a9f06db09b2 tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] 10.222.0.96 "GET /compute/v2.1/os-keypairs/tempest-keypair-1572129397" status: 200 len: 498 microversion: 2.1 time: 0.026689 Aug 22 17:16:29.109904 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 562/1112] 10.222.0.96 () {58 vars in 1218 bytes} [Mon Aug 22 17:16:29 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1572129397 => generated 498 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:16:29.128649 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1d15058c-0b5d-45ce-8433-55c6c6346aca tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Calling method '.version_select at 0x7f8009624160>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:29.153674 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b6db47c1-43a7-4686-a899-73c09f9da1b0 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef" status: 200 len: 1616 microversion: 2.1 time: 0.190767 Aug 22 17:16:29.154317 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 551/1113] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:28 2022] GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef => generated 1616 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:29.186919 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0c82a40f-ac16-42f5-ad0f-10e690a1e571 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f800a4e8700>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:29.216801 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:29.319235 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1d15058c-0b5d-45ce-8433-55c6c6346aca tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1572129397" status: 202 len: 0 microversion: 2.1 time: 0.200258 Aug 22 17:16:29.324770 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 563/1114] 10.222.0.96 () {58 vars in 1221 bytes} [Mon Aug 22 17:16:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1572129397 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:16:29.325975 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0c82a40f-ac16-42f5-ad0f-10e690a1e571 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.142733 Aug 22 17:16:29.334153 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 552/1115] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:29 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:16:29.337670 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-89a75d22-cd74-47c0-89ae-f7559aa2e09b tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Action: 'create', calling method: .version_select at 0x7f8009624940>, body: {"keypair": {"name": "tempest-keypair-1044804588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbFFY008LgceLUgJJfLC3/jKg5dxxNKwhq78le+WviQQ3pc8pkK7BRhZwCFpaw03F3X4muGwTU084DKzRi9rLuv1ewbZE2RBYXndLvD88kLAmejzLVUM9KaJcPsXoUYaQ=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:29.411870 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-89a75d22-cd74-47c0-89ae-f7559aa2e09b tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Getting quotas for project 4a01c829d4314d95b851925c7ec358a6. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:29.428149 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-89a75d22-cd74-47c0-89ae-f7559aa2e09b tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Getting quotas for user b2ce5476c2874b30b3881dc63640206a and project 4a01c829d4314d95b851925c7ec358a6. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:29.572503 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-89a75d22-cd74-47c0-89ae-f7559aa2e09b tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.244097 Aug 22 17:16:29.573849 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 564/1116] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:16:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:16:29.586055 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b1ddf2f8-88f3-4f64-8904-58cd3eb21f9a tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Calling method '.version_select at 0x7f800a0754c0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:29.745786 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b1ddf2f8-88f3-4f64-8904-58cd3eb21f9a tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1044804588" status: 202 len: 0 microversion: 2.1 time: 0.165642 Aug 22 17:16:29.746705 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 553/1117] 10.222.0.96 () {58 vars in 1221 bytes} [Mon Aug 22 17:16:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1044804588 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:16:29.761586 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8eb14e89-8868-439d-8088-34f145c4e11b tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Action: 'create', calling method: .version_select at 0x7f80096e0a60>, body: {"keypair": {"name": "tempest-keypair-1876771086", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:29.834995 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-8eb14e89-8868-439d-8088-34f145c4e11b tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Getting quotas for project 4a01c829d4314d95b851925c7ec358a6. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:29.854906 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-8eb14e89-8868-439d-8088-34f145c4e11b tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Getting quotas for user b2ce5476c2874b30b3881dc63640206a and project 4a01c829d4314d95b851925c7ec358a6. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:29.999180 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8aa5214b-bdaf-4bab-a36c-7c142222f301 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:30.001791 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-8aa5214b-bdaf-4bab-a36c-7c142222f301 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:30.021720 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8aa5214b-bdaf-4bab-a36c-7c142222f301 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:30.026883 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8aa5214b-bdaf-4bab-a36c-7c142222f301 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:30.029149 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8aa5214b-bdaf-4bab-a36c-7c142222f301 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:30.030133 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8aa5214b-bdaf-4bab-a36c-7c142222f301 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:30.033164 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8aa5214b-bdaf-4bab-a36c-7c142222f301 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:30.033826 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8aa5214b-bdaf-4bab-a36c-7c142222f301 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:30.048906 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8eb14e89-8868-439d-8088-34f145c4e11b tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.295964 Aug 22 17:16:30.050964 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 565/1118] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:16:29 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:16:30.065386 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f31814de-0196-4310-b0e3-ebbeb7ba07b3 tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Calling method '.version_select at 0x7f80096963a0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:30.192391 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f31814de-0196-4310-b0e3-ebbeb7ba07b3 tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1876771086" status: 202 len: 0 microversion: 2.1 time: 0.131865 Aug 22 17:16:30.203885 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 566/1119] 10.222.0.96 () {58 vars in 1221 bytes} [Mon Aug 22 17:16:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1876771086 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:16:30.211942 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ad86789e-0bef-4268-ac6a-88622469c2e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-945782272", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["de1802ae-582c-4cc0-bda9-86b08d26493f"]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:30.358504 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-ad86789e-0bef-4268-ac6a-88622469c2e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] validate_networks() for None {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:16:30.720431 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-8aa5214b-bdaf-4bab-a36c-7c142222f301 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:30.737371 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8aa5214b-bdaf-4bab-a36c-7c142222f301 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1317 microversion: 2.1 time: 0.751984 Aug 22 17:16:30.738334 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 554/1120] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:29 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1317 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:16:30.748791 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-30ea93d1-f60a-453d-80a0-c44c64bef55c tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Action: 'create', calling method: .version_select at 0x7f8009fbddc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1785043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6jyCnfHSYSLbjfOMzewCu5Nkd7TD4bUPrT1RhyerXSHg2GqgN/fnf/zZPvE455hQj9p1MbnRPYjUwCripFALmLP+Imbk/+WUD+R3X9VsLC7CzU5Z7LVThkYp4O/ONVvw=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:30.783405 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-30ea93d1-f60a-453d-80a0-c44c64bef55c tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Getting quotas for project 4a01c829d4314d95b851925c7ec358a6. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:30.803572 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-30ea93d1-f60a-453d-80a0-c44c64bef55c tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Getting quotas for user b2ce5476c2874b30b3881dc63640206a and project 4a01c829d4314d95b851925c7ec358a6. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:30.964540 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-30ea93d1-f60a-453d-80a0-c44c64bef55c tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.223788 Aug 22 17:16:30.965267 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 555/1121] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:16:30 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:16:30.971939 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6c81e5ae-3958-432f-9b67-2bcc05f75e3e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009a6e670>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:31.065248 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-6c81e5ae-3958-432f-9b67-2bcc05f75e3e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.096847 Aug 22 17:16:31.066211 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 556/1122] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:30 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:31.087812 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fa289f89-00f9-4536-984d-a29d2a122ea8 tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Action: 'create', calling method: .version_select at 0x7f8009a2f5e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-906451899", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlwgCMxX9ocNNlNQ6tTUk4VkIKhSRuFV3iqFsgBkuVZKbl5rJxR2ZLEsEkeHsEenvUnuc2jM0jvFaRLbEbpjUcWSJV+vURFwSbymmwBUlpNzQyH/Vc0Du+zV/d892C+hQ=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:31.185885 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-fa289f89-00f9-4536-984d-a29d2a122ea8 tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Getting quotas for project 4a01c829d4314d95b851925c7ec358a6. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:31.215921 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-fa289f89-00f9-4536-984d-a29d2a122ea8 tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Getting quotas for user b2ce5476c2874b30b3881dc63640206a and project 4a01c829d4314d95b851925c7ec358a6. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:31.235102 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ad86789e-0bef-4268-ac6a-88622469c2e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:16:31.239810 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ad86789e-0bef-4268-ac6a-88622469c2e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:16:31.239810 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ad86789e-0bef-4268-ac6a-88622469c2e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:16:31.239810 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ad86789e-0bef-4268-ac6a-88622469c2e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:16:31.239810 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ad86789e-0bef-4268-ac6a-88622469c2e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:16:31.256108 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ad86789e-0bef-4268-ac6a-88622469c2e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:31.258253 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ad86789e-0bef-4268-ac6a-88622469c2e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:31.261321 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ad86789e-0bef-4268-ac6a-88622469c2e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:31.262847 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ad86789e-0bef-4268-ac6a-88622469c2e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:31.264809 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ad86789e-0bef-4268-ac6a-88622469c2e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:31.265952 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ad86789e-0bef-4268-ac6a-88622469c2e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:31.325572 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-ad86789e-0bef-4268-ac6a-88622469c2e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for project d789047469894e1fbe5af3a109a95b4c. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:31.335399 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-ad86789e-0bef-4268-ac6a-88622469c2e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for user 43188026fda44118ad642b7065108966 and project d789047469894e1fbe5af3a109a95b4c. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:31.387972 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-fa289f89-00f9-4536-984d-a29d2a122ea8 tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.320598 Aug 22 17:16:31.388635 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 557/1123] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:16:31 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:16:31.403072 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ad86789e-0bef-4268-ac6a-88622469c2e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Going to run 1 instances... {{(pid=123015) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:16:31.404400 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e515f805-2138-4a8b-add5-ed70971c42d1 tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Action: 'create', calling method: .version_select at 0x7f8009a6e5e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-452925583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNkDgYMEA0rUTTjGnLndPIobQMlAnmPZPOT47zj+W0vzwq4inZenVc+T5y0ui5bhEaT3L1znRQK/c45CJ6Z7HLThnp7QJn4Ts0sTziNU5nYC+zlxWf+0C4t95N2sTwXRg=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:31.407553 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ad86789e-0bef-4268-ac6a-88622469c2e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:16:31.475510 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-e515f805-2138-4a8b-add5-ed70971c42d1 tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Getting quotas for project 4a01c829d4314d95b851925c7ec358a6. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:31.499297 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-e515f805-2138-4a8b-add5-ed70971c42d1 tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Getting quotas for user b2ce5476c2874b30b3881dc63640206a and project 4a01c829d4314d95b851925c7ec358a6. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:31.600723 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ad86789e-0bef-4268-ac6a-88622469c2e7 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.394355 Aug 22 17:16:31.603100 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 567/1124] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:16:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:16:31.616710 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f7950aac-f25a-48b7-86c2-40f7d61c1303 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:31.617966 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f7950aac-f25a-48b7-86c2-40f7d61c1303 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:31.638633 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=12,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:31.650294 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e515f805-2138-4a8b-add5-ed70971c42d1 tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.251616 Aug 22 17:16:31.651262 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 558/1125] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:16:31 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:16:31.675806 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f787e007-df4f-4557-8948-4428afab9705 tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Calling method '.version_select at 0x7f8009ebaa60>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:31.735600 n-d-854030-1 devstack@n-api.service[123016]: WARNING oslo_db.sqlalchemy.utils [None req-f787e007-df4f-4557-8948-4428afab9705 tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 22 17:16:31.757157 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f787e007-df4f-4557-8948-4428afab9705 tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] 10.222.0.96 "GET /compute/v2.1/os-keypairs" status: 200 len: 1089 microversion: 2.1 time: 0.095157 Aug 22 17:16:31.757955 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 559/1126] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:16:31 2022] GET /compute/v2.1/os-keypairs => generated 1089 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:31.776781 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-14bd0785-9175-4082-8eb8-00de73593933 tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Calling method '.version_select at 0x7f800a04ef70>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:31.901166 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f7950aac-f25a-48b7-86c2-40f7d61c1303 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:31.913314 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-14bd0785-9175-4082-8eb8-00de73593933 tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-452925583" status: 202 len: 0 microversion: 2.1 time: 0.147221 Aug 22 17:16:31.914644 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 560/1127] 10.222.0.96 () {58 vars in 1275 bytes} [Mon Aug 22 17:16:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-452925583 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:16:31.921013 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5959c7fe-f2fc-4d19-972f-cc3067b48161 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:31.922339 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f7950aac-f25a-48b7-86c2-40f7d61c1303 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1216 microversion: 2.1 time: 0.312799 Aug 22 17:16:31.927594 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 568/1128] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:31 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1216 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:16:31.942713 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5959c7fe-f2fc-4d19-972f-cc3067b48161 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:31.960062 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fd4fc9f6-192d-4e21-8cd1-c22c5661182d tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Calling method '.version_select at 0x7f8009696040>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:31.972019 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5959c7fe-f2fc-4d19-972f-cc3067b48161 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:31.972625 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5959c7fe-f2fc-4d19-972f-cc3067b48161 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:31.974581 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5959c7fe-f2fc-4d19-972f-cc3067b48161 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:31.975371 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5959c7fe-f2fc-4d19-972f-cc3067b48161 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:31.977989 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5959c7fe-f2fc-4d19-972f-cc3067b48161 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:31.982982 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5959c7fe-f2fc-4d19-972f-cc3067b48161 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:32.165831 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fd4fc9f6-192d-4e21-8cd1-c22c5661182d tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-906451899" status: 202 len: 0 microversion: 2.1 time: 0.236463 Aug 22 17:16:32.167200 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 569/1129] 10.222.0.96 () {58 vars in 1275 bytes} [Mon Aug 22 17:16:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-906451899 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:16:32.189012 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-66f334b0-93c9-4153-849a-b5e09558b02b tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009696e50>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:32.309432 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-66f334b0-93c9-4153-849a-b5e09558b02b tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.141092 Aug 22 17:16:32.310339 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 570/1130] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:32 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:32.328578 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-78909581-652c-4eda-87fd-ec5e944f1ac4 tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] Calling method '.version_select at 0x7f8009696160>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:32.490616 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-78909581-652c-4eda-87fd-ec5e944f1ac4 tempest-KeyPairsV2TestJSON-680918119 tempest-KeyPairsV2TestJSON-680918119-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1785043" status: 202 len: 0 microversion: 2.1 time: 0.178921 Aug 22 17:16:32.492541 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 571/1131] 10.222.0.96 () {58 vars in 1269 bytes} [Mon Aug 22 17:16:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1785043 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:16:32.614735 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-760dcfa1-1890-4280-986b-6f7681c226ef req-4a11f0e2-b86c-4242-8416-81440343f897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9580929a-e453-41ef-a4e9-330cede53f01", "tag": "ae70627f-e44d-42a8-9bae-1081a5f5e717"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:32.646940 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-760dcfa1-1890-4280-986b-6f7681c226ef req-4a11f0e2-b86c-4242-8416-81440343f897 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:32.648866 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-760dcfa1-1890-4280-986b-6f7681c226ef req-4a11f0e2-b86c-4242-8416-81440343f897 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:32.649679 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-760dcfa1-1890-4280-986b-6f7681c226ef req-4a11f0e2-b86c-4242-8416-81440343f897 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:32.668501 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-760dcfa1-1890-4280-986b-6f7681c226ef req-4a11f0e2-b86c-4242-8416-81440343f897 service nova] Creating event network-changed:ae70627f-e44d-42a8-9bae-1081a5f5e717 for instance 9580929a-e453-41ef-a4e9-330cede53f01 on n-h2-854030-1 Aug 22 17:16:32.678252 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-760dcfa1-1890-4280-986b-6f7681c226ef req-4a11f0e2-b86c-4242-8416-81440343f897 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071772 Aug 22 17:16:32.679784 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 572/1132] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:16:32.955020 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1b3c864f-64bc-4cf9-bc98-673dbf97665b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:32.958708 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-1b3c864f-64bc-4cf9-bc98-673dbf97665b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:33.138713 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1b3c864f-64bc-4cf9-bc98-673dbf97665b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:33.154599 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1b3c864f-64bc-4cf9-bc98-673dbf97665b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1216 microversion: 2.1 time: 0.201226 Aug 22 17:16:33.165882 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 573/1133] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:32 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1216 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:33.325482 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4341a285-4755-4477-89db-6f372b6a34d1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80095fc790>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:33.356582 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-5959c7fe-f2fc-4d19-972f-cc3067b48161 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:33.403888 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5959c7fe-f2fc-4d19-972f-cc3067b48161 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1317 microversion: 2.1 time: 1.486161 Aug 22 17:16:33.404533 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 561/1134] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:31 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1317 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:33.448518 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-4341a285-4755-4477-89db-6f372b6a34d1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.127682 Aug 22 17:16:33.450205 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 574/1135] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:33 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:34.184902 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-40ec4e5f-2e25-4e65-93b7-0054b761637d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:34.189258 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-40ec4e5f-2e25-4e65-93b7-0054b761637d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:34.226598 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-40ec4e5f-2e25-4e65-93b7-0054b761637d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:34.227163 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-40ec4e5f-2e25-4e65-93b7-0054b761637d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:34.227616 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-40ec4e5f-2e25-4e65-93b7-0054b761637d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:34.229826 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-40ec4e5f-2e25-4e65-93b7-0054b761637d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:34.239025 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-40ec4e5f-2e25-4e65-93b7-0054b761637d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:34.240629 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-40ec4e5f-2e25-4e65-93b7-0054b761637d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:34.427321 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6fdf8b84-1b55-4f88-acfa-adf2994a88a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:34.428681 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-6fdf8b84-1b55-4f88-acfa-adf2994a88a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:34.443102 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6fdf8b84-1b55-4f88-acfa-adf2994a88a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:34.446754 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6fdf8b84-1b55-4f88-acfa-adf2994a88a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:34.447515 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6fdf8b84-1b55-4f88-acfa-adf2994a88a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:34.448473 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6fdf8b84-1b55-4f88-acfa-adf2994a88a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:34.451175 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6fdf8b84-1b55-4f88-acfa-adf2994a88a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:34.453118 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6fdf8b84-1b55-4f88-acfa-adf2994a88a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:34.464705 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-40ec4e5f-2e25-4e65-93b7-0054b761637d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:34.495758 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-40ec4e5f-2e25-4e65-93b7-0054b761637d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1268 microversion: 2.1 time: 0.302566 Aug 22 17:16:34.495758 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 562/1136] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:34 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1268 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:34.507335 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f90fdebd-bd33-491a-adbf-ec4607d21776 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009eb8430>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:34.602706 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f90fdebd-bd33-491a-adbf-ec4607d21776 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.100530 Aug 22 17:16:34.604505 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 563/1137] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:34 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:35.132042 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6fdf8b84-1b55-4f88-acfa-adf2994a88a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:35.145251 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6fdf8b84-1b55-4f88-acfa-adf2994a88a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1317 microversion: 2.1 time: 0.722193 Aug 22 17:16:35.146654 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 575/1138] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:34 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1317 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:16:35.510770 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-deb499f5-1b90-4157-abe4-1524b1ed3a3c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:35.511763 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-deb499f5-1b90-4157-abe4-1524b1ed3a3c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:35.525140 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-deb499f5-1b90-4157-abe4-1524b1ed3a3c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:35.527290 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-deb499f5-1b90-4157-abe4-1524b1ed3a3c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:35.527997 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-deb499f5-1b90-4157-abe4-1524b1ed3a3c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:35.529938 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-deb499f5-1b90-4157-abe4-1524b1ed3a3c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:35.531534 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-deb499f5-1b90-4157-abe4-1524b1ed3a3c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:35.532464 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-deb499f5-1b90-4157-abe4-1524b1ed3a3c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:35.770611 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-deb499f5-1b90-4157-abe4-1524b1ed3a3c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:35.788339 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-deb499f5-1b90-4157-abe4-1524b1ed3a3c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1276 microversion: 2.1 time: 0.280347 Aug 22 17:16:35.791187 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 576/1139] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:35 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1276 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:35.808697 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8fd2d64b-e510-4150-b783-3a48f278385b tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80096e0790>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:35.905446 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-22ffb534-c3dd-42f9-b533-c7cbeb1200c4 tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Action: 'update', calling method: .version_select at 0x7f8009a2f4c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:35.937764 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8fd2d64b-e510-4150-b783-3a48f278385b tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.145023 Aug 22 17:16:35.938499 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 577/1140] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:35 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:36.110655 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-22ffb534-c3dd-42f9-b533-c7cbeb1200c4 tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:36.112515 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-22ffb534-c3dd-42f9-b533-c7cbeb1200c4 tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:36.115102 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-22ffb534-c3dd-42f9-b533-c7cbeb1200c4 tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:36.120571 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-22ffb534-c3dd-42f9-b533-c7cbeb1200c4 tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:36.120571 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-22ffb534-c3dd-42f9-b533-c7cbeb1200c4 tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:36.120571 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-22ffb534-c3dd-42f9-b533-c7cbeb1200c4 tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:36.159677 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:36.167209 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2f87ebc5-c325-4302-85b0-d5505f29cf6a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:36.167825 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-2f87ebc5-c325-4302-85b0-d5505f29cf6a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:36.180943 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2f87ebc5-c325-4302-85b0-d5505f29cf6a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:36.181806 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2f87ebc5-c325-4302-85b0-d5505f29cf6a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:36.182833 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2f87ebc5-c325-4302-85b0-d5505f29cf6a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:36.183908 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2f87ebc5-c325-4302-85b0-d5505f29cf6a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:36.184564 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2f87ebc5-c325-4302-85b0-d5505f29cf6a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:36.185229 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2f87ebc5-c325-4302-85b0-d5505f29cf6a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:36.400017 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-22ffb534-c3dd-42f9-b533-c7cbeb1200c4 tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-quota-sets/9e575256fcfd444192b708abe0a6dede" status: 200 len: 148 microversion: 2.57 time: 0.937795 Aug 22 17:16:36.403206 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 564/1141] 10.222.0.96 () {62 vars in 1303 bytes} [Mon Aug 22 17:16:35 2022] PUT /compute/v2.1/os-quota-sets/9e575256fcfd444192b708abe0a6dede => generated 148 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:16:36.429529 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-625fbda1-f082-458e-a01f-6a7519e9fcc2 tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Calling method '.version_select at 0x7f800c66e820>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:37.053417 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-2f87ebc5-c325-4302-85b0-d5505f29cf6a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:37.061492 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2f87ebc5-c325-4302-85b0-d5505f29cf6a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1317 microversion: 2.1 time: 0.898258 Aug 22 17:16:37.069994 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 578/1142] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:36 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1317 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:16:37.083340 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2ae3cccc-d3ca-4930-a896-202ebb7bb943 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:37.085008 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-2ae3cccc-d3ca-4930-a896-202ebb7bb943 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:37.099502 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2ae3cccc-d3ca-4930-a896-202ebb7bb943 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:37.102519 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2ae3cccc-d3ca-4930-a896-202ebb7bb943 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:37.105664 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2ae3cccc-d3ca-4930-a896-202ebb7bb943 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:37.108233 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2ae3cccc-d3ca-4930-a896-202ebb7bb943 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:37.111927 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2ae3cccc-d3ca-4930-a896-202ebb7bb943 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:37.113200 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2ae3cccc-d3ca-4930-a896-202ebb7bb943 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:37.158066 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:37.230604 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-625fbda1-f082-458e-a01f-6a7519e9fcc2 tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:37.234769 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-625fbda1-f082-458e-a01f-6a7519e9fcc2 tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:37.240426 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-625fbda1-f082-458e-a01f-6a7519e9fcc2 tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:37.241761 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-625fbda1-f082-458e-a01f-6a7519e9fcc2 tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:37.243455 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-625fbda1-f082-458e-a01f-6a7519e9fcc2 tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:37.246238 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-625fbda1-f082-458e-a01f-6a7519e9fcc2 tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:37.351213 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-625fbda1-f082-458e-a01f-6a7519e9fcc2 tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/9e575256fcfd444192b708abe0a6dede/detail" status: 200 len: 463 microversion: 2.57 time: 0.934413 Aug 22 17:16:37.357132 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 565/1143] 10.222.0.96 () {60 vars in 1304 bytes} [Mon Aug 22 17:16:36 2022] GET /compute/v2.1/os-quota-sets/9e575256fcfd444192b708abe0a6dede/detail => generated 463 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:16:37.357132 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-45c351b3-ceb2-4ccd-b960-e0bc6599ab7f tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009dded30>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:37.460545 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-45c351b3-ceb2-4ccd-b960-e0bc6599ab7f tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 0.107162 Aug 22 17:16:37.465411 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 566/1144] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:37 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:37.472978 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-2ae3cccc-d3ca-4930-a896-202ebb7bb943 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:37.486205 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2ae3cccc-d3ca-4930-a896-202ebb7bb943 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1274 microversion: 2.1 time: 0.414625 Aug 22 17:16:37.487753 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 579/1145] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:37 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1274 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:38.087143 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c61894ab-e7d9-4a33-ac5a-ef61a2428c43 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:38.087919 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-c61894ab-e7d9-4a33-ac5a-ef61a2428c43 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:38.095613 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c61894ab-e7d9-4a33-ac5a-ef61a2428c43 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:38.096104 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c61894ab-e7d9-4a33-ac5a-ef61a2428c43 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:38.096541 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c61894ab-e7d9-4a33-ac5a-ef61a2428c43 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:38.097279 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c61894ab-e7d9-4a33-ac5a-ef61a2428c43 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:38.097920 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c61894ab-e7d9-4a33-ac5a-ef61a2428c43 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:38.098842 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c61894ab-e7d9-4a33-ac5a-ef61a2428c43 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:38.665954 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-02335d3a-70de-49c9-b9c9-51cd6df191db tempest-FlavorsV2NegativeTest-764045262 tempest-FlavorsV2NegativeTest-764045262-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:38.685569 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-02335d3a-70de-49c9-b9c9-51cd6df191db tempest-FlavorsV2NegativeTest-764045262 tempest-FlavorsV2NegativeTest-764045262-project] 10.222.0.96 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.998938 Aug 22 17:16:38.689669 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 567/1146] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:16:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:16:38.701027 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-90a6a16b-727e-42c4-9700-3426f862dffd tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Action: 'update', calling method: .version_select at 0x7f800c864040>, body: {"quota_set": {"ram": "2048"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:38.720949 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c61894ab-e7d9-4a33-ac5a-ef61a2428c43 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:38.743183 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c61894ab-e7d9-4a33-ac5a-ef61a2428c43 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1317 microversion: 2.1 time: 0.652787 Aug 22 17:16:38.743183 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 580/1147] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:38 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1317 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:16:38.746026 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8e58d687-9a54-4561-9c5f-59feaf44f305 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009b31f70>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:38.880452 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90a6a16b-727e-42c4-9700-3426f862dffd tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:38.882070 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90a6a16b-727e-42c4-9700-3426f862dffd tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:38.883318 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90a6a16b-727e-42c4-9700-3426f862dffd tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:38.884646 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90a6a16b-727e-42c4-9700-3426f862dffd tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:38.886022 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90a6a16b-727e-42c4-9700-3426f862dffd tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:38.887043 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90a6a16b-727e-42c4-9700-3426f862dffd tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:38.989373 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90a6a16b-727e-42c4-9700-3426f862dffd tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:38.997323 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90a6a16b-727e-42c4-9700-3426f862dffd tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:38.998017 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90a6a16b-727e-42c4-9700-3426f862dffd tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:39.001908 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90a6a16b-727e-42c4-9700-3426f862dffd tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:39.002506 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90a6a16b-727e-42c4-9700-3426f862dffd tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:39.007053 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90a6a16b-727e-42c4-9700-3426f862dffd tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:39.290144 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-90a6a16b-727e-42c4-9700-3426f862dffd tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-quota-sets/9e575256fcfd444192b708abe0a6dede?user_id=f3b8e41074644c4c824c60ffe04c32a0" status: 200 len: 148 microversion: 2.57 time: 0.596283 Aug 22 17:16:39.296712 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 568/1148] 10.222.0.96 () {62 vars in 1384 bytes} [Mon Aug 22 17:16:38 2022] PUT /compute/v2.1/os-quota-sets/9e575256fcfd444192b708abe0a6dede?user_id=f3b8e41074644c4c824c60ffe04c32a0 => generated 148 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:16:39.303498 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-639f902b-55ed-464e-b56c-4134964442c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:39.306648 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-639f902b-55ed-464e-b56c-4134964442c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:39.326474 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-639f902b-55ed-464e-b56c-4134964442c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:39.326474 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-639f902b-55ed-464e-b56c-4134964442c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:39.326474 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-639f902b-55ed-464e-b56c-4134964442c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:39.327704 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-639f902b-55ed-464e-b56c-4134964442c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:39.328380 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-639f902b-55ed-464e-b56c-4134964442c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:39.329017 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-639f902b-55ed-464e-b56c-4134964442c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:39.834738 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-639f902b-55ed-464e-b56c-4134964442c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:39.851655 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-639f902b-55ed-464e-b56c-4134964442c9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1316 microversion: 2.1 time: 0.558918 Aug 22 17:16:39.854637 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 569/1149] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:39 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1316 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:39.874345 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1ec8a452-6cc9-43a1-bc3d-99ded4a961a0 tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] Calling method '.version_select at 0x7f8009eb6c10>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:40.270424 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8e58d687-9a54-4561-9c5f-59feaf44f305 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1455 microversion: 2.1 time: 1.531775 Aug 22 17:16:40.271999 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 581/1150] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:38 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1455 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:40.297215 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9b83db42-3a73-4342-a273-0bbbf584186a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:40.304413 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9b83db42-3a73-4342-a273-0bbbf584186a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:40.341790 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b83db42-3a73-4342-a273-0bbbf584186a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:40.345869 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b83db42-3a73-4342-a273-0bbbf584186a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:40.347657 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b83db42-3a73-4342-a273-0bbbf584186a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:40.351901 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b83db42-3a73-4342-a273-0bbbf584186a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:40.356238 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b83db42-3a73-4342-a273-0bbbf584186a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:40.358098 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b83db42-3a73-4342-a273-0bbbf584186a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:40.375260 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1ec8a452-6cc9-43a1-bc3d-99ded4a961a0 tempest-QuotasAdminTestV257-2074046416 tempest-QuotasAdminTestV257-2074046416-project-admin] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/9e575256fcfd444192b708abe0a6dede?user_id=f3b8e41074644c4c824c60ffe04c32a0" status: 200 len: 190 microversion: 2.57 time: 0.518533 Aug 22 17:16:40.384329 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 570/1151] 10.222.0.96 () {60 vars in 1364 bytes} [Mon Aug 22 17:16:39 2022] GET /compute/v2.1/os-quota-sets/9e575256fcfd444192b708abe0a6dede?user_id=f3b8e41074644c4c824c60ffe04c32a0 => generated 190 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:16:40.467429 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-044cfaff-72db-4469-a7b0-7512822ef77e tempest-FlavorsV2NegativeTest-764045262 tempest-FlavorsV2NegativeTest-764045262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1578962410", "imageRef": "c6feec91-a389-4b03-baa2-0045d485a2b5", "flavorRef": "452"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:40.614025 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-044cfaff-72db-4469-a7b0-7512822ef77e tempest-FlavorsV2NegativeTest-764045262 tempest-FlavorsV2NegativeTest-764045262-project] validate_networks() for None {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:16:40.999108 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-044cfaff-72db-4469-a7b0-7512822ef77e tempest-FlavorsV2NegativeTest-764045262 tempest-FlavorsV2NegativeTest-764045262-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-044cfaff-72db-4469-a7b0-7512822ef77e tempest-FlavorsV2NegativeTest-764045262 tempest-FlavorsV2NegativeTest-764045262-project] Request method failure captured: Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 143 Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7n11ewytq9B2GGrqHCSaX1eofkFDlSRtypKX_8JT6w9XFNQGNlI9eWW0dthx_JhsgRu-LHieem6fWiijIhLvDXZxVYYG-qZn8tbXhlLpjIdoNO0EfS6ERdob8MM0QYCzWd1As-wtVMe4REpX8QbL9BlH_NL1QTc3SIiIOfoPdC3Mpk Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 406553f2bbfc4c5781d25c3b06fc98fd Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-FlavorsV2NegativeTest-764045262 Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/406553f2bbfc4c5781d25c3b06fc98fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_406553f2bbfc4c5781d25c3b06fc98fd", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/406553f2bbfc4c5781d25c3b06fc98fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/406553f2bbfc4c5781d25c3b06fc98fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-FlavorsV2NegativeTest-764045262 Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 406553f2bbfc4c5781d25c3b06fc98fd Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-764045262 Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-FlavorsV2NegativeTest-764045262-project Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 03c7c50130684acbab33dc8af1154507 Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-FlavorsV2NegativeTest-764045262-project Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1578962410", "imageRef": "c6feec91-a389-4b03-baa2-0045d485a2b5", "flavorRef": "452"}} Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: exception: Flavor's memory is too small for requested image. Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1578962410', 'imageRef': 'c6feec91-a389-4b03-baa2-0045d485a2b5', 'flavorRef': '452'}}} Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1711, in _create_instance Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1006, in _checks_for_create_and_rebuild Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 670, in _validate_flavor_image Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 738, in _validate_flavor_image_nostatus Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:41.003819 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:41.013924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:41.013924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:41.013924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:16:41.013924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 22 17:16:41.013924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 22 17:16:41.013924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 22 17:16:41.013924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:41.013924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:16:41.013924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:41.013924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:41.013924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:16:41.013924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:16:41.013924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:16:41.013924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:16:41.013924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 22 17:16:41.013924 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:41.013924 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-044cfaff-72db-4469-a7b0-7512822ef77e tempest-FlavorsV2NegativeTest-764045262 tempest-FlavorsV2NegativeTest-764045262-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:16:41.013924 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-044cfaff-72db-4469-a7b0-7512822ef77e tempest-FlavorsV2NegativeTest-764045262 tempest-FlavorsV2NegativeTest-764045262-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.545565 Aug 22 17:16:41.016568 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 571/1152] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:16:40 2022] POST /compute/v2.1/servers => generated 93 bytes in 554 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 22 17:16:41.165060 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9b83db42-3a73-4342-a273-0bbbf584186a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:41.177473 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9b83db42-3a73-4342-a273-0bbbf584186a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1317 microversion: 2.1 time: 0.904294 Aug 22 17:16:41.178657 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 582/1153] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:40 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1317 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:41.190730 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f0baade8-9eb0-4d1c-8c52-d5eb1e20b73e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:41.192155 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f0baade8-9eb0-4d1c-8c52-d5eb1e20b73e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:41.203977 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f0baade8-9eb0-4d1c-8c52-d5eb1e20b73e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:41.217041 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f0baade8-9eb0-4d1c-8c52-d5eb1e20b73e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:41.218279 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f0baade8-9eb0-4d1c-8c52-d5eb1e20b73e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:41.219454 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f0baade8-9eb0-4d1c-8c52-d5eb1e20b73e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:41.220126 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f0baade8-9eb0-4d1c-8c52-d5eb1e20b73e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:41.220776 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f0baade8-9eb0-4d1c-8c52-d5eb1e20b73e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:41.282708 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:41.430729 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b73116da-5ad9-4111-a047-db147cefe95d tempest-MultipleCreateTestJSON-1084633261 tempest-MultipleCreateTestJSON-1084633261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-597241085", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "8ea3a711-8859-43b3-9908-f67eea9c705a"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:41.550156 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-b73116da-5ad9-4111-a047-db147cefe95d tempest-MultipleCreateTestJSON-1084633261 tempest-MultipleCreateTestJSON-1084633261-project] validate_networks() for [('8ea3a711-8859-43b3-9908-f67eea9c705a', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:16:41.839265 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f0baade8-9eb0-4d1c-8c52-d5eb1e20b73e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:41.853871 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f0baade8-9eb0-4d1c-8c52-d5eb1e20b73e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1316 microversion: 2.1 time: 0.670037 Aug 22 17:16:41.855833 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 583/1154] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:41 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1316 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:41.876096 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-efc15442-ba60-4213-945a-86e54cfa3785 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009d1d430>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:41.976709 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-efc15442-ba60-4213-945a-86e54cfa3785 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1464 microversion: 2.1 time: 0.117712 Aug 22 17:16:41.978020 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 584/1155] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:41 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1464 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-b73116da-5ad9-4111-a047-db147cefe95d tempest-MultipleCreateTestJSON-1084633261 tempest-MultipleCreateTestJSON-1084633261-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b608f8e8-2cc9-4a98-93d5-aff4b55d2c33) Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:16:42.305554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:16:42.310425 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:16:42.310425 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:16:42.310425 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:16:42.310425 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:16:42.310425 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:16:42.310425 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:16:42.310425 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:16:42.310425 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:16:42.310425 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:16:42.310425 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:16:42.310425 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:16:42.310425 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:16:42.310425 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:16:42.310425 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:16:42.310425 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b608f8e8-2cc9-4a98-93d5-aff4b55d2c33) Aug 22 17:16:42.310425 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:42.313123 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-b73116da-5ad9-4111-a047-db147cefe95d tempest-MultipleCreateTestJSON-1084633261 tempest-MultipleCreateTestJSON-1084633261-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:42.313123 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b73116da-5ad9-4111-a047-db147cefe95d tempest-MultipleCreateTestJSON-1084633261 tempest-MultipleCreateTestJSON-1084633261-project] Request method failure captured: Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 225 Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7n4IGBT0WC2ffC10pj8gBxq2j_p93-jslkY0fKXCeIW3IcHASNXvhB5htSnwTTzzR3qQRBJw_v-HD5uuxIOYVo1cpNG8tRYhV09aWV8gwhs1R_QafzeKfJlVeENuGSz26UcxNvK9V8NCFKxAThCqr0l0fia2q0J3f6B3d_nkv04sMg Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 4a4436ab771e4ee099655f1602bbf57d Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-MultipleCreateTestJSON-1084633261 Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4a4436ab771e4ee099655f1602bbf57d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_4a4436ab771e4ee099655f1602bbf57d", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4a4436ab771e4ee099655f1602bbf57d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/4a4436ab771e4ee099655f1602bbf57d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-MultipleCreateTestJSON-1084633261 Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 4a4436ab771e4ee099655f1602bbf57d Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1084633261 Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-MultipleCreateTestJSON-1084633261-project Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 8ce6b9e8aa2346e8aa863490aba21ffb Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-MultipleCreateTestJSON-1084633261-project Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-tempest.common.compute-instance-597241085", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "8ea3a711-8859-43b3-9908-f67eea9c705a"}]}} Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-tempest.common.compute-instance-597241085', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'min_count': 2, 'networks': [{'uuid': '8ea3a711-8859-43b3-9908-f67eea9c705a'}]}}} Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:16:42.316340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b608f8e8-2cc9-4a98-93d5-aff4b55d2c33) Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:16:42.321676 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:16:42.336470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:42.336470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:42.336470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:42.336470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:16:42.336470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:42.336470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:42.336470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:16:42.336470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:16:42.336470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:16:42.336470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:16:42.336470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:42.336470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:42.336470 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:42.336470 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b73116da-5ad9-4111-a047-db147cefe95d tempest-MultipleCreateTestJSON-1084633261 tempest-MultipleCreateTestJSON-1084633261-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:42.336470 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:16:42.336470 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b73116da-5ad9-4111-a047-db147cefe95d tempest-MultipleCreateTestJSON-1084633261 tempest-MultipleCreateTestJSON-1084633261-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.302317 Aug 22 17:16:42.336470 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 572/1156] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:16:41 2022] POST /compute/v2.1/servers => generated 214 bytes in 1307 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:16:42.364221 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-af1dfbc2-0977-40b7-bad5-5e1a353f0d01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009fbddc0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:42.536932 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-af1dfbc2-0977-40b7-bad5-5e1a353f0d01 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 200 len: 1464 microversion: 2.1 time: 0.211191 Aug 22 17:16:42.541477 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 573/1157] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:42 2022] GET /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 1464 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:42.561662 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ebbb1267-e54c-46c7-8bb3-f922d113ad8a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:42.562323 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-ebbb1267-e54c-46c7-8bb3-f922d113ad8a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:42.580439 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ebbb1267-e54c-46c7-8bb3-f922d113ad8a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:42.581236 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ebbb1267-e54c-46c7-8bb3-f922d113ad8a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:42.586265 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ebbb1267-e54c-46c7-8bb3-f922d113ad8a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:42.588022 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ebbb1267-e54c-46c7-8bb3-f922d113ad8a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:42.588671 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ebbb1267-e54c-46c7-8bb3-f922d113ad8a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:42.589479 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ebbb1267-e54c-46c7-8bb3-f922d113ad8a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:42.638560 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-002bb767-34cb-4516-8b41-c151266ef811 req-fb7ea731-fa54-478a-bb04-da1e9760255a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283c0e37-bf44-4514-9a22-78f349663102", "tag": "6ae81955-3017-4ea8-9dd4-92356f7e4dbc"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:42.663628 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-002bb767-34cb-4516-8b41-c151266ef811 req-fb7ea731-fa54-478a-bb04-da1e9760255a service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:42.666814 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-002bb767-34cb-4516-8b41-c151266ef811 req-fb7ea731-fa54-478a-bb04-da1e9760255a service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:42.667686 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-002bb767-34cb-4516-8b41-c151266ef811 req-fb7ea731-fa54-478a-bb04-da1e9760255a service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:42.685996 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-002bb767-34cb-4516-8b41-c151266ef811 req-fb7ea731-fa54-478a-bb04-da1e9760255a service nova] Creating event network-changed:6ae81955-3017-4ea8-9dd4-92356f7e4dbc for instance 283c0e37-bf44-4514-9a22-78f349663102 on n-h1-854030-1 Aug 22 17:16:42.692941 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-002bb767-34cb-4516-8b41-c151266ef811 req-fb7ea731-fa54-478a-bb04-da1e9760255a service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.713199 Aug 22 17:16:42.694538 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 585/1158] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:16:42.702928 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-878d5822-b31b-4f53-98e2-5e2769b3ee69 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:42.703999 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-878d5822-b31b-4f53-98e2-5e2769b3ee69 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:42.719047 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-878d5822-b31b-4f53-98e2-5e2769b3ee69 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:42.722160 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-878d5822-b31b-4f53-98e2-5e2769b3ee69 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:42.723320 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-878d5822-b31b-4f53-98e2-5e2769b3ee69 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:42.724181 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-878d5822-b31b-4f53-98e2-5e2769b3ee69 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:42.725072 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-878d5822-b31b-4f53-98e2-5e2769b3ee69 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:42.726106 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-878d5822-b31b-4f53-98e2-5e2769b3ee69 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:42.942591 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ebbb1267-e54c-46c7-8bb3-f922d113ad8a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:42.951834 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ebbb1267-e54c-46c7-8bb3-f922d113ad8a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1317 microversion: 2.1 time: 0.409148 Aug 22 17:16:42.955414 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 574/1159] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:42 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:42.970927 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d3140610-8059-4f0d-8bb1-d33e7462fb21 tempest-MultipleCreateTestJSON-1084633261 tempest-MultipleCreateTestJSON-1084633261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1791725778", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "8ea3a711-8859-43b3-9908-f67eea9c705a"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:43.054589 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-d3140610-8059-4f0d-8bb1-d33e7462fb21 tempest-MultipleCreateTestJSON-1084633261 tempest-MultipleCreateTestJSON-1084633261-project] validate_networks() for [('8ea3a711-8859-43b3-9908-f67eea9c705a', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:16:43.143710 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=51,nova_cell0:UPDATE=7 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-d3140610-8059-4f0d-8bb1-d33e7462fb21 tempest-MultipleCreateTestJSON-1084633261 tempest-MultipleCreateTestJSON-1084633261-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-693c59b9-7d91-4bb5-8cbb-f4520beef198) Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:16:43.432591 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-693c59b9-7d91-4bb5-8cbb-f4520beef198) Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-d3140610-8059-4f0d-8bb1-d33e7462fb21 tempest-MultipleCreateTestJSON-1084633261 tempest-MultipleCreateTestJSON-1084633261-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d3140610-8059-4f0d-8bb1-d33e7462fb21 tempest-MultipleCreateTestJSON-1084633261 tempest-MultipleCreateTestJSON-1084633261-project] Request method failure captured: Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 271 Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7n4IGBT0WC2ffC10pj8gBxq2j_p93-jslkY0fKXCeIW3IcHASNXvhB5htSnwTTzzR3qQRBJw_v-HD5uuxIOYVo1cpNG8tRYhV09aWV8gwhs1R_QafzeKfJlVeENuGSz26UcxNvK9V8NCFKxAThCqr0l0fia2q0J3f6B3d_nkv04sMg Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 4a4436ab771e4ee099655f1602bbf57d Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-MultipleCreateTestJSON-1084633261 Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4a4436ab771e4ee099655f1602bbf57d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_4a4436ab771e4ee099655f1602bbf57d", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4a4436ab771e4ee099655f1602bbf57d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/4a4436ab771e4ee099655f1602bbf57d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-MultipleCreateTestJSON-1084633261 Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 4a4436ab771e4ee099655f1602bbf57d Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1084633261 Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-MultipleCreateTestJSON-1084633261-project Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 8ce6b9e8aa2346e8aa863490aba21ffb Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-MultipleCreateTestJSON-1084633261-project Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1791725778", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "8ea3a711-8859-43b3-9908-f67eea9c705a"}]}} Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:16:43.437214 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateTestJSON-server-1791725778', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'min_count': 1, 'max_count': 2, 'return_reservation_id': True, 'networks': [{'uuid': '8ea3a711-8859-43b3-9908-f67eea9c705a'}]}}} Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:16:43.444738 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-693c59b9-7d91-4bb5-8cbb-f4520beef198) Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d3140610-8059-4f0d-8bb1-d33e7462fb21 tempest-MultipleCreateTestJSON-1084633261 tempest-MultipleCreateTestJSON-1084633261-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d3140610-8059-4f0d-8bb1-d33e7462fb21 tempest-MultipleCreateTestJSON-1084633261 tempest-MultipleCreateTestJSON-1084633261-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.480456 Aug 22 17:16:43.448958 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 575/1160] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:16:42 2022] POST /compute/v2.1/servers => generated 214 bytes in 482 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:16:43.456226 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b2fd939c-ba77-4654-99f3-ecb13805d29c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:43.457753 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b2fd939c-ba77-4654-99f3-ecb13805d29c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:43.476826 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b2fd939c-ba77-4654-99f3-ecb13805d29c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:43.481619 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b2fd939c-ba77-4654-99f3-ecb13805d29c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:43.482437 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b2fd939c-ba77-4654-99f3-ecb13805d29c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:43.485228 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b2fd939c-ba77-4654-99f3-ecb13805d29c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:43.492333 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b2fd939c-ba77-4654-99f3-ecb13805d29c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:43.493181 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b2fd939c-ba77-4654-99f3-ecb13805d29c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:43.893014 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-878d5822-b31b-4f53-98e2-5e2769b3ee69 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:43.907317 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-878d5822-b31b-4f53-98e2-5e2769b3ee69 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1466 microversion: 2.1 time: 1.211280 Aug 22 17:16:43.911267 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 586/1161] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:42 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1466 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:43.921700 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-6ea2b7ed-5c64-4bcb-865b-8f69939fc061 req-a8e502af-fcd8-4949-abb7-34a2669df5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9580929a-e453-41ef-a4e9-330cede53f01", "name": "network-vif-plugged", "status": "completed", "tag": "ae70627f-e44d-42a8-9bae-1081a5f5e717"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:43.948894 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-6ea2b7ed-5c64-4bcb-865b-8f69939fc061 req-a8e502af-fcd8-4949-abb7-34a2669df5f0 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:43.950533 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-6ea2b7ed-5c64-4bcb-865b-8f69939fc061 req-a8e502af-fcd8-4949-abb7-34a2669df5f0 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:43.950974 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-6ea2b7ed-5c64-4bcb-865b-8f69939fc061 req-a8e502af-fcd8-4949-abb7-34a2669df5f0 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:43.968136 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-6ea2b7ed-5c64-4bcb-865b-8f69939fc061 req-a8e502af-fcd8-4949-abb7-34a2669df5f0 service nova] Creating event network-vif-plugged:ae70627f-e44d-42a8-9bae-1081a5f5e717 for instance 9580929a-e453-41ef-a4e9-330cede53f01 on n-h2-854030-1 Aug 22 17:16:43.975709 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-6ea2b7ed-5c64-4bcb-865b-8f69939fc061 req-a8e502af-fcd8-4949-abb7-34a2669df5f0 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062605 Aug 22 17:16:43.981117 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 587/1162] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:16:43.989954 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-dfa8e122-c62c-408e-bde7-948e7883354f tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-200093335"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:43.995303 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-dfa8e122-c62c-408e-bde7-948e7883354f tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: b9d1e79a-48e9-436e-a233-7a950de59886] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:44.007028 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dfa8e122-c62c-408e-bde7-948e7883354f tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:44.012745 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dfa8e122-c62c-408e-bde7-948e7883354f tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:44.012745 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dfa8e122-c62c-408e-bde7-948e7883354f tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:44.012745 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dfa8e122-c62c-408e-bde7-948e7883354f tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:44.012745 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dfa8e122-c62c-408e-bde7-948e7883354f tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:44.012745 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dfa8e122-c62c-408e-bde7-948e7883354f tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:44.289161 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b2fd939c-ba77-4654-99f3-ecb13805d29c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:44.300484 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=100 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:44.334216 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b2fd939c-ba77-4654-99f3-ecb13805d29c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1316 microversion: 2.1 time: 0.874018 Aug 22 17:16:44.352210 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 576/1163] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:43 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1316 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:44.367397 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9e0b9291-6487-4033-8d38-02907b4b8578 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:44.389998 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-9e0b9291-6487-4033-8d38-02907b4b8578 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:44.398831 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9e0b9291-6487-4033-8d38-02907b4b8578 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:44.399844 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9e0b9291-6487-4033-8d38-02907b4b8578 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:44.400505 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9e0b9291-6487-4033-8d38-02907b4b8578 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:44.401849 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9e0b9291-6487-4033-8d38-02907b4b8578 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:44.402789 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9e0b9291-6487-4033-8d38-02907b4b8578 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:44.403995 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9e0b9291-6487-4033-8d38-02907b4b8578 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:44.635830 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-dfa8e122-c62c-408e-bde7-948e7883354f tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "POST /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886/action" status: 202 len: 0 microversion: 2.1 time: 0.652651 Aug 22 17:16:44.643461 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 588/1164] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:16:43 2022] POST /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886/action => generated 0 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 22 17:16:44.651999 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-84d1b52d-27e4-4d0a-9cb8-3352f7608d95 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f800972c550>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:44.746155 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-84d1b52d-27e4-4d0a-9cb8-3352f7608d95 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c" status: 200 len: 1454 microversion: 2.1 time: 0.100221 Aug 22 17:16:44.746763 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 589/1165] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:44 2022] GET /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:44.882399 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9e0b9291-6487-4033-8d38-02907b4b8578 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:44.924407 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9e0b9291-6487-4033-8d38-02907b4b8578 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1317 microversion: 2.1 time: 0.569709 Aug 22 17:16:44.927489 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 577/1166] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:44 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1317 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:45.364832 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-90dd3d99-22f0-4c9d-8e39-ee1f89b650cf tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:45.365748 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-90dd3d99-22f0-4c9d-8e39-ee1f89b650cf tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:45.374079 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-90dd3d99-22f0-4c9d-8e39-ee1f89b650cf tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:45.374785 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-90dd3d99-22f0-4c9d-8e39-ee1f89b650cf tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:45.375490 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-90dd3d99-22f0-4c9d-8e39-ee1f89b650cf tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:45.377174 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-90dd3d99-22f0-4c9d-8e39-ee1f89b650cf tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:45.378492 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-90dd3d99-22f0-4c9d-8e39-ee1f89b650cf tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:45.379606 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-90dd3d99-22f0-4c9d-8e39-ee1f89b650cf tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:45.763480 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a163e2e9-5211-46e9-bb9c-131e83c86e85 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009be8c10>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:45.767161 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-90dd3d99-22f0-4c9d-8e39-ee1f89b650cf tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:45.777971 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-90dd3d99-22f0-4c9d-8e39-ee1f89b650cf tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1316 microversion: 2.1 time: 0.421842 Aug 22 17:16:45.785869 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 590/1167] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:45 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1316 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:45.840623 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a163e2e9-5211-46e9-bb9c-131e83c86e85 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c" status: 200 len: 1454 microversion: 2.1 time: 0.081612 Aug 22 17:16:45.843135 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 578/1168] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:45 2022] GET /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c => generated 1454 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:16:45.945229 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-82f31465-cc97-425c-a232-fab122769a2a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:45.945850 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-82f31465-cc97-425c-a232-fab122769a2a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:45.955295 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-82f31465-cc97-425c-a232-fab122769a2a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:45.959638 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-82f31465-cc97-425c-a232-fab122769a2a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:45.960349 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-82f31465-cc97-425c-a232-fab122769a2a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:45.963364 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-82f31465-cc97-425c-a232-fab122769a2a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:45.964887 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-82f31465-cc97-425c-a232-fab122769a2a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:45.964887 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-82f31465-cc97-425c-a232-fab122769a2a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:46.417839 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-4ae80405-7986-4061-b1c5-63a27118c957 req-012a38f9-56f9-4cd8-b841-bf5c97a782a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9699e0-8054-4491-91a6-2d8e34898838", "name": "network-vif-unplugged", "status": "completed", "tag": "0bc75a5b-a857-42d1-be9e-f441f5aad90b"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:46.455931 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-4ae80405-7986-4061-b1c5-63a27118c957 req-012a38f9-56f9-4cd8-b841-bf5c97a782a1 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:46.456443 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-4ae80405-7986-4061-b1c5-63a27118c957 req-012a38f9-56f9-4cd8-b841-bf5c97a782a1 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:46.457661 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-4ae80405-7986-4061-b1c5-63a27118c957 req-012a38f9-56f9-4cd8-b841-bf5c97a782a1 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:46.504750 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-4ae80405-7986-4061-b1c5-63a27118c957 req-012a38f9-56f9-4cd8-b841-bf5c97a782a1 service nova] Creating event network-vif-unplugged:0bc75a5b-a857-42d1-be9e-f441f5aad90b for instance 8a9699e0-8054-4491-91a6-2d8e34898838 on n-h2-854030-1 Aug 22 17:16:46.525584 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-4ae80405-7986-4061-b1c5-63a27118c957 req-012a38f9-56f9-4cd8-b841-bf5c97a782a1 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.402040 Aug 22 17:16:46.527329 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 579/1169] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:16:46.807247 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e01c0e54-a6e3-4cdf-be32-09a22c161fbd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:46.819066 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e01c0e54-a6e3-4cdf-be32-09a22c161fbd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:46.841499 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e01c0e54-a6e3-4cdf-be32-09a22c161fbd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:46.844233 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e01c0e54-a6e3-4cdf-be32-09a22c161fbd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:46.844797 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e01c0e54-a6e3-4cdf-be32-09a22c161fbd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:46.913018 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e01c0e54-a6e3-4cdf-be32-09a22c161fbd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:46.913018 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e01c0e54-a6e3-4cdf-be32-09a22c161fbd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:46.913018 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e01c0e54-a6e3-4cdf-be32-09a22c161fbd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:46.987421 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-82f31465-cc97-425c-a232-fab122769a2a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:47.002380 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-82f31465-cc97-425c-a232-fab122769a2a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1317 microversion: 2.1 time: 1.060935 Aug 22 17:16:47.004361 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 591/1170] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:45 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1317 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:47.012255 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-38a9858f-72ca-43ad-8371-51e404fac61e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80095fc820>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:47.096796 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-38a9858f-72ca-43ad-8371-51e404fac61e tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c" status: 200 len: 1454 microversion: 2.1 time: 0.090722 Aug 22 17:16:47.106951 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 592/1171] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:47 2022] GET /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:47.236121 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e01c0e54-a6e3-4cdf-be32-09a22c161fbd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:47.266796 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e01c0e54-a6e3-4cdf-be32-09a22c161fbd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1316 microversion: 2.1 time: 0.464721 Aug 22 17:16:47.268361 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 580/1172] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:46 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:16:48.029677 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8eeaf274-664d-4840-933a-684d7d1845a8 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:48.032234 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8eeaf274-664d-4840-933a-684d7d1845a8 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:48.048383 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8eeaf274-664d-4840-933a-684d7d1845a8 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:48.048878 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8eeaf274-664d-4840-933a-684d7d1845a8 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:48.055723 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8eeaf274-664d-4840-933a-684d7d1845a8 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:48.057420 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8eeaf274-664d-4840-933a-684d7d1845a8 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:48.058511 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8eeaf274-664d-4840-933a-684d7d1845a8 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:48.059463 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8eeaf274-664d-4840-933a-684d7d1845a8 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:48.113739 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9e0ae996-2c74-4554-9c4c-2a3a9e7c1a19 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009a6edc0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:48.223059 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9e0ae996-2c74-4554-9c4c-2a3a9e7c1a19 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c" status: 200 len: 1454 microversion: 2.1 time: 0.108287 Aug 22 17:16:48.223059 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 581/1173] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:48 2022] GET /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:48.295636 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-14c13766-019a-4158-b39a-5fcc94d9cca1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:48.295636 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-14c13766-019a-4158-b39a-5fcc94d9cca1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:48.303910 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-14c13766-019a-4158-b39a-5fcc94d9cca1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:48.309575 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-14c13766-019a-4158-b39a-5fcc94d9cca1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:48.310231 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-14c13766-019a-4158-b39a-5fcc94d9cca1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:48.311389 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-14c13766-019a-4158-b39a-5fcc94d9cca1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:48.312013 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-14c13766-019a-4158-b39a-5fcc94d9cca1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:48.319237 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-14c13766-019a-4158-b39a-5fcc94d9cca1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:48.781424 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8eeaf274-664d-4840-933a-684d7d1845a8 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:48.799430 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8eeaf274-664d-4840-933a-684d7d1845a8 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1467 microversion: 2.1 time: 0.768785 Aug 22 17:16:48.802336 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 593/1174] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:48 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1467 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:48.827882 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7b1c92be-e440-41ab-b03b-766eb342d07c tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-70438356", "metadata": {"image_type": "test"}}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:48.830682 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-7b1c92be-e440-41ab-b03b-766eb342d07c tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:48.849753 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7b1c92be-e440-41ab-b03b-766eb342d07c tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:48.850250 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7b1c92be-e440-41ab-b03b-766eb342d07c tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:48.850686 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7b1c92be-e440-41ab-b03b-766eb342d07c tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:48.851396 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7b1c92be-e440-41ab-b03b-766eb342d07c tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:48.851848 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7b1c92be-e440-41ab-b03b-766eb342d07c tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:48.852264 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7b1c92be-e440-41ab-b03b-766eb342d07c tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:48.865982 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-14c13766-019a-4158-b39a-5fcc94d9cca1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:48.878005 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-14c13766-019a-4158-b39a-5fcc94d9cca1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1316 microversion: 2.1 time: 0.593174 Aug 22 17:16:48.878677 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 582/1175] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:48 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1316 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:16:49.018146 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-7b1c92be-e440-41ab-b03b-766eb342d07c tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Getting quotas for project 81a86484222946699be05f1087e2d005. Resources: dict_keys(['metadata_items']) {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:49.026190 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-7b1c92be-e440-41ab-b03b-766eb342d07c tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Getting quotas for user c2367b6e03a249b69e17156366ebbb53 and project 81a86484222946699be05f1087e2d005. Resources: dict_keys(['metadata_items']) {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:49.233864 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d052521e-aa9e-46df-b57d-1ce0942920dc tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009b30040>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:49.246288 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=9 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:49.569151 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d052521e-aa9e-46df-b57d-1ce0942920dc tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c" status: 200 len: 1454 microversion: 2.1 time: 0.319563 Aug 22 17:16:49.572931 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 583/1176] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:49 2022] GET /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c => generated 1454 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:16:49.816785 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7b1c92be-e440-41ab-b03b-766eb342d07c tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "POST /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01/action" status: 202 len: 0 microversion: 2.1 time: 0.992967 Aug 22 17:16:49.822234 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 594/1177] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:16:48 2022] POST /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01/action => generated 0 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 22 17:16:49.837184 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-971721e2-d79f-40cd-86c1-c8577968f53a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f8009be8dc0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:49.900762 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6ddb4081-07d9-4fe6-8bb6-9102c58f8383 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:49.903452 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-6ddb4081-07d9-4fe6-8bb6-9102c58f8383 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:49.940159 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6ddb4081-07d9-4fe6-8bb6-9102c58f8383 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:49.940159 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6ddb4081-07d9-4fe6-8bb6-9102c58f8383 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:49.940159 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6ddb4081-07d9-4fe6-8bb6-9102c58f8383 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:49.940701 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-971721e2-d79f-40cd-86c1-c8577968f53a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2" status: 200 len: 1420 microversion: 2.1 time: 0.110244 Aug 22 17:16:49.942369 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 584/1178] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:49 2022] GET /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2 => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:16:49.947998 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6ddb4081-07d9-4fe6-8bb6-9102c58f8383 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:49.948782 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6ddb4081-07d9-4fe6-8bb6-9102c58f8383 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:49.949427 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6ddb4081-07d9-4fe6-8bb6-9102c58f8383 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:50.584926 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=48 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:16:50.590847 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-03d204ad-a8a8-4a84-8460-1a669edd8f15 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f800a04ef70>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:50.701694 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-03d204ad-a8a8-4a84-8460-1a669edd8f15 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c" status: 200 len: 1454 microversion: 2.1 time: 0.117871 Aug 22 17:16:50.705678 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 585/1179] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:50 2022] GET /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:50.957544 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2372063e-499f-4b86-92ff-a9cc1b08727a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f8009be8dc0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:51.067428 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2372063e-499f-4b86-92ff-a9cc1b08727a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2" status: 200 len: 1420 microversion: 2.1 time: 0.114657 Aug 22 17:16:51.071654 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 586/1180] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:50 2022] GET /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2 => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:16:51.447261 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-118c33c4-6f12-4997-890c-1bb4d6325928 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1251100266", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:51.541576 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-118c33c4-6f12-4997-890c-1bb4d6325928 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] validate_networks() for None {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:16:52.032319 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-118c33c4-6f12-4997-890c-1bb4d6325928 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:16:52.033534 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-118c33c4-6f12-4997-890c-1bb4d6325928 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:16:52.034193 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-118c33c4-6f12-4997-890c-1bb4d6325928 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:16:52.035584 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-118c33c4-6f12-4997-890c-1bb4d6325928 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:16:52.036544 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-118c33c4-6f12-4997-890c-1bb4d6325928 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:16:52.054003 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6ddb4081-07d9-4fe6-8bb6-9102c58f8383 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:52.065438 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-118c33c4-6f12-4997-890c-1bb4d6325928 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:52.065438 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-118c33c4-6f12-4997-890c-1bb4d6325928 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:52.065438 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-118c33c4-6f12-4997-890c-1bb4d6325928 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:52.065959 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6ddb4081-07d9-4fe6-8bb6-9102c58f8383 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1316 microversion: 2.1 time: 2.166282 Aug 22 17:16:52.067778 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-118c33c4-6f12-4997-890c-1bb4d6325928 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:52.069540 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-118c33c4-6f12-4997-890c-1bb4d6325928 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:52.070734 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-118c33c4-6f12-4997-890c-1bb4d6325928 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:52.081045 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 595/1181] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:49 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1316 bytes in 2185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:52.093664 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a7df8327-57a1-462b-a586-0ea980998c8b tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009e4cd30>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:52.121328 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-118c33c4-6f12-4997-890c-1bb4d6325928 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Getting quotas for project d2ecfb79c01d4d40850d84c3cced9240. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:52.137043 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-118c33c4-6f12-4997-890c-1bb4d6325928 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Getting quotas for user 72a0121eeba0467b9ac1030b4f2b6638 and project d2ecfb79c01d4d40850d84c3cced9240. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:52.183578 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-118c33c4-6f12-4997-890c-1bb4d6325928 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Going to run 1 instances... {{(pid=123016) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:16:52.193688 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-118c33c4-6f12-4997-890c-1bb4d6325928 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:16:52.251539 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a7df8327-57a1-462b-a586-0ea980998c8b tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c" status: 200 len: 1454 microversion: 2.1 time: 0.167957 Aug 22 17:16:52.252243 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 596/1182] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:52 2022] GET /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:52.275879 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-70e4ac14-c2a5-4a5e-8b0b-6ab4ddafa763 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f80096244c0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:52.382232 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-70e4ac14-c2a5-4a5e-8b0b-6ab4ddafa763 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2" status: 200 len: 1420 microversion: 2.1 time: 0.128886 Aug 22 17:16:52.382827 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 597/1183] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:52 2022] GET /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2 => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:52.424130 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-118c33c4-6f12-4997-890c-1bb4d6325928 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.231730 Aug 22 17:16:52.424941 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 587/1184] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:16:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:16:52.549777 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-063efa66-134e-4fb3-a21e-21d1990385bf tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-539193306", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:16:52.651947 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-063efa66-134e-4fb3-a21e-21d1990385bf tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] validate_networks() for None {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:16:53.091853 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-743f1410-424f-4615-ac4e-eb3c6541ad01 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:53.092583 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-743f1410-424f-4615-ac4e-eb3c6541ad01 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:16:53.116913 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-743f1410-424f-4615-ac4e-eb3c6541ad01 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:53.118169 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-743f1410-424f-4615-ac4e-eb3c6541ad01 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:53.118655 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-743f1410-424f-4615-ac4e-eb3c6541ad01 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:53.120861 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-743f1410-424f-4615-ac4e-eb3c6541ad01 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:53.121763 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-743f1410-424f-4615-ac4e-eb3c6541ad01 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:53.122211 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-743f1410-424f-4615-ac4e-eb3c6541ad01 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:53.965701 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-063efa66-134e-4fb3-a21e-21d1990385bf tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:16:53.966933 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-063efa66-134e-4fb3-a21e-21d1990385bf tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:16:53.967630 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-063efa66-134e-4fb3-a21e-21d1990385bf tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:16:53.968251 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-063efa66-134e-4fb3-a21e-21d1990385bf tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:16:53.968858 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-063efa66-134e-4fb3-a21e-21d1990385bf tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:16:53.985031 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-063efa66-134e-4fb3-a21e-21d1990385bf tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:53.986864 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-063efa66-134e-4fb3-a21e-21d1990385bf tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:53.987562 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-063efa66-134e-4fb3-a21e-21d1990385bf tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:53.989759 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-063efa66-134e-4fb3-a21e-21d1990385bf tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:53.990518 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-063efa66-134e-4fb3-a21e-21d1990385bf tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:53.991167 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-063efa66-134e-4fb3-a21e-21d1990385bf tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:54.020157 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-063efa66-134e-4fb3-a21e-21d1990385bf tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Getting quotas for project d2ecfb79c01d4d40850d84c3cced9240. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:16:54.038301 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-063efa66-134e-4fb3-a21e-21d1990385bf tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Getting quotas for user 72a0121eeba0467b9ac1030b4f2b6638 and project d2ecfb79c01d4d40850d84c3cced9240. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:16:54.058692 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-063efa66-134e-4fb3-a21e-21d1990385bf tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Going to run 1 instances... {{(pid=123015) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:16:54.061595 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-063efa66-134e-4fb3-a21e-21d1990385bf tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 256c1311-1a56-4547-a142-0daf98661aff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:16:54.223170 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-063efa66-134e-4fb3-a21e-21d1990385bf tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.676951 Aug 22 17:16:54.238274 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 598/1185] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:16:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:16:54.255363 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-701b6157-842f-456a-a422-4fbf6efdbcf5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80096e00d0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:54.502972 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-743f1410-424f-4615-ac4e-eb3c6541ad01 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:16:54.519853 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-743f1410-424f-4615-ac4e-eb3c6541ad01 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1316 microversion: 2.1 time: 1.429244 Aug 22 17:16:54.522562 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 588/1186] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:16:53 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1316 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:16:54.530043 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-703b26fc-80bf-4ebd-b9a7-5da2e870c73d tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f8009aa8ee0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:02.087669 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:02.164493 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=6 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:03.107520 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=5 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:04.008783 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:04.010162 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:04.048229 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=6 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:04.097916 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:04.510427 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=28 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:18.943293 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-701b6157-842f-456a-a422-4fbf6efdbcf5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c" status: 200 len: 1463 microversion: 2.1 time: 24.699107 Aug 22 17:17:18.943293 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 599/1187] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:54 2022] GET /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c => generated 1463 bytes in 24706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:18.960965 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-703b26fc-80bf-4ebd-b9a7-5da2e870c73d tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2" status: 200 len: 1420 microversion: 2.1 time: 24.436483 Aug 22 17:17:18.972966 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 589/1188] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:16:54 2022] GET /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2 => generated 1420 bytes in 24441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:18.973504 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3e411606-e217-4259-89b9-ca6449522f40 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:18.974552 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-3e411606-e217-4259-89b9-ca6449522f40 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 256c1311-1a56-4547-a142-0daf98661aff] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:18.982480 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-61f0211a-163f-41c7-873c-b0d60eba9964 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:18.983878 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-61f0211a-163f-41c7-873c-b0d60eba9964 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:18.997841 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-61f0211a-163f-41c7-873c-b0d60eba9964 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:18.998726 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-61f0211a-163f-41c7-873c-b0d60eba9964 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:18.999721 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-61f0211a-163f-41c7-873c-b0d60eba9964 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:19.000980 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-61f0211a-163f-41c7-873c-b0d60eba9964 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:19.001854 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-61f0211a-163f-41c7-873c-b0d60eba9964 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:19.003387 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-61f0211a-163f-41c7-873c-b0d60eba9964 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:19.006085 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3e411606-e217-4259-89b9-ca6449522f40 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:19.007021 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3e411606-e217-4259-89b9-ca6449522f40 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:19.007746 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3e411606-e217-4259-89b9-ca6449522f40 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:19.010025 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3e411606-e217-4259-89b9-ca6449522f40 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:19.016834 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3e411606-e217-4259-89b9-ca6449522f40 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:19.020502 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3e411606-e217-4259-89b9-ca6449522f40 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:19.432011 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-61f0211a-163f-41c7-873c-b0d60eba9964 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:19.447653 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-61f0211a-163f-41c7-873c-b0d60eba9964 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1316 microversion: 2.1 time: 0.477535 Aug 22 17:17:19.449035 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 590/1189] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:18 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1316 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:19.473544 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-d1e8fe9f-2788-4e74-a233-82755d7edeeb req-8b5fffc0-8e57-40c8-a3ee-7bace33ec034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d1e79a-48e9-436e-a233-7a950de59886", "name": "network-vif-plugged", "status": "completed", "tag": "6f8bb3a8-685e-4d62-8584-0402c1743657"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:19.499104 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-d1e8fe9f-2788-4e74-a233-82755d7edeeb req-8b5fffc0-8e57-40c8-a3ee-7bace33ec034 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:19.505296 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-d1e8fe9f-2788-4e74-a233-82755d7edeeb req-8b5fffc0-8e57-40c8-a3ee-7bace33ec034 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:19.506475 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-d1e8fe9f-2788-4e74-a233-82755d7edeeb req-8b5fffc0-8e57-40c8-a3ee-7bace33ec034 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:19.555845 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-d1e8fe9f-2788-4e74-a233-82755d7edeeb req-8b5fffc0-8e57-40c8-a3ee-7bace33ec034 service nova] Creating event network-vif-plugged:6f8bb3a8-685e-4d62-8584-0402c1743657 for instance b9d1e79a-48e9-436e-a233-7a950de59886 on n-h2-854030-1 Aug 22 17:17:19.568533 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-d1e8fe9f-2788-4e74-a233-82755d7edeeb req-8b5fffc0-8e57-40c8-a3ee-7bace33ec034 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116633 Aug 22 17:17:19.570275 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 591/1190] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:19.585026 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-3e411606-e217-4259-89b9-ca6449522f40 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:19.618049 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3e411606-e217-4259-89b9-ca6449522f40 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff" status: 200 len: 1313 microversion: 2.1 time: 0.669767 Aug 22 17:17:19.625782 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 600/1191] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:18 2022] GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff => generated 1313 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:20.053499 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0ba0364a-104c-412a-999f-44b51c1498ed tempest-ServerActionsTestJSON-1480040175 tempest-ServerActionsTestJSON-1480040175-project] Action: 'create', calling method: .version_select at 0x7f8009eb6700>, body: {"keypair": {"name": "tempest-keypair-2061205307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9AMnmklQIS3l+123daocKtPfjYmfKCBRGJtKmJzKxWof/BRsOcDT6n0PwLDFkVzFoswTRwSMi8COi2l5IKU7JGGVUiUjTXaUd4hvbr4lPre3klKiipRvQt3IWMdbSoag=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:20.076500 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-0ba0364a-104c-412a-999f-44b51c1498ed tempest-ServerActionsTestJSON-1480040175 tempest-ServerActionsTestJSON-1480040175-project] Getting quotas for project d17f397f16914eacac75c90f6c56150f. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:17:20.085523 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-0ba0364a-104c-412a-999f-44b51c1498ed tempest-ServerActionsTestJSON-1480040175 tempest-ServerActionsTestJSON-1480040175-project] Getting quotas for user 71971665a85044aea8b7b2cf5c020b46 and project d17f397f16914eacac75c90f6c56150f. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:17:20.131867 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-61a02ee8-0356-4a1a-bff2-9b42eaf86fa6 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Action: 'create', calling method: .version_select at 0x7f8009624e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-805996162", "description": "tempest-description-1380411257"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:20.180423 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0ba0364a-104c-412a-999f-44b51c1498ed tempest-ServerActionsTestJSON-1480040175 tempest-ServerActionsTestJSON-1480040175-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.606971 Aug 22 17:17:20.182981 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 592/1192] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:17:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:20.314683 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d11a9ad6-747d-4427-85e1-d2620d5cc80f tempest-FloatingIPsAssociationNegativeTestJSON-2909355 tempest-FloatingIPsAssociationNegativeTestJSON-2909355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1959192968", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "1393d1ae-67a1-488b-b941-ea7bc38514b4"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:20.386195 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-d11a9ad6-747d-4427-85e1-d2620d5cc80f tempest-FloatingIPsAssociationNegativeTestJSON-2909355 tempest-FloatingIPsAssociationNegativeTestJSON-2909355-project] validate_networks() for [('1393d1ae-67a1-488b-b941-ea7bc38514b4', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-d11a9ad6-747d-4427-85e1-d2620d5cc80f tempest-FloatingIPsAssociationNegativeTestJSON-2909355 tempest-FloatingIPsAssociationNegativeTestJSON-2909355-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-807d182e-fa64-4c38-be7c-e1588663bc1c) Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:17:20.806579 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-807d182e-fa64-4c38-be7c-e1588663bc1c) Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-d11a9ad6-747d-4427-85e1-d2620d5cc80f tempest-FloatingIPsAssociationNegativeTestJSON-2909355 tempest-FloatingIPsAssociationNegativeTestJSON-2909355-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d11a9ad6-747d-4427-85e1-d2620d5cc80f tempest-FloatingIPsAssociationNegativeTestJSON-2909355 tempest-FloatingIPsAssociationNegativeTestJSON-2909355-project] Request method failure captured: Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 224 Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7oSBaX3njuaq4xEiTvJL0vVuVqL0E9fhxqoebjZTmgj6DgKGLg6l8SDpaw7Qox4wMQIzsJuTqEWoJ6vsKOyWt1n0p7sbvcfAmBydNL0tkFOJ5JTF9m4HxIHpiYKmwVj8Bpi_NHEa2Gp62T7NHXh_u7eVkNTJdzitBOSbZk7b8j2bdQ Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 8333f97b6b3b4f99984f699e41af04e3 Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2909355 Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8333f97b6b3b4f99984f699e41af04e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_8333f97b6b3b4f99984f699e41af04e3", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8333f97b6b3b4f99984f699e41af04e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/8333f97b6b3b4f99984f699e41af04e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2909355 Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 8333f97b6b3b4f99984f699e41af04e3 Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2909355 Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2909355-project Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 89f9d83bc0614c829800e223cd93b603 Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2909355-project Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1959192968", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "1393d1ae-67a1-488b-b941-ea7bc38514b4"}]}} Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:20.869180 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-server-1959192968', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '1393d1ae-67a1-488b-b941-ea7bc38514b4'}]}}} Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:17:20.880909 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-807d182e-fa64-4c38-be7c-e1588663bc1c) Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d11a9ad6-747d-4427-85e1-d2620d5cc80f tempest-FloatingIPsAssociationNegativeTestJSON-2909355 tempest-FloatingIPsAssociationNegativeTestJSON-2909355-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d11a9ad6-747d-4427-85e1-d2620d5cc80f tempest-FloatingIPsAssociationNegativeTestJSON-2909355 tempest-FloatingIPsAssociationNegativeTestJSON-2909355-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.581485 Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 593/1193] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:17:20 2022] POST /compute/v2.1/servers => generated 214 bytes in 589 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:17:20.886439 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-326ed3e1-e9f5-42d3-a395-407d3aa6680e req-417002f8-d78f-4223-8010-75f7c28d2d3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4961b018-19fe-4ddf-8b18-1f392dc1a893", "tag": "83c67bcc-3180-44e8-84d7-e8a3bfa77f5e"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:20.892482 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-326ed3e1-e9f5-42d3-a395-407d3aa6680e req-417002f8-d78f-4223-8010-75f7c28d2d3d service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:20.892482 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-326ed3e1-e9f5-42d3-a395-407d3aa6680e req-417002f8-d78f-4223-8010-75f7c28d2d3d service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:20.892482 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-326ed3e1-e9f5-42d3-a395-407d3aa6680e req-417002f8-d78f-4223-8010-75f7c28d2d3d service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:20.892482 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-326ed3e1-e9f5-42d3-a395-407d3aa6680e req-417002f8-d78f-4223-8010-75f7c28d2d3d service nova] Creating event network-changed:83c67bcc-3180-44e8-84d7-e8a3bfa77f5e for instance 4961b018-19fe-4ddf-8b18-1f392dc1a893 on n-h2-854030-1 Aug 22 17:17:20.892482 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-326ed3e1-e9f5-42d3-a395-407d3aa6680e req-417002f8-d78f-4223-8010-75f7c28d2d3d service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092670 Aug 22 17:17:20.892482 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 594/1194] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:20.897369 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c7434186-3082-483c-b447-72bdc1d08841 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009be80d0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:20.998618 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c7434186-3082-483c-b447-72bdc1d08841 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c" status: 200 len: 1463 microversion: 2.1 time: 0.113506 Aug 22 17:17:21.006392 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-61a02ee8-0356-4a1a-bff2-9b42eaf86fa6 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.379023 Aug 22 17:17:21.007013 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 601/1195] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:17:19 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:21.024017 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 595/1196] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:20 2022] GET /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c => generated 1463 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:21.030075 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2931f6cf-11c9-4540-b25b-ef32327ea656 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f8009945b80>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:21.075791 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-75b63cd9-43c2-45e2-83a0-8d0ae374b18e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:21.076704 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-75b63cd9-43c2-45e2-83a0-8d0ae374b18e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:21.106030 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-75b63cd9-43c2-45e2-83a0-8d0ae374b18e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:21.110405 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-75b63cd9-43c2-45e2-83a0-8d0ae374b18e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:21.111010 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-75b63cd9-43c2-45e2-83a0-8d0ae374b18e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:21.112009 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-75b63cd9-43c2-45e2-83a0-8d0ae374b18e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:21.112660 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-75b63cd9-43c2-45e2-83a0-8d0ae374b18e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:21.115472 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-75b63cd9-43c2-45e2-83a0-8d0ae374b18e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:21.160362 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2931f6cf-11c9-4540-b25b-ef32327ea656 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2" status: 200 len: 1429 microversion: 2.1 time: 0.141961 Aug 22 17:17:21.174349 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 602/1197] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:21 2022] GET /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2 => generated 1429 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:21.201011 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ff57d9cc-6abc-488d-976d-ca0691546162 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:21.209816 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ff57d9cc-6abc-488d-976d-ca0691546162 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 256c1311-1a56-4547-a142-0daf98661aff] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:21.242611 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ff57d9cc-6abc-488d-976d-ca0691546162 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:21.243354 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ff57d9cc-6abc-488d-976d-ca0691546162 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:21.243816 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ff57d9cc-6abc-488d-976d-ca0691546162 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:21.252456 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ff57d9cc-6abc-488d-976d-ca0691546162 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:21.253923 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ff57d9cc-6abc-488d-976d-ca0691546162 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:21.254567 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ff57d9cc-6abc-488d-976d-ca0691546162 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:21.923874 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ff57d9cc-6abc-488d-976d-ca0691546162 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:21.931166 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ff57d9cc-6abc-488d-976d-ca0691546162 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff" status: 200 len: 1313 microversion: 2.1 time: 0.749983 Aug 22 17:17:21.958211 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 603/1198] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:21 2022] GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff => generated 1313 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:21.977675 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fb16b138-d028-451a-b46c-afa2d2730742 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Action: 'create', calling method: .version_select at 0x7f8009b31b80>, body: {"security_group_rule": {"parent_group_id": "93c35de3-3e95-4c02-8868-aaa531171b71", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:22.094456 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-75b63cd9-43c2-45e2-83a0-8d0ae374b18e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:22.105112 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-75b63cd9-43c2-45e2-83a0-8d0ae374b18e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1316 microversion: 2.1 time: 1.079891 Aug 22 17:17:22.108931 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 596/1199] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:21 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1316 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:22.115160 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-75b97c21-ae0c-48ed-ac99-1ff3472689a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:22.116586 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-75b97c21-ae0c-48ed-ac99-1ff3472689a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: b9d1e79a-48e9-436e-a233-7a950de59886] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:22.132075 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-75b97c21-ae0c-48ed-ac99-1ff3472689a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:22.132991 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-75b97c21-ae0c-48ed-ac99-1ff3472689a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:22.133717 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-75b97c21-ae0c-48ed-ac99-1ff3472689a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:22.134668 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-75b97c21-ae0c-48ed-ac99-1ff3472689a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:22.136121 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-75b97c21-ae0c-48ed-ac99-1ff3472689a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:22.136819 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-75b97c21-ae0c-48ed-ac99-1ff3472689a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:22.535592 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-75b97c21-ae0c-48ed-ac99-1ff3472689a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:22.544519 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-75b97c21-ae0c-48ed-ac99-1ff3472689a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886" status: 200 len: 1467 microversion: 2.1 time: 0.434165 Aug 22 17:17:22.545133 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 597/1200] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:22 2022] GET /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886 => generated 1467 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:22.561501 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8bfa1368-0863-4ec7-9a47-ce11fe2daf4b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f8009a2f280>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:22.642465 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8bfa1368-0863-4ec7-9a47-ce11fe2daf4b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2" status: 200 len: 1429 microversion: 2.1 time: 0.092850 Aug 22 17:17:22.649131 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 598/1201] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:22 2022] GET /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2 => generated 1429 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:22.649373 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-5490edaf-5bbb-4918-a4aa-064506ebabcf req-8c25e0a2-d5a5-4608-9422-8f061b15e97a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283c0e37-bf44-4514-9a22-78f349663102", "name": "network-vif-plugged", "status": "completed", "tag": "6ae81955-3017-4ea8-9dd4-92356f7e4dbc"}, {"server_uuid": "9580929a-e453-41ef-a4e9-330cede53f01", "name": "network-vif-plugged", "status": "completed", "tag": "ae70627f-e44d-42a8-9bae-1081a5f5e717"}, {"server_uuid": "4961b018-19fe-4ddf-8b18-1f392dc1a893", "name": "network-vif-plugged", "status": "completed", "tag": "83c67bcc-3180-44e8-84d7-e8a3bfa77f5e"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:22.665366 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-5490edaf-5bbb-4918-a4aa-064506ebabcf req-8c25e0a2-d5a5-4608-9422-8f061b15e97a service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:22.666306 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-5490edaf-5bbb-4918-a4aa-064506ebabcf req-8c25e0a2-d5a5-4608-9422-8f061b15e97a service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:22.667212 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-5490edaf-5bbb-4918-a4aa-064506ebabcf req-8c25e0a2-d5a5-4608-9422-8f061b15e97a service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:22.686964 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-5490edaf-5bbb-4918-a4aa-064506ebabcf req-8c25e0a2-d5a5-4608-9422-8f061b15e97a service nova] Creating event network-vif-plugged:6ae81955-3017-4ea8-9dd4-92356f7e4dbc for instance 283c0e37-bf44-4514-9a22-78f349663102 on n-h1-854030-1 Aug 22 17:17:22.687756 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-5490edaf-5bbb-4918-a4aa-064506ebabcf req-8c25e0a2-d5a5-4608-9422-8f061b15e97a service nova] Creating event network-vif-plugged:ae70627f-e44d-42a8-9bae-1081a5f5e717 for instance 9580929a-e453-41ef-a4e9-330cede53f01 on n-h2-854030-1 Aug 22 17:17:22.688444 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-5490edaf-5bbb-4918-a4aa-064506ebabcf req-8c25e0a2-d5a5-4608-9422-8f061b15e97a service nova] Creating event network-vif-plugged:83c67bcc-3180-44e8-84d7-e8a3bfa77f5e for instance 4961b018-19fe-4ddf-8b18-1f392dc1a893 on n-h2-854030-1 Aug 22 17:17:22.703935 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-5490edaf-5bbb-4918-a4aa-064506ebabcf req-8c25e0a2-d5a5-4608-9422-8f061b15e97a service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.058181 Aug 22 17:17:22.712968 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 599/1202] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:22.753951 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-29e1129f-b640-4751-b9e8-a608539ee2cd tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009a2fee0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:22.994093 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-29e1129f-b640-4751-b9e8-a608539ee2cd tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images?changes-since=2022-08-22T17%3A14%3A47Z" status: 200 len: 1901 microversion: 2.1 time: 0.286220 Aug 22 17:17:23.007731 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 600/1203] 10.222.0.96 () {58 vars in 1199 bytes} [Mon Aug 22 17:17:22 2022] GET /compute/v2.1/images?changes-since=2022-08-22T17%3A14%3A47Z => generated 1901 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:23.014471 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-33f435b8-16fb-4e88-9cdb-3aa25f5c65b1 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:23.015536 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-33f435b8-16fb-4e88-9cdb-3aa25f5c65b1 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:23.027250 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-33f435b8-16fb-4e88-9cdb-3aa25f5c65b1 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:23.027786 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-33f435b8-16fb-4e88-9cdb-3aa25f5c65b1 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:23.028636 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-33f435b8-16fb-4e88-9cdb-3aa25f5c65b1 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:23.029767 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-33f435b8-16fb-4e88-9cdb-3aa25f5c65b1 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:23.030562 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-33f435b8-16fb-4e88-9cdb-3aa25f5c65b1 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:23.031248 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-33f435b8-16fb-4e88-9cdb-3aa25f5c65b1 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:23.332395 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fb16b138-d028-451a-b46c-afa2d2730742 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.373017 Aug 22 17:17:23.334172 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-33f435b8-16fb-4e88-9cdb-3aa25f5c65b1 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:23.350930 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 604/1204] 10.222.0.96 () {60 vars in 1195 bytes} [Mon Aug 22 17:17:21 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:23.359938 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6d7e6eec-8a38-4576-90eb-b019595e21ec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:23.362922 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-6d7e6eec-8a38-4576-90eb-b019595e21ec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 256c1311-1a56-4547-a142-0daf98661aff] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:23.369875 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-33f435b8-16fb-4e88-9cdb-3aa25f5c65b1 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1467 microversion: 2.1 time: 0.359985 Aug 22 17:17:23.370640 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 601/1205] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:23 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1467 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:23.384748 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6d7e6eec-8a38-4576-90eb-b019595e21ec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:23.385524 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6d7e6eec-8a38-4576-90eb-b019595e21ec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:23.394128 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6d7e6eec-8a38-4576-90eb-b019595e21ec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:23.394128 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6d7e6eec-8a38-4576-90eb-b019595e21ec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:23.394128 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6d7e6eec-8a38-4576-90eb-b019595e21ec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:23.394128 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6d7e6eec-8a38-4576-90eb-b019595e21ec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:23.394550 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-10f40306-171f-4cef-951d-8d352dc838c7 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009e7bdc0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:23.591151 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-10f40306-171f-4cef-951d-8d352dc838c7 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-79661852" status: 200 len: 483 microversion: 2.1 time: 0.214559 Aug 22 17:17:23.592066 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 602/1206] 10.222.0.96 () {58 vars in 1227 bytes} [Mon Aug 22 17:17:23 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-79661852 => generated 483 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:23.605686 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-87b8b0a5-3a8f-4b13-85be-e12567044bfa req-12af06da-1ced-465e-b3a5-50540541626b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "256c1311-1a56-4547-a142-0daf98661aff", "tag": "9fcf1432-c8b1-49d3-b6d6-a712dabb2995"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:23.638227 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-87b8b0a5-3a8f-4b13-85be-e12567044bfa req-12af06da-1ced-465e-b3a5-50540541626b service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:23.638973 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-87b8b0a5-3a8f-4b13-85be-e12567044bfa req-12af06da-1ced-465e-b3a5-50540541626b service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:23.639573 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-87b8b0a5-3a8f-4b13-85be-e12567044bfa req-12af06da-1ced-465e-b3a5-50540541626b service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:23.664050 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-87b8b0a5-3a8f-4b13-85be-e12567044bfa req-12af06da-1ced-465e-b3a5-50540541626b service nova] Creating event network-changed:9fcf1432-c8b1-49d3-b6d6-a712dabb2995 for instance 256c1311-1a56-4547-a142-0daf98661aff on n-h2-854030-1 Aug 22 17:17:23.672114 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-87b8b0a5-3a8f-4b13-85be-e12567044bfa req-12af06da-1ced-465e-b3a5-50540541626b service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078825 Aug 22 17:17:23.673348 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 603/1207] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:23.680031 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5befc900-18c2-418c-ae29-984762421b6e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:23.680979 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5befc900-18c2-418c-ae29-984762421b6e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:23.688571 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5befc900-18c2-418c-ae29-984762421b6e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:23.691568 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5befc900-18c2-418c-ae29-984762421b6e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:23.692237 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5befc900-18c2-418c-ae29-984762421b6e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:23.693212 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5befc900-18c2-418c-ae29-984762421b6e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:23.693838 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5befc900-18c2-418c-ae29-984762421b6e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:23.694428 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5befc900-18c2-418c-ae29-984762421b6e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:23.757123 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6d7e6eec-8a38-4576-90eb-b019595e21ec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:23.769541 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6d7e6eec-8a38-4576-90eb-b019595e21ec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff" status: 200 len: 1313 microversion: 2.1 time: 0.416994 Aug 22 17:17:23.777762 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 605/1208] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:23 2022] GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:23.806113 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9eb99d93-2bf0-42a7-9c13-d745947f9dd1 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Action: 'create', calling method: .version_select at 0x7f8009692a60>, body: {"security_group_rule": {"parent_group_id": "93c35de3-3e95-4c02-8868-aaa531171b71", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:23.977802 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-9eb99d93-2bf0-42a7-9c13-d745947f9dd1 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] HTTP exception thrown: This rule already exists in group 93c35de3-3e95-4c02-8868-aaa531171b71 Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9eb99d93-2bf0-42a7-9c13-d745947f9dd1 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Request method failure captured: Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 138 Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7oQkInSU3xbiUaVRp-aidVGk-7Seh3ChWcVqi7snNYZMX2Aa8I3QiPyRapzfw9nJvzwNAXZQKC42q-Fea34wP50yDIT386AH_VsSoYZ9-FQMxEKtiq-A6i4VbrMbn9_lamziIzJ6MkWbxS3204kX4_l7Qk4ccDEr7labaoGE_tx8vg Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 7e00a640064847bf97024f2e31af7edf Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7e00a640064847bf97024f2e31af7edf", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 7e00a640064847bf97024f2e31af7edf Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 3c685f003ef84558a137b39987defe0f Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: {"security_group_rule": {"parent_group_id": "93c35de3-3e95-4c02-8868-aaa531171b71", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: exception: This rule already exists in group 93c35de3-3e95-4c02-8868-aaa531171b71 Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'security_group_rule': {'parent_group_id': '93c35de3-3e95-4c02-8868-aaa531171b71', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 93c35de3-3e95-4c02-8868-aaa531171b71 Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 93c35de3-3e95-4c02-8868-aaa531171b71 Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:23.985492 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:23.991285 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:23.991285 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:23.991285 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 93c35de3-3e95-4c02-8868-aaa531171b71 Aug 22 17:17:23.991285 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:23.991285 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9eb99d93-2bf0-42a7-9c13-d745947f9dd1 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Returning 400 to user: This rule already exists in group 93c35de3-3e95-4c02-8868-aaa531171b71 {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:23.991285 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9eb99d93-2bf0-42a7-9c13-d745947f9dd1 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.208873 Aug 22 17:17:23.991285 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 606/1209] 10.222.0.96 () {60 vars in 1195 bytes} [Mon Aug 22 17:17:23 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 211 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:17:23.996091 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-273872da-8cb9-481b-b8b6-3c792afa72f7 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f80095fc790>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:24.062429 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-273872da-8cb9-481b-b8b6-3c792afa72f7 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/11a48bbe-9c58-420e-95bf-5f8489a49f10" status: 200 len: 784 microversion: 2.1 time: 0.071804 Aug 22 17:17:24.063342 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 607/1210] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:23 2022] GET /compute/v2.1/images/11a48bbe-9c58-420e-95bf-5f8489a49f10 => generated 784 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:24.071105 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f80c3e59-6ed6-4280-a5c9-976cd6dc9493 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80095bf160>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:24.213937 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f80c3e59-6ed6-4280-a5c9-976cd6dc9493 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images?server=b9d1e79a-48e9-436e-a233-7a950de59886" status: 200 len: 957 microversion: 2.1 time: 0.146590 Aug 22 17:17:24.215167 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 608/1211] 10.222.0.96 () {58 vars in 1209 bytes} [Mon Aug 22 17:17:24 2022] GET /compute/v2.1/images?server=b9d1e79a-48e9-436e-a233-7a950de59886 => generated 957 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:24.302343 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7bea5006-304e-40d1-96bd-48b51ea9bb5b tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Action: 'create', calling method: .version_select at 0x7f8009945a60>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-907452758", "policies": ["affinity"]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:24.316427 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-5befc900-18c2-418c-ae29-984762421b6e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:24.324235 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5befc900-18c2-418c-ae29-984762421b6e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1316 microversion: 2.1 time: 0.648539 Aug 22 17:17:24.328646 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 604/1212] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:23 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1316 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:24.337718 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-7bea5006-304e-40d1-96bd-48b51ea9bb5b tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:17:24.338215 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a1292d82-b187-4b9e-85df-b8f42367c22c tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Calling method '.version_select at 0x7f8009b11430>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:24.360682 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-7bea5006-304e-40d1-96bd-48b51ea9bb5b tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for user b81ffc2da871454ba703addb45a8e31f and project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:17:24.579773 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-7bea5006-304e-40d1-96bd-48b51ea9bb5b tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:17:24.588004 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-7bea5006-304e-40d1-96bd-48b51ea9bb5b tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for user b81ffc2da871454ba703addb45a8e31f and project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:17:24.608670 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7bea5006-304e-40d1-96bd-48b51ea9bb5b tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.392951 Aug 22 17:17:24.610632 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 609/1213] 10.222.0.96 () {60 vars in 1174 bytes} [Mon Aug 22 17:17:24 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:24.619952 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-90c4dea0-e310-4c1d-a8b5-aff3e3fd4f00 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:24.638985 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-90c4dea0-e310-4c1d-a8b5-aff3e3fd4f00 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026831 Aug 22 17:17:24.649390 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 610/1214] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:17:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:24.662739 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-48454c45-e195-491f-a3f1-26a41030fb97 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80095bfaf0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:24.748465 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-48454c45-e195-491f-a3f1-26a41030fb97 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.96%2Fcompute%2Fv2.1%2Fservers%2F8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 485 microversion: 2.1 time: 0.096254 Aug 22 17:17:24.749026 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 611/1215] 10.222.0.96 () {58 vars in 1317 bytes} [Mon Aug 22 17:17:24 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.96%2Fcompute%2Fv2.1%2Fservers%2F8a9699e0-8054-4491-91a6-2d8e34898838 => generated 485 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:24.757863 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ff24d4bf-80a6-4010-bfc4-c37eab9e9db6 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Action: 'create', calling method: .version_select at 0x7f8009624670>, body: {"server_group": {"name": "tempest-server-group-1424546710", "policies": ["affinity"]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:24.781761 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-ff24d4bf-80a6-4010-bfc4-c37eab9e9db6 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:17:24.794550 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-ff24d4bf-80a6-4010-bfc4-c37eab9e9db6 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for user b81ffc2da871454ba703addb45a8e31f and project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:17:24.834461 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a1292d82-b187-4b9e-85df-b8f42367c22c tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-group-rules/15977017-7c4c-4f2c-b92e-ae72e399575d" status: 202 len: 0 microversion: 2.1 time: 0.504232 Aug 22 17:17:24.835918 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 605/1216] 10.222.0.96 () {58 vars in 1287 bytes} [Mon Aug 22 17:17:24 2022] DELETE /compute/v2.1/os-security-group-rules/15977017-7c4c-4f2c-b92e-ae72e399575d => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:17:24.844676 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-065485c0-cdaf-4ec2-aaed-d0eadf6b9bc9 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f8009a2f5e0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:24.957228 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-ff24d4bf-80a6-4010-bfc4-c37eab9e9db6 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:17:24.963857 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-ff24d4bf-80a6-4010-bfc4-c37eab9e9db6 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for user b81ffc2da871454ba703addb45a8e31f and project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:17:24.988171 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ff24d4bf-80a6-4010-bfc4-c37eab9e9db6 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.237984 Aug 22 17:17:24.995632 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 612/1217] 10.222.0.96 () {60 vars in 1173 bytes} [Mon Aug 22 17:17:24 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:25.001659 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-2613056a-6d7d-44d8-a9f7-8cfef28a3f8e req-e694f386-2fb1-476c-a9fb-6b42cb125a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "256c1311-1a56-4547-a142-0daf98661aff", "name": "network-vif-plugged", "status": "completed", "tag": "9fcf1432-c8b1-49d3-b6d6-a712dabb2995"}, {"server_uuid": "b9d1e79a-48e9-436e-a233-7a950de59886", "name": "network-vif-unplugged", "status": "completed", "tag": "6f8bb3a8-685e-4d62-8584-0402c1743657"}, {"server_uuid": "9580929a-e453-41ef-a4e9-330cede53f01", "name": "network-vif-unplugged", "status": "completed", "tag": "ae70627f-e44d-42a8-9bae-1081a5f5e717"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:25.017296 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-2613056a-6d7d-44d8-a9f7-8cfef28a3f8e req-e694f386-2fb1-476c-a9fb-6b42cb125a35 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:25.020668 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-2613056a-6d7d-44d8-a9f7-8cfef28a3f8e req-e694f386-2fb1-476c-a9fb-6b42cb125a35 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:25.021457 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-2613056a-6d7d-44d8-a9f7-8cfef28a3f8e req-e694f386-2fb1-476c-a9fb-6b42cb125a35 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:25.045001 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-2613056a-6d7d-44d8-a9f7-8cfef28a3f8e req-e694f386-2fb1-476c-a9fb-6b42cb125a35 service nova] Creating event network-vif-plugged:9fcf1432-c8b1-49d3-b6d6-a712dabb2995 for instance 256c1311-1a56-4547-a142-0daf98661aff on n-h2-854030-1 Aug 22 17:17:25.045800 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-2613056a-6d7d-44d8-a9f7-8cfef28a3f8e req-e694f386-2fb1-476c-a9fb-6b42cb125a35 service nova] Creating event network-vif-unplugged:6f8bb3a8-685e-4d62-8584-0402c1743657 for instance b9d1e79a-48e9-436e-a233-7a950de59886 on n-h2-854030-1 Aug 22 17:17:25.047073 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-2613056a-6d7d-44d8-a9f7-8cfef28a3f8e req-e694f386-2fb1-476c-a9fb-6b42cb125a35 service nova] Creating event network-vif-unplugged:ae70627f-e44d-42a8-9bae-1081a5f5e717 for instance 9580929a-e453-41ef-a4e9-330cede53f01 on n-h2-854030-1 Aug 22 17:17:25.058855 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-2613056a-6d7d-44d8-a9f7-8cfef28a3f8e req-e694f386-2fb1-476c-a9fb-6b42cb125a35 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.061309 Aug 22 17:17:25.061292 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 613/1218] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:25.070439 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2f176ae8-7081-444d-b21b-9c5356687702 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80095fc4c0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:25.249301 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2f176ae8-7081-444d-b21b-9c5356687702 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.96%2Fcompute%2Fservers%2F8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 485 microversion: 2.1 time: 0.185842 Aug 22 17:17:25.259102 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 614/1219] 10.222.0.96 () {58 vars in 1303 bytes} [Mon Aug 22 17:17:25 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.96%2Fcompute%2Fservers%2F8a9699e0-8054-4491-91a6-2d8e34898838 => generated 485 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:25.271256 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8606f67b-fa82-43b3-adea-a294b7694ca6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:25.272023 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8606f67b-fa82-43b3-adea-a294b7694ca6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 256c1311-1a56-4547-a142-0daf98661aff] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:25.297671 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8606f67b-fa82-43b3-adea-a294b7694ca6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:25.298369 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8606f67b-fa82-43b3-adea-a294b7694ca6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:25.298759 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8606f67b-fa82-43b3-adea-a294b7694ca6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:25.304417 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8606f67b-fa82-43b3-adea-a294b7694ca6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:25.305783 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8606f67b-fa82-43b3-adea-a294b7694ca6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:25.306366 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8606f67b-fa82-43b3-adea-a294b7694ca6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:25.623446 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8606f67b-fa82-43b3-adea-a294b7694ca6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:25.633631 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8606f67b-fa82-43b3-adea-a294b7694ca6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff" status: 200 len: 1313 microversion: 2.1 time: 0.372716 Aug 22 17:17:25.634345 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 615/1220] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:25 2022] GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:25.639855 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fa716e97-2fc2-4ffc-821e-8aa7b06cce16 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Action: 'create', calling method: .version_select at 0x7f80095f1820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-836721426", "description": "tempest-description-1905609251"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:26.188573 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fa716e97-2fc2-4ffc-821e-8aa7b06cce16 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.552359 Aug 22 17:17:26.190425 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 616/1221] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:17:25 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:26.196396 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4e4a82aa-e50e-4891-a5c8-c5436a59872b tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Action: 'create', calling method: .version_select at 0x7f80095f1940>, body: {"server_group": {"name": "tempest-server-group-1424546710", "policies": ["affinity"]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:26.217862 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-4e4a82aa-e50e-4891-a5c8-c5436a59872b tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:17:26.224757 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-4e4a82aa-e50e-4891-a5c8-c5436a59872b tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for user b81ffc2da871454ba703addb45a8e31f and project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:17:26.367356 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-4e4a82aa-e50e-4891-a5c8-c5436a59872b tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:17:26.376624 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-4e4a82aa-e50e-4891-a5c8-c5436a59872b tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for user b81ffc2da871454ba703addb45a8e31f and project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:17:26.426491 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-4e4a82aa-e50e-4891-a5c8-c5436a59872b tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.229998 Aug 22 17:17:26.431106 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 617/1222] 10.222.0.96 () {60 vars in 1173 bytes} [Mon Aug 22 17:17:26 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:26.447876 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e0aecd7d-1404-44a8-9086-a6773a4a532a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009624820>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:26.590848 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e0aecd7d-1404-44a8-9086-a6773a4a532a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3277 microversion: 2.1 time: 0.157803 Aug 22 17:17:26.603183 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 618/1223] 10.222.0.96 () {58 vars in 1149 bytes} [Mon Aug 22 17:17:26 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:26.609901 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-af5f1fe2-2659-4bdf-aa0c-dde5f99d34e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:26.611232 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-af5f1fe2-2659-4bdf-aa0c-dde5f99d34e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:26.619639 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-af5f1fe2-2659-4bdf-aa0c-dde5f99d34e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:26.620491 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-af5f1fe2-2659-4bdf-aa0c-dde5f99d34e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:26.621202 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-af5f1fe2-2659-4bdf-aa0c-dde5f99d34e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:26.622497 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-af5f1fe2-2659-4bdf-aa0c-dde5f99d34e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:26.623194 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-af5f1fe2-2659-4bdf-aa0c-dde5f99d34e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:26.624072 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-af5f1fe2-2659-4bdf-aa0c-dde5f99d34e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:26.816099 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-af5f1fe2-2659-4bdf-aa0c-dde5f99d34e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:26.827318 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-af5f1fe2-2659-4bdf-aa0c-dde5f99d34e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1466 microversion: 2.1 time: 0.222630 Aug 22 17:17:26.828193 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 619/1224] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:26 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1466 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:26.834681 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8e64d8ea-a90b-46cf-b2f2-6c9d8704e0db tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Action: 'create', calling method: .version_select at 0x7f80095f1ca0>, body: {"security_group_rule": {"parent_group_id": "47eabde4-22d3-4d8a-b371-e507330b2832", "ip_protocol": "tcp", "from_port": 199276725, "to_port": 22}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:26.884842 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-065485c0-cdaf-4ec2-aaed-d0eadf6b9bc9 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "DELETE /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2" status: 204 len: 0 microversion: 2.1 time: 2.047545 Aug 22 17:17:26.886044 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 606/1225] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:24 2022] DELETE /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2 => generated 0 bytes in 2049 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:17:26.892791 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-8e64d8ea-a90b-46cf-b2f2-6c9d8704e0db tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] HTTP exception thrown: Invalid port range 199276725:22. Former value cannot be greater than the later Aug 22 17:17:26.894843 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2fbaca97-096b-4569-a6e9-d50d867ca5b1 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8e64d8ea-a90b-46cf-b2f2-6c9d8704e0db tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Request method failure captured: Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 145 Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7oQkInSU3xbiUaVRp-aidVGk-7Seh3ChWcVqi7snNYZMX2Aa8I3QiPyRapzfw9nJvzwNAXZQKC42q-Fea34wP50yDIT386AH_VsSoYZ9-FQMxEKtiq-A6i4VbrMbn9_lamziIzJ6MkWbxS3204kX4_l7Qk4ccDEr7labaoGE_tx8vg Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 7e00a640064847bf97024f2e31af7edf Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7e00a640064847bf97024f2e31af7edf", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 7e00a640064847bf97024f2e31af7edf Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 3c685f003ef84558a137b39987defe0f Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: {"security_group_rule": {"parent_group_id": "47eabde4-22d3-4d8a-b371-e507330b2832", "ip_protocol": "tcp", "from_port": 199276725, "to_port": 22}} Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: exception: Invalid port range 199276725:22. Former value cannot be greater than the later Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'security_group_rule': {'parent_group_id': '47eabde4-22d3-4d8a-b371-e507330b2832', 'ip_protocol': 'tcp', 'from_port': 199276725, 'to_port': 22}}} Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 199276725:22. Former value cannot be greater than the later Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 199276725:22. Former value cannot be greater than the later Aug 22 17:17:26.895028 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:26.899769 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:26.899769 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:26.899769 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:26.899769 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:26.899769 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:26.899769 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:26.899769 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:26.899769 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 199276725:22. Former value cannot be greater than the later Aug 22 17:17:26.899769 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:26.899769 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8e64d8ea-a90b-46cf-b2f2-6c9d8704e0db tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Returning 400 to user: Invalid port range 199276725:22. Former value cannot be greater than the later {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:26.899769 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8e64d8ea-a90b-46cf-b2f2-6c9d8704e0db tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.066958 Aug 22 17:17:26.899769 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 620/1226] 10.222.0.96 () {60 vars in 1195 bytes} [Mon Aug 22 17:17:26 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:17:26.910466 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6ea033a2-46fe-4a67-b98d-7a34e63c94f6 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80096249d0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:27.014210 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6ea033a2-46fe-4a67-b98d-7a34e63c94f6 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.111096 Aug 22 17:17:27.014821 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 621/1227] 10.222.0.96 () {58 vars in 1149 bytes} [Mon Aug 22 17:17:26 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:27.024762 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0fd7ed2e-f18d-4bea-b311-300b2c9a6da1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:27.024762 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0fd7ed2e-f18d-4bea-b311-300b2c9a6da1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 256c1311-1a56-4547-a142-0daf98661aff] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:27.043985 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0fd7ed2e-f18d-4bea-b311-300b2c9a6da1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:27.052935 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2fbaca97-096b-4569-a6e9-d50d867ca5b1 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "DELETE /compute/v2.1/os-server-groups/01ad372b-a071-4d97-9942-1ea7a76d8640" status: 204 len: 0 microversion: 2.1 time: 0.162345 Aug 22 17:17:27.055465 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 607/1228] 10.222.0.96 () {58 vars in 1266 bytes} [Mon Aug 22 17:17:26 2022] DELETE /compute/v2.1/os-server-groups/01ad372b-a071-4d97-9942-1ea7a76d8640 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:17:27.055682 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0fd7ed2e-f18d-4bea-b311-300b2c9a6da1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:27.056452 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0fd7ed2e-f18d-4bea-b311-300b2c9a6da1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:27.057447 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0fd7ed2e-f18d-4bea-b311-300b2c9a6da1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:27.058103 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0fd7ed2e-f18d-4bea-b311-300b2c9a6da1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:27.062117 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4226dec0-653d-4cb4-ba7b-3ab5ec189ce6 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:27.062738 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-4226dec0-653d-4cb4-ba7b-3ab5ec189ce6 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:27.065846 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0fd7ed2e-f18d-4bea-b311-300b2c9a6da1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:27.072916 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4226dec0-653d-4cb4-ba7b-3ab5ec189ce6 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:27.074304 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4226dec0-653d-4cb4-ba7b-3ab5ec189ce6 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:27.078397 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4226dec0-653d-4cb4-ba7b-3ab5ec189ce6 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:27.078397 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4226dec0-653d-4cb4-ba7b-3ab5ec189ce6 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:27.078397 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4226dec0-653d-4cb4-ba7b-3ab5ec189ce6 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:27.078397 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4226dec0-653d-4cb4-ba7b-3ab5ec189ce6 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:27.291306 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0fd7ed2e-f18d-4bea-b311-300b2c9a6da1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:27.301813 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0fd7ed2e-f18d-4bea-b311-300b2c9a6da1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff" status: 200 len: 1313 microversion: 2.1 time: 0.285852 Aug 22 17:17:27.303117 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 622/1229] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:27 2022] GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:27.308782 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-126a5292-b802-41e5-b1e7-88dd1075910f tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f8009624e50>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:27.336045 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-126a5292-b802-41e5-b1e7-88dd1075910f tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] HTTP exception thrown: Image not found. Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-126a5292-b802-41e5-b1e7-88dd1075910f tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Request method failure captured: Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2 HTTP/1.1 Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7ngkkZYmh6Y0J1fzsOeHzKO9bIe1stZizPI1KvB5U0w04QK5uCT_3S109vOdtLJk18ANslR1IH0MnH6FPM7jTzhn6hyufK1r3sFJWHSAt39QtywwAnfsB-R5Bpw5ZdPrIoG3WwzbM4ucuM18f_F9SwWggoQbMg-Q4EUt7fj5WwSSLI Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 81a86484222946699be05f1087e2d005 Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ImagesOneServerTestJSON-653112909 Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/81a86484222946699be05f1087e2d005"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_81a86484222946699be05f1087e2d005", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/81a86484222946699be05f1087e2d005"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/81a86484222946699be05f1087e2d005"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ImagesOneServerTestJSON-653112909 Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 81a86484222946699be05f1087e2d005 Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-653112909 Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ImagesOneServerTestJSON-653112909-project Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: c2367b6e03a249b69e17156366ebbb53 Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ImagesOneServerTestJSON-653112909-project Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: exception: Image not found. Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '8c0f8380-2106-4601-abae-0ba6246a4cb2'} Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8c0f8380-2106-4601-abae-0ba6246a4cb2 Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 22 17:17:27.365925 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8c0f8380-2106-4601-abae-0ba6246a4cb2 could not be found. Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-126a5292-b802-41e5-b1e7-88dd1075910f tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Returning 404 to user: Image not found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-126a5292-b802-41e5-b1e7-88dd1075910f tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2" status: 404 len: 62 microversion: 2.1 time: 0.063199 Aug 22 17:17:27.376157 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 623/1230] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:27 2022] GET /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:17:27.385398 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-84e8e479-d576-45dd-ad95-00224022f993 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Action: 'create', calling method: .version_select at 0x7f80095f14c0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-448890088", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:27.387596 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-84e8e479-d576-45dd-ad95-00224022f993 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] HTTP exception thrown: Security group id should be uuid Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-84e8e479-d576-45dd-ad95-00224022f993 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Request method failure captured: Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 130 Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7oQkInSU3xbiUaVRp-aidVGk-7Seh3ChWcVqi7snNYZMX2Aa8I3QiPyRapzfw9nJvzwNAXZQKC42q-Fea34wP50yDIT386AH_VsSoYZ9-FQMxEKtiq-A6i4VbrMbn9_lamziIzJ6MkWbxS3204kX4_l7Qk4ccDEr7labaoGE_tx8vg Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 7e00a640064847bf97024f2e31af7edf Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7e00a640064847bf97024f2e31af7edf", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 7e00a640064847bf97024f2e31af7edf Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 3c685f003ef84558a137b39987defe0f Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-448890088", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: exception: Security group id should be uuid Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-448890088', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:27.389037 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:27.393560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 22 17:17:27.393560 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:27.393560 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-84e8e479-d576-45dd-ad95-00224022f993 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Returning 400 to user: Security group id should be uuid {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:27.393560 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-84e8e479-d576-45dd-ad95-00224022f993 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.016339 Aug 22 17:17:27.395524 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 624/1231] 10.222.0.96 () {60 vars in 1195 bytes} [Mon Aug 22 17:17:27 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 22 17:17:27.402482 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-52b22019-229b-4126-8de6-f14fea47430a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009624820>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:27.418450 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4226dec0-653d-4cb4-ba7b-3ab5ec189ce6 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1617 microversion: 2.1 time: 0.361216 Aug 22 17:17:27.419444 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 608/1232] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:27 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1617 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:27.426045 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f359cfd1-a945-4c56-ac27-24c8f1503937 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:27.445748 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f359cfd1-a945-4c56-ac27-24c8f1503937 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.025037 Aug 22 17:17:27.461094 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 609/1233] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:17:27 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:27.480191 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-3f75a8d3-306e-43fb-a521-4f3cbf98cc96 tempest-ServerActionsTestJSON-1480040175 tempest-ServerActionsTestJSON-1480040175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2084719183", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e7f82692-a422-4939-8224-3d511fcabe98"}], "security_groups": [{"name": "tempest-securitygroup--80714530"}], "key_name": "tempest-keypair-2061205307", "user_data": "}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:27.544361 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-52b22019-229b-4126-8de6-f14fea47430a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.144044 Aug 22 17:17:27.549652 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 625/1234] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:17:27 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:27.562124 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3dd56036-7914-4960-ae02-6f4763ac7868 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1835451424"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:27.564773 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-3dd56036-7914-4960-ae02-6f4763ac7868 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:27.578324 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3dd56036-7914-4960-ae02-6f4763ac7868 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:27.578831 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3dd56036-7914-4960-ae02-6f4763ac7868 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:27.579535 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3dd56036-7914-4960-ae02-6f4763ac7868 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:27.585557 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3dd56036-7914-4960-ae02-6f4763ac7868 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:27.586170 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3dd56036-7914-4960-ae02-6f4763ac7868 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:27.586708 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3dd56036-7914-4960-ae02-6f4763ac7868 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:27.699242 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-3f75a8d3-306e-43fb-a521-4f3cbf98cc96 tempest-ServerActionsTestJSON-1480040175 tempest-ServerActionsTestJSON-1480040175-project] validate_networks() for [('e7f82692-a422-4939-8224-3d511fcabe98', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-3f75a8d3-306e-43fb-a521-4f3cbf98cc96 tempest-ServerActionsTestJSON-1480040175 tempest-ServerActionsTestJSON-1480040175-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f2769fae-7276-4c3f-89b3-a1022c2aa214) Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:17:28.023075 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f2769fae-7276-4c3f-89b3-a1022c2aa214) Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-3f75a8d3-306e-43fb-a521-4f3cbf98cc96 tempest-ServerActionsTestJSON-1480040175 tempest-ServerActionsTestJSON-1480040175-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-3f75a8d3-306e-43fb-a521-4f3cbf98cc96 tempest-ServerActionsTestJSON-1480040175 tempest-ServerActionsTestJSON-1480040175-project] Request method failure captured: Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 492 Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7oJ9YftjGPxS3_-3AAmXD62DVx0YnfaUUJme6426wT_5jNU1YJDp0ziMm20VzLD6D_CW74LTpSNszr8q8TjZ1JbZyx4snqNrbJbsmokUWPJkGPpQsvwuvE5vOv1xLn4QMfR-1GJLooRZ0NjKMjDseu_X-2LGt_vowjLd--e1Ms4ai8 Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: d17f397f16914eacac75c90f6c56150f Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServerActionsTestJSON-1480040175 Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d17f397f16914eacac75c90f6c56150f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_d17f397f16914eacac75c90f6c56150f", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d17f397f16914eacac75c90f6c56150f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/d17f397f16914eacac75c90f6c56150f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServerActionsTestJSON-1480040175 Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: d17f397f16914eacac75c90f6c56150f Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServerActionsTestJSON-1480040175 Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServerActionsTestJSON-1480040175-project Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 71971665a85044aea8b7b2cf5c020b46 Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServerActionsTestJSON-1480040175-project Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-ServerActionsTestJSON-server-2084719183", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "K4#3*xP*^JkR_tO", "networks": [{"uuid": "e7f82692-a422-4939-8224-3d511fcabe98"}], "security_groups": [{"name": "tempest-securitygroup--80714530"}], "key_name": "tempest-keypair-2061205307", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:28.027766 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-ServerActionsTestJSON-server-2084719183', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'adminPass': 'K4#3*xP*^JkR_tO', 'networks': [{'uuid': 'e7f82692-a422-4939-8224-3d511fcabe98'}], 'security_groups': [{'name': 'tempest-securitygroup--80714530'}], 'key_name': 'tempest-keypair-2061205307', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:17:28.031443 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f2769fae-7276-4c3f-89b3-a1022c2aa214) Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-3f75a8d3-306e-43fb-a521-4f3cbf98cc96 tempest-ServerActionsTestJSON-1480040175 tempest-ServerActionsTestJSON-1480040175-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-3f75a8d3-306e-43fb-a521-4f3cbf98cc96 tempest-ServerActionsTestJSON-1480040175 tempest-ServerActionsTestJSON-1480040175-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.561307 Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 610/1235] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:17:27 2022] POST /compute/v2.1/servers => generated 214 bytes in 566 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:17:28.042523 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-3200106e-14a5-48bd-96de-1c95c5da3370 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Action: 'create', calling method: .version_select at 0x7f8009bf3b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1540829453", "description": "tempest-description-174182461"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:28.057525 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3dd56036-7914-4960-ae02-6f4763ac7868 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "POST /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01/action" status: 202 len: 0 microversion: 2.1 time: 0.509957 Aug 22 17:17:28.063644 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 626/1236] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:17:27 2022] POST /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 22 17:17:28.064618 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3d994f44-1d8c-4325-981e-737cda852f6c tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:28.067436 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:28.203561 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3d994f44-1d8c-4325-981e-737cda852f6c tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "DELETE /compute/v2.1/os-server-groups/a026a449-71b8-4eed-a1b9-58fc3553d49b" status: 204 len: 0 microversion: 2.1 time: 0.143555 Aug 22 17:17:28.204515 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 627/1237] 10.222.0.96 () {58 vars in 1266 bytes} [Mon Aug 22 17:17:28 2022] DELETE /compute/v2.1/os-server-groups/a026a449-71b8-4eed-a1b9-58fc3553d49b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:17:28.211346 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9b24bb8b-ea9c-4feb-92af-da2b990153a2 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80095bf160>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:28.339649 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9b24bb8b-ea9c-4feb-92af-da2b990153a2 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/detail?changes-since=2022-08-22T17%3A14%3A38Z" status: 200 len: 6330 microversion: 2.1 time: 0.133584 Aug 22 17:17:28.340737 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 628/1238] 10.222.0.96 () {58 vars in 1220 bytes} [Mon Aug 22 17:17:28 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-22T17%3A14%3A38Z => generated 6330 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:28.359340 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-54b39b7c-05b6-478d-a66d-820c0719579e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2022382364", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "de1802ae-582c-4cc0-bda9-86b08d26493f"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:28.443757 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-54b39b7c-05b6-478d-a66d-820c0719579e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] validate_networks() for None {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:17:28.668937 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-3200106e-14a5-48bd-96de-1c95c5da3370 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.636941 Aug 22 17:17:28.673598 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 611/1239] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:17:28 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:28.680189 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8f7f7013-0797-4917-a929-42bd0873b5d5 tempest-ServerActionsTestJSON-1480040175 tempest-ServerActionsTestJSON-1480040175-project] Calling method '.version_select at 0x7f800a04eaf0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:28.793414 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8f7f7013-0797-4917-a929-42bd0873b5d5 tempest-ServerActionsTestJSON-1480040175 tempest-ServerActionsTestJSON-1480040175-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061205307" status: 202 len: 0 microversion: 2.1 time: 0.121788 Aug 22 17:17:28.794009 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 612/1240] 10.222.0.96 () {58 vars in 1221 bytes} [Mon Aug 22 17:17:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061205307 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:17:28.820930 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b7c93dc8-e3d5-4941-a117-8d760acb19b3 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f8009dded30>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:28.901863 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b7c93dc8-e3d5-4941-a117-8d760acb19b3 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1427 microversion: 2.1 time: 0.104749 Aug 22 17:17:28.904384 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 613/1241] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:28 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1427 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:28.911858 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-54b39b7c-05b6-478d-a66d-820c0719579e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:17:28.915055 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-54b39b7c-05b6-478d-a66d-820c0719579e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:17:28.915055 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-54b39b7c-05b6-478d-a66d-820c0719579e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:17:28.915055 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-54b39b7c-05b6-478d-a66d-820c0719579e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:17:28.915391 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-41e0e5ea-7fd0-4a50-bcb7-e52204e1c71e tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:28.915514 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-54b39b7c-05b6-478d-a66d-820c0719579e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:17:28.926034 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-41e0e5ea-7fd0-4a50-bcb7-e52204e1c71e tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.018486 Aug 22 17:17:28.927148 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 614/1242] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:17:28 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:28.933336 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-54b39b7c-05b6-478d-a66d-820c0719579e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:28.934719 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-34338779-5c79-46c1-a1b0-bebb347defa1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:28.935094 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-54b39b7c-05b6-478d-a66d-820c0719579e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:28.935796 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-34338779-5c79-46c1-a1b0-bebb347defa1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 256c1311-1a56-4547-a142-0daf98661aff] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:28.935926 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-54b39b7c-05b6-478d-a66d-820c0719579e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:28.936665 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-54b39b7c-05b6-478d-a66d-820c0719579e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:28.937164 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-54b39b7c-05b6-478d-a66d-820c0719579e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:28.940382 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-54b39b7c-05b6-478d-a66d-820c0719579e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:28.948151 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-34338779-5c79-46c1-a1b0-bebb347defa1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:28.948916 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-34338779-5c79-46c1-a1b0-bebb347defa1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:28.949606 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-34338779-5c79-46c1-a1b0-bebb347defa1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:28.952174 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-34338779-5c79-46c1-a1b0-bebb347defa1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:28.952878 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-34338779-5c79-46c1-a1b0-bebb347defa1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:28.954052 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-34338779-5c79-46c1-a1b0-bebb347defa1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:28.963592 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-54b39b7c-05b6-478d-a66d-820c0719579e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for project d789047469894e1fbe5af3a109a95b4c. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:17:28.969933 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-54b39b7c-05b6-478d-a66d-820c0719579e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Getting quotas for user 43188026fda44118ad642b7065108966 and project d789047469894e1fbe5af3a109a95b4c. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:17:28.994190 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-54b39b7c-05b6-478d-a66d-820c0719579e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Going to run 1 instances... {{(pid=123015) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:17:28.997061 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-54b39b7c-05b6-478d-a66d-820c0719579e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:17:29.151986 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-34338779-5c79-46c1-a1b0-bebb347defa1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:29.160927 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-34338779-5c79-46c1-a1b0-bebb347defa1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff" status: 200 len: 1463 microversion: 2.1 time: 0.232104 Aug 22 17:17:29.161563 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 615/1243] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:28 2022] GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff => generated 1463 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:29.166267 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1c8e7e36-4410-42fa-abb4-58617788c717 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f800a04e9d0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:29.207384 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-54b39b7c-05b6-478d-a66d-820c0719579e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.865310 Aug 22 17:17:29.218909 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 629/1244] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:17:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:17:29.230024 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b27d4ef7-5e8b-4975-9932-f8ba78ecec78 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Action: 'create', calling method: .version_select at 0x7f800958b1f0>, body: {"security_group_rule": {"parent_group_id": "3807281c-9fae-44fa-9185-778a673ed23b", "ip_protocol": "tempest-999-774261055", "from_port": 22, "to_port": 22}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:29.254200 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1c8e7e36-4410-42fa-abb4-58617788c717 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-79661852" status: 200 len: 663 microversion: 2.1 time: 0.090287 Aug 22 17:17:29.254200 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 616/1245] 10.222.0.96 () {58 vars in 1248 bytes} [Mon Aug 22 17:17:29 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-79661852 => generated 663 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:29.259074 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-86e47cb9-fe02-4be5-bc2e-8d6f6d42c181 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Action: 'create', calling method: .version_select at 0x7f8009fbd9d0>, body: {"server_group": {"name": "tempest-server-group-718511292", "policies": ["affinity"]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:29.278080 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-86e47cb9-fe02-4be5-bc2e-8d6f6d42c181 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:17:29.286128 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-86e47cb9-fe02-4be5-bc2e-8d6f6d42c181 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for user b81ffc2da871454ba703addb45a8e31f and project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:17:29.402327 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-b27d4ef7-5e8b-4975-9932-f8ba78ecec78 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] HTTP exception thrown: Invalid IP protocol tempest-999-774261055. Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b27d4ef7-5e8b-4975-9932-f8ba78ecec78 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Request method failure captured: Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 156 Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7oQkInSU3xbiUaVRp-aidVGk-7Seh3ChWcVqi7snNYZMX2Aa8I3QiPyRapzfw9nJvzwNAXZQKC42q-Fea34wP50yDIT386AH_VsSoYZ9-FQMxEKtiq-A6i4VbrMbn9_lamziIzJ6MkWbxS3204kX4_l7Qk4ccDEr7labaoGE_tx8vg Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 7e00a640064847bf97024f2e31af7edf Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7e00a640064847bf97024f2e31af7edf", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 7e00a640064847bf97024f2e31af7edf Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 3c685f003ef84558a137b39987defe0f Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: {"security_group_rule": {"parent_group_id": "3807281c-9fae-44fa-9185-778a673ed23b", "ip_protocol": "tempest-999-774261055", "from_port": 22, "to_port": 22}} Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: exception: Invalid IP protocol tempest-999-774261055. Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3807281c-9fae-44fa-9185-778a673ed23b', 'ip_protocol': 'tempest-999-774261055', 'from_port': 22, 'to_port': 22}}} Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-774261055. Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-774261055. Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:29.404360 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:29.419425 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:29.419425 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:29.419425 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:29.419425 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:29.419425 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:29.419425 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:29.419425 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-774261055. Aug 22 17:17:29.419425 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:29.419425 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b27d4ef7-5e8b-4975-9932-f8ba78ecec78 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Returning 400 to user: Invalid IP protocol tempest-999-774261055. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:29.419425 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b27d4ef7-5e8b-4975-9932-f8ba78ecec78 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.190644 Aug 22 17:17:29.419425 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 630/1246] 10.222.0.96 () {60 vars in 1195 bytes} [Mon Aug 22 17:17:29 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 22 17:17:29.419425 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-189eb1d2-f2ea-43ec-a49b-578e5fb0b98e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:29.419425 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-189eb1d2-f2ea-43ec-a49b-578e5fb0b98e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:29.421775 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-86e47cb9-fe02-4be5-bc2e-8d6f6d42c181 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:17:29.426742 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-189eb1d2-f2ea-43ec-a49b-578e5fb0b98e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:29.427561 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-189eb1d2-f2ea-43ec-a49b-578e5fb0b98e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:29.428730 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-189eb1d2-f2ea-43ec-a49b-578e5fb0b98e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:29.428885 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-86e47cb9-fe02-4be5-bc2e-8d6f6d42c181 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for user b81ffc2da871454ba703addb45a8e31f and project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:17:29.430044 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-189eb1d2-f2ea-43ec-a49b-578e5fb0b98e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:29.430700 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-189eb1d2-f2ea-43ec-a49b-578e5fb0b98e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:29.431433 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-189eb1d2-f2ea-43ec-a49b-578e5fb0b98e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:29.448359 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-86e47cb9-fe02-4be5-bc2e-8d6f6d42c181 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.193146 Aug 22 17:17:29.448971 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 617/1247] 10.222.0.96 () {60 vars in 1173 bytes} [Mon Aug 22 17:17:29 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:29.453813 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-461bbbb9-33cc-4fd9-8007-8f6582af9d03 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:29.456004 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-461bbbb9-33cc-4fd9-8007-8f6582af9d03 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:29.546315 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-461bbbb9-33cc-4fd9-8007-8f6582af9d03 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:29.556564 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-461bbbb9-33cc-4fd9-8007-8f6582af9d03 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8" status: 200 len: 1217 microversion: 2.1 time: 0.106114 Aug 22 17:17:29.557322 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 618/1248] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:29 2022] GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:29.563328 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-dfd9a4be-a095-4557-9eaf-3b5c53603938 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009e7bdc0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:29.634569 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-dfd9a4be-a095-4557-9eaf-3b5c53603938 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.96%2Fcompute%2Fv2.1%2Fservers%2F8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1467 microversion: 2.1 time: 0.076251 Aug 22 17:17:29.635389 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 619/1249] 10.222.0.96 () {58 vars in 1338 bytes} [Mon Aug 22 17:17:29 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.96%2Fcompute%2Fv2.1%2Fservers%2F8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1467 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:29.644903 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0f7a4428-40a3-4781-b017-575c54c91029 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Action: 'create', calling method: .version_select at 0x7f8009eb83a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1384777960", "description": "tempest-description-1337056607"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:29.725840 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-189eb1d2-f2ea-43ec-a49b-578e5fb0b98e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:29.732714 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-189eb1d2-f2ea-43ec-a49b-578e5fb0b98e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1463 microversion: 2.1 time: 0.324864 Aug 22 17:17:29.733364 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 631/1250] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:29 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1463 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:29.752096 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8afa639a-d1fe-4317-b82f-0c59c448a362 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:29.906243 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8afa639a-d1fe-4317-b82f-0c59c448a362 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "DELETE /compute/v2.1/os-server-groups/9826c9a7-401b-4fb7-8ceb-21694e71c144" status: 204 len: 0 microversion: 2.1 time: 0.171820 Aug 22 17:17:29.906827 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 632/1251] 10.222.0.96 () {58 vars in 1266 bytes} [Mon Aug 22 17:17:29 2022] DELETE /compute/v2.1/os-server-groups/9826c9a7-401b-4fb7-8ceb-21694e71c144 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:17:29.912809 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-274c28e6-ae2b-4639-bf8c-c59848be5a03 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f800958b3a0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:29.969484 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-274c28e6-ae2b-4639-bf8c-c59848be5a03 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.96%2Fcompute%2Fservers%2F8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1467 microversion: 2.1 time: 0.061352 Aug 22 17:17:29.970061 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 633/1252] 10.222.0.96 () {58 vars in 1324 bytes} [Mon Aug 22 17:17:29 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.96%2Fcompute%2Fservers%2F8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1467 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:29.975821 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a74eec10-5fc0-43cf-9f8c-2ab5bc3e92b3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1136824", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "4961b018-19fe-4ddf-8b18-1f392dc1a893"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:30.040310 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-a74eec10-5fc0-43cf-9f8c-2ab5bc3e92b3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] validate_networks() for None {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:17:30.196012 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0f7a4428-40a3-4781-b017-575c54c91029 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.559217 Aug 22 17:17:30.197115 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 620/1253] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:17:29 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:30.201845 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-85044bc4-af21-4f4b-b199-4765b5d38c13 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f8009eb03a0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:30.266590 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-85044bc4-af21-4f4b-b199-4765b5d38c13 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1427 microversion: 2.1 time: 0.067430 Aug 22 17:17:30.267981 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 621/1254] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:30 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1427 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:30.273403 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-92a804b0-ffb0-4c2a-a869-b4af0174cea3 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:30.293719 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-92a804b0-ffb0-4c2a-a869-b4af0174cea3 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.023992 Aug 22 17:17:30.308715 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 622/1255] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:17:30 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:30.320156 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2eedce52-b6b6-42de-bc7d-c2c57862d147 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009a6e5e0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:30.521641 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2eedce52-b6b6-42de-bc7d-c2c57862d147 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7105 microversion: 2.1 time: 0.209774 Aug 22 17:17:30.522613 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 623/1256] 10.222.0.96 () {58 vars in 1170 bytes} [Mon Aug 22 17:17:30 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7105 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:30.541871 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-a74eec10-5fc0-43cf-9f8c-2ab5bc3e92b3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:17:30.542429 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-a74eec10-5fc0-43cf-9f8c-2ab5bc3e92b3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:17:30.542758 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-a74eec10-5fc0-43cf-9f8c-2ab5bc3e92b3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:17:30.543173 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-a74eec10-5fc0-43cf-9f8c-2ab5bc3e92b3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:17:30.545211 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-a74eec10-5fc0-43cf-9f8c-2ab5bc3e92b3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:17:30.545343 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0d44ea34-d55a-4672-802b-8493f5d13fd7 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Action: 'create', calling method: .version_select at 0x7f8009a0caf0>, body: {"security_group_rule": {"parent_group_id": "8ca25f7e-fa56-43a3-9c29-8575aa113263", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:30.554174 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a74eec10-5fc0-43cf-9f8c-2ab5bc3e92b3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:30.554666 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a74eec10-5fc0-43cf-9f8c-2ab5bc3e92b3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:30.555173 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a74eec10-5fc0-43cf-9f8c-2ab5bc3e92b3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:30.555923 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a74eec10-5fc0-43cf-9f8c-2ab5bc3e92b3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:30.556450 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a74eec10-5fc0-43cf-9f8c-2ab5bc3e92b3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:30.557022 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a74eec10-5fc0-43cf-9f8c-2ab5bc3e92b3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:30.611155 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-a74eec10-5fc0-43cf-9f8c-2ab5bc3e92b3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Getting quotas for project d2ecfb79c01d4d40850d84c3cced9240. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:17:30.622333 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-a74eec10-5fc0-43cf-9f8c-2ab5bc3e92b3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Getting quotas for user 72a0121eeba0467b9ac1030b4f2b6638 and project d2ecfb79c01d4d40850d84c3cced9240. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:17:30.636846 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a74eec10-5fc0-43cf-9f8c-2ab5bc3e92b3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Going to run 1 instances... {{(pid=123015) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:17:30.639337 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a74eec10-5fc0-43cf-9f8c-2ab5bc3e92b3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:17:30.641221 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-0d44ea34-d55a-4672-802b-8493f5d13fd7 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0d44ea34-d55a-4672-802b-8493f5d13fd7 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Request method failure captured: Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 138 Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7oQkInSU3xbiUaVRp-aidVGk-7Seh3ChWcVqi7snNYZMX2Aa8I3QiPyRapzfw9nJvzwNAXZQKC42q-Fea34wP50yDIT386AH_VsSoYZ9-FQMxEKtiq-A6i4VbrMbn9_lamziIzJ6MkWbxS3204kX4_l7Qk4ccDEr7labaoGE_tx8vg Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 7e00a640064847bf97024f2e31af7edf Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7e00a640064847bf97024f2e31af7edf", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 7e00a640064847bf97024f2e31af7edf Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 3c685f003ef84558a137b39987defe0f Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: {"security_group_rule": {"parent_group_id": "8ca25f7e-fa56-43a3-9c29-8575aa113263", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8ca25f7e-fa56-43a3-9c29-8575aa113263', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 22 17:17:30.644360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:30.650345 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:30.650345 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:30.650345 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:30.650345 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:30.650345 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:30.650345 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:30.650345 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:30.650345 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 22 17:17:30.650345 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:30.650345 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0d44ea34-d55a-4672-802b-8493f5d13fd7 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:30.650345 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0d44ea34-d55a-4672-802b-8493f5d13fd7 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.121889 Aug 22 17:17:30.651827 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 624/1257] 10.222.0.96 () {60 vars in 1195 bytes} [Mon Aug 22 17:17:30 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:17:30.658997 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-790d7672-1f9a-44a0-ab5f-2f97fbc4d9ff tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Action: 'create', calling method: .version_select at 0x7f800a075f70>, body: {"server_group": {"name": "tempest-server-group-857602566", "policies": ["anti-affinity"]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:30.680118 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-790d7672-1f9a-44a0-ab5f-2f97fbc4d9ff tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:17:30.685494 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-790d7672-1f9a-44a0-ab5f-2f97fbc4d9ff tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for user b81ffc2da871454ba703addb45a8e31f and project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:17:30.695462 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:30.768825 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a74eec10-5fc0-43cf-9f8c-2ab5bc3e92b3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797381 Aug 22 17:17:30.773298 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 634/1258] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:17:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:17:30.785847 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-350e2740-6f28-488c-a493-1c64d3859584 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80095bf9d0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:30.828057 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-790d7672-1f9a-44a0-ab5f-2f97fbc4d9ff tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:17:30.840066 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-790d7672-1f9a-44a0-ab5f-2f97fbc4d9ff tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Getting quotas for user b81ffc2da871454ba703addb45a8e31f and project e503218e8c274c6da9ea8b827068f2eb. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:17:30.874477 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-790d7672-1f9a-44a0-ab5f-2f97fbc4d9ff tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.221531 Aug 22 17:17:30.878371 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 625/1259] 10.222.0.96 () {60 vars in 1173 bytes} [Mon Aug 22 17:17:30 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:30.883619 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d083b8c0-40ee-4efa-af5f-1ba433454f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:30.884813 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-d083b8c0-40ee-4efa-af5f-1ba433454f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:30.894948 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d083b8c0-40ee-4efa-af5f-1ba433454f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:30.895848 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d083b8c0-40ee-4efa-af5f-1ba433454f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:30.896521 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d083b8c0-40ee-4efa-af5f-1ba433454f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:30.897744 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d083b8c0-40ee-4efa-af5f-1ba433454f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:30.898949 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d083b8c0-40ee-4efa-af5f-1ba433454f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:30.899638 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d083b8c0-40ee-4efa-af5f-1ba433454f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:30.953618 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-350e2740-6f28-488c-a493-1c64d3859584 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.172276 Aug 22 17:17:30.954836 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 635/1260] 10.222.0.96 () {58 vars in 1170 bytes} [Mon Aug 22 17:17:30 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:30.991871 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-12dc77ef-7aa8-4f81-9802-fe8facacff04 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Action: 'create', calling method: .version_select at 0x7f80095fcdc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-479265443", "description": "tempest-description-1806519779"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:31.016281 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-d083b8c0-40ee-4efa-af5f-1ba433454f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:31.037132 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d083b8c0-40ee-4efa-af5f-1ba433454f7f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8" status: 200 len: 1221 microversion: 2.1 time: 0.156893 Aug 22 17:17:31.038690 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 626/1261] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:30 2022] GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 => generated 1221 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:31.044935 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-be30e1d0-8e05-4559-a02e-1ef71d2fc7d9 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:31.045849 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-be30e1d0-8e05-4559-a02e-1ef71d2fc7d9 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:31.109821 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-be30e1d0-8e05-4559-a02e-1ef71d2fc7d9 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:31.118500 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-be30e1d0-8e05-4559-a02e-1ef71d2fc7d9 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 200 len: 1211 microversion: 2.1 time: 0.077893 Aug 22 17:17:31.134129 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 627/1262] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:31 2022] GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 1211 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:31.138367 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-304eb879-cf09-47a7-a824-3555e49550f9 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:31.274452 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-304eb879-cf09-47a7-a824-3555e49550f9 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "DELETE /compute/v2.1/os-server-groups/f1d85e2b-ebdb-4227-a224-23cd1cc4c71a" status: 204 len: 0 microversion: 2.1 time: 0.153997 Aug 22 17:17:31.279452 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 628/1263] 10.222.0.96 () {58 vars in 1266 bytes} [Mon Aug 22 17:17:31 2022] DELETE /compute/v2.1/os-server-groups/f1d85e2b-ebdb-4227-a224-23cd1cc4c71a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:17:31.281560 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-98c7a9ba-4532-4d4c-935f-9d59fccf262d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009a0ce50>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:31.377286 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-98c7a9ba-4532-4d4c-935f-9d59fccf262d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/11a48bbe-9c58-420e-95bf-5f8489a49f10" status: 200 len: 784 microversion: 2.1 time: 0.100577 Aug 22 17:17:31.378430 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 629/1264] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:31 2022] GET /compute/v2.1/images/11a48bbe-9c58-420e-95bf-5f8489a49f10 => generated 784 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:31.387373 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4be49675-3085-47f9-a221-0579f78a848b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f8009eb6ee0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:31.469252 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4be49675-3085-47f9-a221-0579f78a848b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1427 microversion: 2.1 time: 0.088555 Aug 22 17:17:31.473277 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 630/1265] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:31 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:31.478838 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2242a525-9c0d-4c5b-9edb-65d1dfcd8c90 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:31.495780 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2242a525-9c0d-4c5b-9edb-65d1dfcd8c90 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.024587 Aug 22 17:17:31.505235 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 631/1266] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:17:31 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:31.505235 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-daa14337-797f-4e48-a20b-036288ab4b41 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80099ca5e0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:31.570188 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-daa14337-797f-4e48-a20b-036288ab4b41 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.072220 Aug 22 17:17:31.571431 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 632/1267] 10.222.0.96 () {58 vars in 1158 bytes} [Mon Aug 22 17:17:31 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:31.591926 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-69c30088-5c42-4ce0-b9fc-7cc1d3e346e4 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009be8550>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:31.706382 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-12dc77ef-7aa8-4f81-9802-fe8facacff04 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.745664 Aug 22 17:17:31.706966 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 636/1268] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:17:30 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:31.715086 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-22825be9-9362-4bdc-a757-11100338d734 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1659917544", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "ac2d5cb0-3ed4-4987-a08a-9340899542f2"}]}, "os:scheduler_hints": {"group": "d1ff068e-36a0-4136-a4dc-8dbe5be013ab"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:31.771866 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-22825be9-9362-4bdc-a757-11100338d734 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] validate_networks() for [('ac2d5cb0-3ed4-4987-a08a-9340899542f2', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-22825be9-9362-4bdc-a757-11100338d734 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b546741e-7d74-4dd1-a319-3b0c717936f8) Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:17:32.274815 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:17:32.278879 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:17:32.278879 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:17:32.278879 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:17:32.278879 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:17:32.278879 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:17:32.278879 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:17:32.278879 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:17:32.278879 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:17:32.278879 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:17:32.278879 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:17:32.278879 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:17:32.278879 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:17:32.278879 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:17:32.278879 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:17:32.278879 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b546741e-7d74-4dd1-a319-3b0c717936f8) Aug 22 17:17:32.278879 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:32.281066 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-22825be9-9362-4bdc-a757-11100338d734 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:32.281066 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-22825be9-9362-4bdc-a757-11100338d734 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Request method failure captured: Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 278 Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7oj7h-g9YVZXZDia6JtDGJP9uHg_nvy6eDxklG4DGAKKkqTjvYV8CPkRmLg07uJh2FvfTtRtp1GCmBfEPesU5504II08gw44BYUq86Ddknzea5qN0g9mSDfwkXDcuen-gG-b6mgD3mhbB_AOOqcR6RCfk_JRxDEkGl6NIe1YS5mLjg Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: e503218e8c274c6da9ea8b827068f2eb Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServerGroupTestJSON-326094343 Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e503218e8c274c6da9ea8b827068f2eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_e503218e8c274c6da9ea8b827068f2eb", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e503218e8c274c6da9ea8b827068f2eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/e503218e8c274c6da9ea8b827068f2eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServerGroupTestJSON-326094343 Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: e503218e8c274c6da9ea8b827068f2eb Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServerGroupTestJSON-326094343 Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServerGroupTestJSON-326094343-project Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: b81ffc2da871454ba703addb45a8e31f Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServerGroupTestJSON-326094343-project Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ServerGroupTestJSON-server-1659917544", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "ac2d5cb0-3ed4-4987-a08a-9340899542f2"}]}, "os:scheduler_hints": {"group": "d1ff068e-36a0-4136-a4dc-8dbe5be013ab"}} Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ServerGroupTestJSON-server-1659917544', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'ac2d5cb0-3ed4-4987-a08a-9340899542f2'}]}, 'os:scheduler_hints': {'group': 'd1ff068e-36a0-4136-a4dc-8dbe5be013ab'}}} Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:17:32.283904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b546741e-7d74-4dd1-a319-3b0c717936f8) Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:32.289460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:17:32.294282 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:17:32.294282 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:32.294282 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:32.294282 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:32.294282 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:32.294282 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:32.294282 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:32.294282 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:32.294282 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:32.294282 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:32.294282 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:32.294282 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:32.294282 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:32.294282 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:32.294282 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-22825be9-9362-4bdc-a757-11100338d734 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:32.294282 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:32.294282 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-22825be9-9362-4bdc-a757-11100338d734 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.577655 Aug 22 17:17:32.294282 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 637/1269] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:17:31 2022] POST /compute/v2.1/servers => generated 214 bytes in 579 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:17:32.294282 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-386f9ec1-b461-411c-b94f-47f94b839555 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Action: 'create', calling method: .version_select at 0x7f800958b9d0>, body: {"security_group_rule": {"parent_group_id": "4d4ab826-b47c-4d44-8c56-08013923a646", "ip_protocol": "tcp", "from_port": 22, "to_port": 856696359}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:32.578788 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-386f9ec1-b461-411c-b94f-47f94b839555 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] HTTP exception thrown: Invalid port range 22:856696359. Valid TCP ports should be between 1-65535 Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-386f9ec1-b461-411c-b94f-47f94b839555 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Request method failure captured: Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 145 Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7oQkInSU3xbiUaVRp-aidVGk-7Seh3ChWcVqi7snNYZMX2Aa8I3QiPyRapzfw9nJvzwNAXZQKC42q-Fea34wP50yDIT386AH_VsSoYZ9-FQMxEKtiq-A6i4VbrMbn9_lamziIzJ6MkWbxS3204kX4_l7Qk4ccDEr7labaoGE_tx8vg Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 7e00a640064847bf97024f2e31af7edf Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7e00a640064847bf97024f2e31af7edf", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 7e00a640064847bf97024f2e31af7edf Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 3c685f003ef84558a137b39987defe0f Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: {"security_group_rule": {"parent_group_id": "4d4ab826-b47c-4d44-8c56-08013923a646", "ip_protocol": "tcp", "from_port": 22, "to_port": 856696359}} Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: exception: Invalid port range 22:856696359. Valid TCP ports should be between 1-65535 Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4d4ab826-b47c-4d44-8c56-08013923a646', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 856696359}}} Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:856696359. Valid TCP ports should be between 1-65535 Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:856696359. Valid TCP ports should be between 1-65535 Aug 22 17:17:32.581498 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:32.590935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:32.590935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:32.590935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:32.590935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:32.590935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:32.590935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:32.590935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:32.590935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:856696359. Valid TCP ports should be between 1-65535 Aug 22 17:17:32.590935 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:32.590935 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-386f9ec1-b461-411c-b94f-47f94b839555 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Returning 400 to user: Invalid port range 22:856696359. Valid TCP ports should be between 1-65535 {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:32.590935 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-386f9ec1-b461-411c-b94f-47f94b839555 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.295653 Aug 22 17:17:32.590935 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 638/1270] 10.222.0.96 () {60 vars in 1195 bytes} [Mon Aug 22 17:17:32 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 297 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:17:32.599657 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0c379042-51e6-4c2e-a454-76818fd9c986 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:32.605316 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0c379042-51e6-4c2e-a454-76818fd9c986 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:32.615213 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0c379042-51e6-4c2e-a454-76818fd9c986 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:32.615573 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0c379042-51e6-4c2e-a454-76818fd9c986 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:32.616016 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0c379042-51e6-4c2e-a454-76818fd9c986 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:32.616789 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0c379042-51e6-4c2e-a454-76818fd9c986 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:32.617549 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0c379042-51e6-4c2e-a454-76818fd9c986 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:32.618221 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0c379042-51e6-4c2e-a454-76818fd9c986 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:32.987022 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0c379042-51e6-4c2e-a454-76818fd9c986 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:32.995394 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0c379042-51e6-4c2e-a454-76818fd9c986 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8" status: 200 len: 1287 microversion: 2.1 time: 0.404776 Aug 22 17:17:32.996325 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 639/1271] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:32 2022] GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 => generated 1287 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:33.001051 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-174502ad-0701-4ac8-b405-7691778a831f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:33.001686 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-174502ad-0701-4ac8-b405-7691778a831f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:33.008892 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-174502ad-0701-4ac8-b405-7691778a831f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:33.009414 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-174502ad-0701-4ac8-b405-7691778a831f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:33.009847 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-174502ad-0701-4ac8-b405-7691778a831f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:33.010552 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-174502ad-0701-4ac8-b405-7691778a831f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:33.011010 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-174502ad-0701-4ac8-b405-7691778a831f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:33.011430 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-174502ad-0701-4ac8-b405-7691778a831f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:33.147264 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-174502ad-0701-4ac8-b405-7691778a831f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:33.165700 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-174502ad-0701-4ac8-b405-7691778a831f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 200 len: 1207 microversion: 2.1 time: 0.168165 Aug 22 17:17:33.166506 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 640/1272] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:32 2022] GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 1207 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:33.177441 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a2ec1e59-3567-478b-a5dd-445709a69e59 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:33.212379 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a2ec1e59-3567-478b-a5dd-445709a69e59 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.044478 Aug 22 17:17:33.219911 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 641/1273] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:17:33 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:33.227638 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4edcb23b-3ddf-45e2-8384-7bc93a3a8f8d tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f80095f1280>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:33.854006 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-69c30088-5c42-4ce0-b9fc-7cc1d3e346e4 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "DELETE /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c" status: 204 len: 0 microversion: 2.1 time: 2.267063 Aug 22 17:17:33.855241 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 633/1274] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:31 2022] DELETE /compute/v2.1/images/5735cf5d-bdc2-4983-9d13-ed25e107ac8c => generated 0 bytes in 2269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:17:33.862861 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d33e47a2-365f-48e5-a584-c5fecbc3c3f1 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Action: 'create', calling method: .version_select at 0x7f8009a0c4c0>, body: {"security_group_rule": {"parent_group_id": "c0adf337-d05f-444a-b52b-901bb0167109", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:33.944514 n-d-854030-1 devstack@n-api.service[123016]: DEBUG neutronclient.v2_0.client [None req-d33e47a2-365f-48e5-a584-c5fecbc3c3f1 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c0adf337-d05f-444a-b52b-901bb0167109 does not exist", "detail": ""}} {{(pid=123016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:17:33.945393 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.security_group_api [None req-d33e47a2-365f-48e5-a584-c5fecbc3c3f1 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Neutron security group c0adf337-d05f-444a-b52b-901bb0167109 not found {{(pid=123016) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 22 17:17:33.946164 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-d33e47a2-365f-48e5-a584-c5fecbc3c3f1 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] HTTP exception thrown: Security group c0adf337-d05f-444a-b52b-901bb0167109 does not exist Aug 22 17:17:33.946164 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-c9414b3a-ffb6-4720-9243-6b2db0d0ad9a'] Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d33e47a2-365f-48e5-a584-c5fecbc3c3f1 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Request method failure captured: Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 138 Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7oQkInSU3xbiUaVRp-aidVGk-7Seh3ChWcVqi7snNYZMX2Aa8I3QiPyRapzfw9nJvzwNAXZQKC42q-Fea34wP50yDIT386AH_VsSoYZ9-FQMxEKtiq-A6i4VbrMbn9_lamziIzJ6MkWbxS3204kX4_l7Qk4ccDEr7labaoGE_tx8vg Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 7e00a640064847bf97024f2e31af7edf Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7e00a640064847bf97024f2e31af7edf", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 7e00a640064847bf97024f2e31af7edf Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 3c685f003ef84558a137b39987defe0f Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: {"security_group_rule": {"parent_group_id": "c0adf337-d05f-444a-b52b-901bb0167109", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: exception: Security group c0adf337-d05f-444a-b52b-901bb0167109 does not exist Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-c9414b3a-ffb6-4720-9243-6b2db0d0ad9a'] Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c0adf337-d05f-444a-b52b-901bb0167109', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 22 17:17:33.948462 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c0adf337-d05f-444a-b52b-901bb0167109 does not exist Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9414b3a-ffb6-4720-9243-6b2db0d0ad9a'] Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c0adf337-d05f-444a-b52b-901bb0167109 does not exist Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9414b3a-ffb6-4720-9243-6b2db0d0ad9a'] Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c0adf337-d05f-444a-b52b-901bb0167109 does not exist Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9414b3a-ffb6-4720-9243-6b2db0d0ad9a'] Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c0adf337-d05f-444a-b52b-901bb0167109 does not exist Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9414b3a-ffb6-4720-9243-6b2db0d0ad9a'] Aug 22 17:17:33.953143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:33.958535 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d33e47a2-365f-48e5-a584-c5fecbc3c3f1 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Returning 404 to user: Security group c0adf337-d05f-444a-b52b-901bb0167109 does not exist Aug 22 17:17:33.958535 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-c9414b3a-ffb6-4720-9243-6b2db0d0ad9a'] {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:33.964446 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-4edcb23b-3ddf-45e2-8384-7bc93a3a8f8d tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1427 microversion: 2.1 time: 0.742142 Aug 22 17:17:33.964446 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 642/1275] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:33 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1427 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:33.965372 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d33e47a2-365f-48e5-a584-c5fecbc3c3f1 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.103717 Aug 22 17:17:33.965372 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 634/1276] 10.222.0.96 () {60 vars in 1195 bytes} [Mon Aug 22 17:17:33 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:17:33.978616 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-de4025d5-78de-4883-8727-fe3abfdddef0 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:33.995170 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-260bb004-d846-4627-aefb-75e4c7dfc2b4 req-28552a1c-42b2-438f-b701-cb7625c88259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9580929a-e453-41ef-a4e9-330cede53f01", "name": "network-vif-plugged", "status": "completed", "tag": "ae70627f-e44d-42a8-9bae-1081a5f5e717"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:34.009972 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-de4025d5-78de-4883-8727-fe3abfdddef0 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "GET /compute/v2.1/os-server-groups/d1ff068e-36a0-4136-a4dc-8dbe5be013ab" status: 200 len: 183 microversion: 2.1 time: 0.043075 Aug 22 17:17:34.010681 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 635/1277] 10.222.0.96 () {58 vars in 1263 bytes} [Mon Aug 22 17:17:33 2022] GET /compute/v2.1/os-server-groups/d1ff068e-36a0-4136-a4dc-8dbe5be013ab => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:34.030002 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1b4b659f-5468-4ffe-93c2-d9841df27f73 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009a0cf70>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:34.041783 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-260bb004-d846-4627-aefb-75e4c7dfc2b4 req-28552a1c-42b2-438f-b701-cb7625c88259 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:34.042328 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-260bb004-d846-4627-aefb-75e4c7dfc2b4 req-28552a1c-42b2-438f-b701-cb7625c88259 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:34.042801 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-260bb004-d846-4627-aefb-75e4c7dfc2b4 req-28552a1c-42b2-438f-b701-cb7625c88259 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:34.074485 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-260bb004-d846-4627-aefb-75e4c7dfc2b4 req-28552a1c-42b2-438f-b701-cb7625c88259 service nova] Creating event network-vif-plugged:ae70627f-e44d-42a8-9bae-1081a5f5e717 for instance 9580929a-e453-41ef-a4e9-330cede53f01 on n-h2-854030-1 Aug 22 17:17:34.084518 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-260bb004-d846-4627-aefb-75e4c7dfc2b4 req-28552a1c-42b2-438f-b701-cb7625c88259 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121995 Aug 22 17:17:34.085486 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 643/1278] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:34.094095 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f8463b37-dd82-4621-9a4d-705aae8665f6 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Calling method '.version_select at 0x7f80095bfb80>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:34.280171 n-d-854030-1 devstack@n-api.service[123015]: DEBUG neutronclient.v2_0.client [None req-f8463b37-dd82-4621-9a4d-705aae8665f6 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule e3d9ff8f-5c9b-4308-b610-b623939b8c09 does not exist", "detail": ""}} {{(pid=123015) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:17:34.281287 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.security_group_api [None req-f8463b37-dd82-4621-9a4d-705aae8665f6 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Neutron security group rule e3d9ff8f-5c9b-4308-b610-b623939b8c09 not found {{(pid=123015) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 22 17:17:34.282801 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-f8463b37-dd82-4621-9a4d-705aae8665f6 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] HTTP exception thrown: Security group rule e3d9ff8f-5c9b-4308-b610-b623939b8c09 does not exist Aug 22 17:17:34.282801 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-af4627ea-99b8-4049-8333-99fa8e6eb9e3'] Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f8463b37-dd82-4621-9a4d-705aae8665f6 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Request method failure captured: Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/os-security-group-rules/e3d9ff8f-5c9b-4308-b610-b623939b8c09 HTTP/1.1 Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7oQkInSU3xbiUaVRp-aidVGk-7Seh3ChWcVqi7snNYZMX2Aa8I3QiPyRapzfw9nJvzwNAXZQKC42q-Fea34wP50yDIT386AH_VsSoYZ9-FQMxEKtiq-A6i4VbrMbn9_lamziIzJ6MkWbxS3204kX4_l7Qk4ccDEr7labaoGE_tx8vg Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 7e00a640064847bf97024f2e31af7edf Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7e00a640064847bf97024f2e31af7edf", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7e00a640064847bf97024f2e31af7edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 7e00a640064847bf97024f2e31af7edf Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635 Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 3c685f003ef84558a137b39987defe0f Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: exception: Security group rule e3d9ff8f-5c9b-4308-b610-b623939b8c09 does not exist Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-af4627ea-99b8-4049-8333-99fa8e6eb9e3'] Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'e3d9ff8f-5c9b-4308-b610-b623939b8c09'} Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 22 17:17:34.286603 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule e3d9ff8f-5c9b-4308-b610-b623939b8c09 does not exist Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af4627ea-99b8-4049-8333-99fa8e6eb9e3'] Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule e3d9ff8f-5c9b-4308-b610-b623939b8c09 does not exist Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af4627ea-99b8-4049-8333-99fa8e6eb9e3'] Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule e3d9ff8f-5c9b-4308-b610-b623939b8c09 does not exist Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af4627ea-99b8-4049-8333-99fa8e6eb9e3'] Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule e3d9ff8f-5c9b-4308-b610-b623939b8c09 does not exist Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af4627ea-99b8-4049-8333-99fa8e6eb9e3'] Aug 22 17:17:34.291484 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:34.302552 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f8463b37-dd82-4621-9a4d-705aae8665f6 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Returning 404 to user: Security group rule e3d9ff8f-5c9b-4308-b610-b623939b8c09 does not exist Aug 22 17:17:34.302552 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-af4627ea-99b8-4049-8333-99fa8e6eb9e3'] {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:34.303751 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f8463b37-dd82-4621-9a4d-705aae8665f6 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-group-rules/e3d9ff8f-5c9b-4308-b610-b623939b8c09" status: 404 len: 199 microversion: 2.1 time: 0.215980 Aug 22 17:17:34.305693 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 644/1279] 10.222.0.96 () {58 vars in 1287 bytes} [Mon Aug 22 17:17:34 2022] DELETE /compute/v2.1/os-security-group-rules/e3d9ff8f-5c9b-4308-b610-b623939b8c09 => generated 199 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:17:34.330657 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-454ac65d-a501-43f7-bf4d-04243bab9432 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:34.358880 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-454ac65d-a501-43f7-bf4d-04243bab9432 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] HTTP exception thrown: Instance group f1d85e2b-ebdb-4227-a224-23cd1cc4c71a could not be found. Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-454ac65d-a501-43f7-bf4d-04243bab9432 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Request method failure captured: Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/os-server-groups/f1d85e2b-ebdb-4227-a224-23cd1cc4c71a HTTP/1.1 Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7oj7h-g9YVZXZDia6JtDGJP9uHg_nvy6eDxklG4DGAKKkqTjvYV8CPkRmLg07uJh2FvfTtRtp1GCmBfEPesU5504II08gw44BYUq86Ddknzea5qN0g9mSDfwkXDcuen-gG-b6mgD3mhbB_AOOqcR6RCfk_JRxDEkGl6NIe1YS5mLjg Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: e503218e8c274c6da9ea8b827068f2eb Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServerGroupTestJSON-326094343 Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e503218e8c274c6da9ea8b827068f2eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_e503218e8c274c6da9ea8b827068f2eb", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e503218e8c274c6da9ea8b827068f2eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/e503218e8c274c6da9ea8b827068f2eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServerGroupTestJSON-326094343 Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: e503218e8c274c6da9ea8b827068f2eb Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServerGroupTestJSON-326094343 Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServerGroupTestJSON-326094343-project Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: b81ffc2da871454ba703addb45a8e31f Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServerGroupTestJSON-326094343-project Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance group f1d85e2b-ebdb-4227-a224-23cd1cc4c71a could not be found. Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'f1d85e2b-ebdb-4227-a224-23cd1cc4c71a'} Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f1d85e2b-ebdb-4227-a224-23cd1cc4c71a could not be found. Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f1d85e2b-ebdb-4227-a224-23cd1cc4c71a could not be found. Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:34.371675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:34.378369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:34.378369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:34.378369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:34.378369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:34.378369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f1d85e2b-ebdb-4227-a224-23cd1cc4c71a could not be found. Aug 22 17:17:34.378369 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:34.380592 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-454ac65d-a501-43f7-bf4d-04243bab9432 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Returning 404 to user: Instance group f1d85e2b-ebdb-4227-a224-23cd1cc4c71a could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:34.384205 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-454ac65d-a501-43f7-bf4d-04243bab9432 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "DELETE /compute/v2.1/os-server-groups/f1d85e2b-ebdb-4227-a224-23cd1cc4c71a" status: 404 len: 117 microversion: 2.1 time: 0.077213 Aug 22 17:17:34.385781 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 645/1280] 10.222.0.96 () {58 vars in 1266 bytes} [Mon Aug 22 17:17:34 2022] DELETE /compute/v2.1/os-server-groups/f1d85e2b-ebdb-4227-a224-23cd1cc4c71a => generated 117 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:17:34.396876 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cd8031d0-99dd-417a-8c9a-d6b74accde14 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:34.405323 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-cd8031d0-99dd-417a-8c9a-d6b74accde14 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:34.425309 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cd8031d0-99dd-417a-8c9a-d6b74accde14 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:34.427823 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cd8031d0-99dd-417a-8c9a-d6b74accde14 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:34.432974 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cd8031d0-99dd-417a-8c9a-d6b74accde14 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:34.434134 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cd8031d0-99dd-417a-8c9a-d6b74accde14 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:34.435152 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cd8031d0-99dd-417a-8c9a-d6b74accde14 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:34.436128 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cd8031d0-99dd-417a-8c9a-d6b74accde14 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:34.980643 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-cd8031d0-99dd-417a-8c9a-d6b74accde14 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:35.002372 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-cd8031d0-99dd-417a-8c9a-d6b74accde14 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8" status: 200 len: 1317 microversion: 2.1 time: 0.613513 Aug 22 17:17:35.008953 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 646/1281] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:34 2022] GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 => generated 1317 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:35.031024 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-63ffa53e-e5e4-48fe-ac6d-9416c40971d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:35.036354 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-63ffa53e-e5e4-48fe-ac6d-9416c40971d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:35.058675 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-63ffa53e-e5e4-48fe-ac6d-9416c40971d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:35.060606 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-63ffa53e-e5e4-48fe-ac6d-9416c40971d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:35.061515 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-63ffa53e-e5e4-48fe-ac6d-9416c40971d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:35.063662 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-63ffa53e-e5e4-48fe-ac6d-9416c40971d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:35.068486 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-63ffa53e-e5e4-48fe-ac6d-9416c40971d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:35.069267 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-63ffa53e-e5e4-48fe-ac6d-9416c40971d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:35.185916 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-63ffa53e-e5e4-48fe-ac6d-9416c40971d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:35.198322 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-63ffa53e-e5e4-48fe-ac6d-9416c40971d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 200 len: 1269 microversion: 2.1 time: 0.185234 Aug 22 17:17:35.199672 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 647/1282] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:35 2022] GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 1269 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:35.207481 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-64008687-2074-4be1-8186-81a1b62d56d1 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Calling method '.version_select at 0x7f80096244c0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:36.042582 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-64008687-2074-4be1-8186-81a1b62d56d1 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/4d4ab826-b47c-4d44-8c56-08013923a646" status: 202 len: 0 microversion: 2.1 time: 0.841205 Aug 22 17:17:36.044054 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 648/1283] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:17:35 2022] DELETE /compute/v2.1/os-security-groups/4d4ab826-b47c-4d44-8c56-08013923a646 => generated 0 bytes in 843 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:17:36.051790 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e5c4e635-adf2-4e07-99a1-dbbdc73e5ba2 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:36.075052 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-e5c4e635-adf2-4e07-99a1-dbbdc73e5ba2 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] HTTP exception thrown: Instance group 9826c9a7-401b-4fb7-8ceb-21694e71c144 could not be found. Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e5c4e635-adf2-4e07-99a1-dbbdc73e5ba2 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Request method failure captured: Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/os-server-groups/9826c9a7-401b-4fb7-8ceb-21694e71c144 HTTP/1.1 Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7oj7h-g9YVZXZDia6JtDGJP9uHg_nvy6eDxklG4DGAKKkqTjvYV8CPkRmLg07uJh2FvfTtRtp1GCmBfEPesU5504II08gw44BYUq86Ddknzea5qN0g9mSDfwkXDcuen-gG-b6mgD3mhbB_AOOqcR6RCfk_JRxDEkGl6NIe1YS5mLjg Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: e503218e8c274c6da9ea8b827068f2eb Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServerGroupTestJSON-326094343 Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e503218e8c274c6da9ea8b827068f2eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_e503218e8c274c6da9ea8b827068f2eb", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e503218e8c274c6da9ea8b827068f2eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/e503218e8c274c6da9ea8b827068f2eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServerGroupTestJSON-326094343 Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: e503218e8c274c6da9ea8b827068f2eb Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServerGroupTestJSON-326094343 Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServerGroupTestJSON-326094343-project Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: b81ffc2da871454ba703addb45a8e31f Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServerGroupTestJSON-326094343-project Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance group 9826c9a7-401b-4fb7-8ceb-21694e71c144 could not be found. Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '9826c9a7-401b-4fb7-8ceb-21694e71c144'} Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9826c9a7-401b-4fb7-8ceb-21694e71c144 could not be found. Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9826c9a7-401b-4fb7-8ceb-21694e71c144 could not be found. Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:36.084139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:36.088881 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:36.088881 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:36.088881 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:36.088881 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:36.088881 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9826c9a7-401b-4fb7-8ceb-21694e71c144 could not be found. Aug 22 17:17:36.088881 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:36.097967 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e5c4e635-adf2-4e07-99a1-dbbdc73e5ba2 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Returning 404 to user: Instance group 9826c9a7-401b-4fb7-8ceb-21694e71c144 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:36.101800 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e5c4e635-adf2-4e07-99a1-dbbdc73e5ba2 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "DELETE /compute/v2.1/os-server-groups/9826c9a7-401b-4fb7-8ceb-21694e71c144" status: 404 len: 117 microversion: 2.1 time: 0.053792 Aug 22 17:17:36.103194 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 649/1284] 10.222.0.96 () {58 vars in 1266 bytes} [Mon Aug 22 17:17:36 2022] DELETE /compute/v2.1/os-server-groups/9826c9a7-401b-4fb7-8ceb-21694e71c144 => generated 117 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:17:36.129929 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a63ca0fb-8951-44fb-8c19-278e612e14c0 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f800958ba60>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:36.161463 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1b4b659f-5468-4ffe-93c2-d9841df27f73 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "DELETE /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f" status: 204 len: 0 microversion: 2.1 time: 2.149623 Aug 22 17:17:36.162121 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 636/1285] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:34 2022] DELETE /compute/v2.1/images/44158ed1-120e-4cbc-b3a4-e57f0c6c3a5f => generated 0 bytes in 2151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:17:36.170567 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6c6b49a7-cae6-46f5-be8f-dd912168210d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:36.172727 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-6c6b49a7-cae6-46f5-be8f-dd912168210d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:36.201513 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6c6b49a7-cae6-46f5-be8f-dd912168210d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:36.209879 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6c6b49a7-cae6-46f5-be8f-dd912168210d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:36.211448 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6c6b49a7-cae6-46f5-be8f-dd912168210d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:36.212217 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6c6b49a7-cae6-46f5-be8f-dd912168210d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:36.214958 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6c6b49a7-cae6-46f5-be8f-dd912168210d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:36.218411 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6c6b49a7-cae6-46f5-be8f-dd912168210d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:36.292251 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a63ca0fb-8951-44fb-8c19-278e612e14c0 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1427 microversion: 2.1 time: 0.183094 Aug 22 17:17:36.300699 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 650/1286] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:36 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1427 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:36.315975 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2a6ab624-70c2-45a5-adf4-529423f49b41 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Calling method '.version_select at 0x7f80095f11f0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:36.646865 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-6c6b49a7-cae6-46f5-be8f-dd912168210d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:36.657325 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-6c6b49a7-cae6-46f5-be8f-dd912168210d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8" status: 200 len: 1317 microversion: 2.1 time: 0.493871 Aug 22 17:17:36.676517 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 637/1287] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:36 2022] GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 => generated 1317 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:36.682572 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f06c2341-7cc8-4e9e-a6ce-3bae4f9fee15 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:36.690078 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-f06c2341-7cc8-4e9e-a6ce-3bae4f9fee15 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] HTTP exception thrown: Instance group a026a449-71b8-4eed-a1b9-58fc3553d49b could not be found. Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f06c2341-7cc8-4e9e-a6ce-3bae4f9fee15 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Request method failure captured: Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: request: DELETE /compute/v2.1/os-server-groups/a026a449-71b8-4eed-a1b9-58fc3553d49b HTTP/1.1 Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7oj7h-g9YVZXZDia6JtDGJP9uHg_nvy6eDxklG4DGAKKkqTjvYV8CPkRmLg07uJh2FvfTtRtp1GCmBfEPesU5504II08gw44BYUq86Ddknzea5qN0g9mSDfwkXDcuen-gG-b6mgD3mhbB_AOOqcR6RCfk_JRxDEkGl6NIe1YS5mLjg Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: e503218e8c274c6da9ea8b827068f2eb Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServerGroupTestJSON-326094343 Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e503218e8c274c6da9ea8b827068f2eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_e503218e8c274c6da9ea8b827068f2eb", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e503218e8c274c6da9ea8b827068f2eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/e503218e8c274c6da9ea8b827068f2eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServerGroupTestJSON-326094343 Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: e503218e8c274c6da9ea8b827068f2eb Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServerGroupTestJSON-326094343 Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServerGroupTestJSON-326094343-project Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: b81ffc2da871454ba703addb45a8e31f Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServerGroupTestJSON-326094343-project Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance group a026a449-71b8-4eed-a1b9-58fc3553d49b could not be found. Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'a026a449-71b8-4eed-a1b9-58fc3553d49b'} Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a026a449-71b8-4eed-a1b9-58fc3553d49b could not be found. Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a026a449-71b8-4eed-a1b9-58fc3553d49b could not be found. Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:36.692799 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:36.700601 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:36.700601 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:36.700601 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:36.700601 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:36.700601 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a026a449-71b8-4eed-a1b9-58fc3553d49b could not be found. Aug 22 17:17:36.700601 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:36.700601 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f06c2341-7cc8-4e9e-a6ce-3bae4f9fee15 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Returning 404 to user: Instance group a026a449-71b8-4eed-a1b9-58fc3553d49b could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:36.700601 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f06c2341-7cc8-4e9e-a6ce-3bae4f9fee15 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "DELETE /compute/v2.1/os-server-groups/a026a449-71b8-4eed-a1b9-58fc3553d49b" status: 404 len: 117 microversion: 2.1 time: 0.016749 Aug 22 17:17:36.700601 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 638/1288] 10.222.0.96 () {58 vars in 1266 bytes} [Mon Aug 22 17:17:36 2022] DELETE /compute/v2.1/os-server-groups/a026a449-71b8-4eed-a1b9-58fc3553d49b => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:17:36.709807 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-43c77694-4b52-4eb5-9b43-b3dd92f04387 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f8009eb0b80>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:37.282395 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2a6ab624-70c2-45a5-adf4-529423f49b41 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/8ca25f7e-fa56-43a3-9c29-8575aa113263" status: 202 len: 0 microversion: 2.1 time: 0.985783 Aug 22 17:17:37.283813 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 651/1289] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:17:36 2022] DELETE /compute/v2.1/os-security-groups/8ca25f7e-fa56-43a3-9c29-8575aa113263 => generated 0 bytes in 988 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:17:37.291581 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-da902c13-1a92-493b-b811-f9faea93ebda tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:37.294182 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-da902c13-1a92-493b-b811-f9faea93ebda tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:37.327698 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-da902c13-1a92-493b-b811-f9faea93ebda tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:37.328454 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-da902c13-1a92-493b-b811-f9faea93ebda tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:37.331702 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-da902c13-1a92-493b-b811-f9faea93ebda tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:37.332940 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-da902c13-1a92-493b-b811-f9faea93ebda tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:37.348294 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-da902c13-1a92-493b-b811-f9faea93ebda tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:37.350945 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-da902c13-1a92-493b-b811-f9faea93ebda tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:38.094258 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-da902c13-1a92-493b-b811-f9faea93ebda tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:38.127348 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-da902c13-1a92-493b-b811-f9faea93ebda tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 200 len: 1311 microversion: 2.1 time: 0.821867 Aug 22 17:17:38.128283 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 652/1290] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:37 2022] GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 1311 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:38.156011 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-79c08151-246a-4c83-b037-f51867872d24 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:38.192544 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-79c08151-246a-4c83-b037-f51867872d24 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] HTTP exception thrown: Instance group 01ad372b-a071-4d97-9942-1ea7a76d8640 could not be found. Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-79c08151-246a-4c83-b037-f51867872d24 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Request method failure captured: Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/os-server-groups/01ad372b-a071-4d97-9942-1ea7a76d8640 HTTP/1.1 Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7oj7h-g9YVZXZDia6JtDGJP9uHg_nvy6eDxklG4DGAKKkqTjvYV8CPkRmLg07uJh2FvfTtRtp1GCmBfEPesU5504II08gw44BYUq86Ddknzea5qN0g9mSDfwkXDcuen-gG-b6mgD3mhbB_AOOqcR6RCfk_JRxDEkGl6NIe1YS5mLjg Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: e503218e8c274c6da9ea8b827068f2eb Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServerGroupTestJSON-326094343 Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e503218e8c274c6da9ea8b827068f2eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_e503218e8c274c6da9ea8b827068f2eb", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e503218e8c274c6da9ea8b827068f2eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/e503218e8c274c6da9ea8b827068f2eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServerGroupTestJSON-326094343 Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: e503218e8c274c6da9ea8b827068f2eb Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServerGroupTestJSON-326094343 Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServerGroupTestJSON-326094343-project Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: b81ffc2da871454ba703addb45a8e31f Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServerGroupTestJSON-326094343-project Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance group 01ad372b-a071-4d97-9942-1ea7a76d8640 could not be found. Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '01ad372b-a071-4d97-9942-1ea7a76d8640'} Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 01ad372b-a071-4d97-9942-1ea7a76d8640 could not be found. Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 01ad372b-a071-4d97-9942-1ea7a76d8640 could not be found. Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:38.201021 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:38.208836 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:38.208836 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:38.208836 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:38.208836 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:38.208836 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 01ad372b-a071-4d97-9942-1ea7a76d8640 could not be found. Aug 22 17:17:38.208836 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:38.218477 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-79c08151-246a-4c83-b037-f51867872d24 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Returning 404 to user: Instance group 01ad372b-a071-4d97-9942-1ea7a76d8640 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:38.219921 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-79c08151-246a-4c83-b037-f51867872d24 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "DELETE /compute/v2.1/os-server-groups/01ad372b-a071-4d97-9942-1ea7a76d8640" status: 404 len: 117 microversion: 2.1 time: 0.090631 Aug 22 17:17:38.221143 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 653/1291] 10.222.0.96 () {58 vars in 1266 bytes} [Mon Aug 22 17:17:38 2022] DELETE /compute/v2.1/os-server-groups/01ad372b-a071-4d97-9942-1ea7a76d8640 => generated 117 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:17:38.226409 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-231548dc-59ea-48d1-b3bb-e17f0f2eee39 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Calling method '.version_select at 0x7f800958bdc0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:38.835191 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-43c77694-4b52-4eb5-9b43-b3dd92f04387 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "DELETE /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a" status: 204 len: 0 microversion: 2.1 time: 2.131911 Aug 22 17:17:38.840360 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 639/1292] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:36 2022] DELETE /compute/v2.1/images/a079e139-240d-4669-964f-4a6dee657e9a => generated 0 bytes in 2140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:17:38.840360 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-3b417603-7cd0-41a2-ad00-3bc8c5e4f711 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f800a075d30>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:38.936614 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-3b417603-7cd0-41a2-ad00-3bc8c5e4f711 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1427 microversion: 2.1 time: 0.099747 Aug 22 17:17:38.944615 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 640/1293] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:38 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:38.963074 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-bdf0331e-a9e1-480a-929d-b59eb4b9c81a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:38.963700 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-bdf0331e-a9e1-480a-929d-b59eb4b9c81a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:38.971394 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bdf0331e-a9e1-480a-929d-b59eb4b9c81a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:38.975464 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bdf0331e-a9e1-480a-929d-b59eb4b9c81a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:38.976812 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bdf0331e-a9e1-480a-929d-b59eb4b9c81a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:38.977683 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bdf0331e-a9e1-480a-929d-b59eb4b9c81a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:38.978122 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bdf0331e-a9e1-480a-929d-b59eb4b9c81a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:38.978558 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bdf0331e-a9e1-480a-929d-b59eb4b9c81a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:39.546099 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-bdf0331e-a9e1-480a-929d-b59eb4b9c81a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:39.558212 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-bdf0331e-a9e1-480a-929d-b59eb4b9c81a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8" status: 200 len: 1317 microversion: 2.1 time: 0.610641 Aug 22 17:17:39.569496 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 641/1294] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:38 2022] GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 => generated 1317 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:39.574539 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-60d716bc-c8ef-4640-a877-f5d03c2647d0 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:39.740953 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-60d716bc-c8ef-4640-a877-f5d03c2647d0 tempest-ServerGroupTestJSON-326094343 tempest-ServerGroupTestJSON-326094343-project] 10.222.0.96 "DELETE /compute/v2.1/os-server-groups/d1ff068e-36a0-4136-a4dc-8dbe5be013ab" status: 204 len: 0 microversion: 2.1 time: 0.168701 Aug 22 17:17:39.745134 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 642/1295] 10.222.0.96 () {58 vars in 1266 bytes} [Mon Aug 22 17:17:39 2022] DELETE /compute/v2.1/os-server-groups/d1ff068e-36a0-4136-a4dc-8dbe5be013ab => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:17:39.758071 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-cdcbfb12-93a2-4373-99f7-b0b2b14bda92 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:39.758811 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-cdcbfb12-93a2-4373-99f7-b0b2b14bda92 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:39.780418 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cdcbfb12-93a2-4373-99f7-b0b2b14bda92 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:39.780970 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cdcbfb12-93a2-4373-99f7-b0b2b14bda92 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:39.781457 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cdcbfb12-93a2-4373-99f7-b0b2b14bda92 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:39.784113 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cdcbfb12-93a2-4373-99f7-b0b2b14bda92 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:39.800163 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cdcbfb12-93a2-4373-99f7-b0b2b14bda92 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:39.801295 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cdcbfb12-93a2-4373-99f7-b0b2b14bda92 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:39.876039 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-cdcbfb12-93a2-4373-99f7-b0b2b14bda92 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Going to try to terminate instance {{(pid=123016) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:17:39.954559 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-231548dc-59ea-48d1-b3bb-e17f0f2eee39 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/3807281c-9fae-44fa-9185-778a673ed23b" status: 202 len: 0 microversion: 2.1 time: 1.731781 Aug 22 17:17:39.957549 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 654/1296] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:17:38 2022] DELETE /compute/v2.1/os-security-groups/3807281c-9fae-44fa-9185-778a673ed23b => generated 0 bytes in 1736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:17:39.963880 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e3779361-6901-49e6-952a-9a621ebccd7c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:39.965524 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-e3779361-6901-49e6-952a-9a621ebccd7c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:40.002876 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e3779361-6901-49e6-952a-9a621ebccd7c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:40.003314 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e3779361-6901-49e6-952a-9a621ebccd7c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:40.005153 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e3779361-6901-49e6-952a-9a621ebccd7c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:40.007821 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e3779361-6901-49e6-952a-9a621ebccd7c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:40.011203 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e3779361-6901-49e6-952a-9a621ebccd7c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:40.011525 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e3779361-6901-49e6-952a-9a621ebccd7c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:40.460278 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e3779361-6901-49e6-952a-9a621ebccd7c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:40.467874 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:40.474330 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e3779361-6901-49e6-952a-9a621ebccd7c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 200 len: 1311 microversion: 2.1 time: 0.515356 Aug 22 17:17:40.475222 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 655/1297] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:39 2022] GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 1311 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:40.481765 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-f47217ea-e578-4a58-b9c5-385903a186ff req-7c4636cd-e0f3-4804-be61-82e716a3bc9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fefacb8-2e26-4e92-937d-58d3d7c720d8", "tag": "cc7c866e-c3d7-4575-a71e-4510cef135f5"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:40.497945 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-f47217ea-e578-4a58-b9c5-385903a186ff req-7c4636cd-e0f3-4804-be61-82e716a3bc9c service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:40.499378 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-f47217ea-e578-4a58-b9c5-385903a186ff req-7c4636cd-e0f3-4804-be61-82e716a3bc9c service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:40.500248 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-f47217ea-e578-4a58-b9c5-385903a186ff req-7c4636cd-e0f3-4804-be61-82e716a3bc9c service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:40.513910 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-f47217ea-e578-4a58-b9c5-385903a186ff req-7c4636cd-e0f3-4804-be61-82e716a3bc9c service nova] Creating event network-changed:cc7c866e-c3d7-4575-a71e-4510cef135f5 for instance 9fefacb8-2e26-4e92-937d-58d3d7c720d8 on n-h2-854030-1 Aug 22 17:17:40.535296 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-f47217ea-e578-4a58-b9c5-385903a186ff req-7c4636cd-e0f3-4804-be61-82e716a3bc9c service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057977 Aug 22 17:17:40.544411 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 656/1298] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:40.548233 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-41404e01-85f7-4091-9c75-5d26f3a223c0 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f80095bf0d0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:40.595432 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:40.630794 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-41404e01-85f7-4091-9c75-5d26f3a223c0 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1427 microversion: 2.1 time: 0.084407 Aug 22 17:17:40.632320 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 657/1299] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:40 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:40.634247 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=36 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:40.638521 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8f25ca5f-a053-4eb4-9ec7-077a10fe79af tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Calling method '.version_select at 0x7f80095fc280>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:40.993602 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-cdcbfb12-93a2-4373-99f7-b0b2b14bda92 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "DELETE /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 204 len: 0 microversion: 2.1 time: 1.244631 Aug 22 17:17:40.993602 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 643/1300] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:17:39 2022] DELETE /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 0 bytes in 1246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:17:40.998812 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ba3ef850-1094-4ac9-bec5-f0e35b9ee84c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:40.999847 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-ba3ef850-1094-4ac9-bec5-f0e35b9ee84c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:41.008417 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ba3ef850-1094-4ac9-bec5-f0e35b9ee84c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:41.008905 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ba3ef850-1094-4ac9-bec5-f0e35b9ee84c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:41.017016 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ba3ef850-1094-4ac9-bec5-f0e35b9ee84c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:41.019391 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ba3ef850-1094-4ac9-bec5-f0e35b9ee84c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:41.020942 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ba3ef850-1094-4ac9-bec5-f0e35b9ee84c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:41.021772 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ba3ef850-1094-4ac9-bec5-f0e35b9ee84c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:41.120521 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=24 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:41.487074 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8f25ca5f-a053-4eb4-9ec7-077a10fe79af tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/47eabde4-22d3-4d8a-b371-e507330b2832" status: 202 len: 0 microversion: 2.1 time: 0.853350 Aug 22 17:17:41.492265 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 658/1301] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:17:40 2022] DELETE /compute/v2.1/os-security-groups/47eabde4-22d3-4d8a-b371-e507330b2832 => generated 0 bytes in 859 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:17:41.497638 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-308a8517-d544-4430-88dd-414488bf6baa tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:41.498655 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-308a8517-d544-4430-88dd-414488bf6baa tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:41.509168 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-308a8517-d544-4430-88dd-414488bf6baa tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:41.509914 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-308a8517-d544-4430-88dd-414488bf6baa tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:41.511513 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-308a8517-d544-4430-88dd-414488bf6baa tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:41.513003 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-308a8517-d544-4430-88dd-414488bf6baa tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:41.513693 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-308a8517-d544-4430-88dd-414488bf6baa tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:41.534791 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-308a8517-d544-4430-88dd-414488bf6baa tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:41.542962 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ba3ef850-1094-4ac9-bec5-f0e35b9ee84c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:41.577951 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ba3ef850-1094-4ac9-bec5-f0e35b9ee84c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8" status: 200 len: 1317 microversion: 2.1 time: 0.583899 Aug 22 17:17:41.582127 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 644/1302] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:40 2022] GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 => generated 1317 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:41.588989 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b485dd66-f4ec-4221-ab88-960390ce8178 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:41.594905 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b485dd66-f4ec-4221-ab88-960390ce8178 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:41.623764 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b485dd66-f4ec-4221-ab88-960390ce8178 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:41.625676 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b485dd66-f4ec-4221-ab88-960390ce8178 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:41.628546 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b485dd66-f4ec-4221-ab88-960390ce8178 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:41.629973 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b485dd66-f4ec-4221-ab88-960390ce8178 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:41.632608 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b485dd66-f4ec-4221-ab88-960390ce8178 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:41.635945 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b485dd66-f4ec-4221-ab88-960390ce8178 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:41.878071 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-308a8517-d544-4430-88dd-414488bf6baa tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:41.888735 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-308a8517-d544-4430-88dd-414488bf6baa tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1472 microversion: 2.1 time: 0.394899 Aug 22 17:17:41.890029 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 659/1303] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:41 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1472 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:41.899455 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e0bd77b4-4c5c-408d-94ef-2c88cdbbc778 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] Calling method '.version_select at 0x7f80095f1820>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:42.339984 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e0bd77b4-4c5c-408d-94ef-2c88cdbbc778 tempest-SecurityGroupRulesNegativeTestJSON-1900173635 tempest-SecurityGroupRulesNegativeTestJSON-1900173635-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/93c35de3-3e95-4c02-8868-aaa531171b71" status: 202 len: 0 microversion: 2.1 time: 0.436706 Aug 22 17:17:42.339984 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 660/1304] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:17:41 2022] DELETE /compute/v2.1/os-security-groups/93c35de3-3e95-4c02-8868-aaa531171b71 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:17:42.339984 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-beb6a7b1-0ac3-48b8-929a-354c491fa528 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f80095bf700>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:42.397014 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-beb6a7b1-0ac3-48b8-929a-354c491fa528 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1427 microversion: 2.1 time: 0.066013 Aug 22 17:17:42.398514 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 661/1305] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:42 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1427 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:42.557711 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b485dd66-f4ec-4221-ab88-960390ce8178 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:42.573753 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b485dd66-f4ec-4221-ab88-960390ce8178 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 200 len: 1311 microversion: 2.1 time: 0.990072 Aug 22 17:17:42.575914 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 645/1306] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:41 2022] GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 1311 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:42.620566 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f3fefcd8-fbcf-423c-8c97-a8ec706bb93a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:42.625213 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f3fefcd8-fbcf-423c-8c97-a8ec706bb93a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:42.668974 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f3fefcd8-fbcf-423c-8c97-a8ec706bb93a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:42.690040 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f3fefcd8-fbcf-423c-8c97-a8ec706bb93a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:42.691149 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f3fefcd8-fbcf-423c-8c97-a8ec706bb93a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:42.702735 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f3fefcd8-fbcf-423c-8c97-a8ec706bb93a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:42.703651 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f3fefcd8-fbcf-423c-8c97-a8ec706bb93a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:42.704880 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f3fefcd8-fbcf-423c-8c97-a8ec706bb93a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:42.770352 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-fd2bbebd-ce27-470e-8af3-acd69e776e66 req-5e0ed6d1-dc9b-4938-88a8-00f1532f1419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "473177e8-4286-43c9-abb3-f54b110ac7ce", "tag": "639dea3e-d6be-4635-a511-ce9ac0735ba1"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:42.816014 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-fd2bbebd-ce27-470e-8af3-acd69e776e66 req-5e0ed6d1-dc9b-4938-88a8-00f1532f1419 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:42.823703 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-fd2bbebd-ce27-470e-8af3-acd69e776e66 req-5e0ed6d1-dc9b-4938-88a8-00f1532f1419 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:42.831501 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-fd2bbebd-ce27-470e-8af3-acd69e776e66 req-5e0ed6d1-dc9b-4938-88a8-00f1532f1419 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:42.858275 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-fd2bbebd-ce27-470e-8af3-acd69e776e66 req-5e0ed6d1-dc9b-4938-88a8-00f1532f1419 service nova] Creating event network-changed:639dea3e-d6be-4635-a511-ce9ac0735ba1 for instance 473177e8-4286-43c9-abb3-f54b110ac7ce on n-h2-854030-1 Aug 22 17:17:42.866874 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-fd2bbebd-ce27-470e-8af3-acd69e776e66 req-5e0ed6d1-dc9b-4938-88a8-00f1532f1419 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104733 Aug 22 17:17:42.867762 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 646/1307] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:42.916238 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-122cf5a2-fbc8-4879-806e-464da548011c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:42.917560 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-122cf5a2-fbc8-4879-806e-464da548011c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:42.948134 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-122cf5a2-fbc8-4879-806e-464da548011c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:42.948779 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-122cf5a2-fbc8-4879-806e-464da548011c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:42.949338 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-122cf5a2-fbc8-4879-806e-464da548011c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:42.950076 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-122cf5a2-fbc8-4879-806e-464da548011c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:42.950581 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-122cf5a2-fbc8-4879-806e-464da548011c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:42.951028 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-122cf5a2-fbc8-4879-806e-464da548011c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:42.957742 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:43.081796 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f3fefcd8-fbcf-423c-8c97-a8ec706bb93a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:43.095751 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f3fefcd8-fbcf-423c-8c97-a8ec706bb93a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8" status: 200 len: 1317 microversion: 2.1 time: 0.491463 Aug 22 17:17:43.101179 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 662/1308] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:42 2022] GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:43.381914 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-122cf5a2-fbc8-4879-806e-464da548011c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:43.390958 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-122cf5a2-fbc8-4879-806e-464da548011c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1472 microversion: 2.1 time: 0.483495 Aug 22 17:17:43.397610 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 647/1309] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:42 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1472 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:43.418232 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-88f31853-a2e6-4e5a-836c-297c86ea1fcf tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f800958baf0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:43.516516 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-88f31853-a2e6-4e5a-836c-297c86ea1fcf tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1427 microversion: 2.1 time: 0.106043 Aug 22 17:17:43.517756 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 663/1310] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:43 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:43.599134 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b1de493a-7c2e-42f7-b2ca-9b2c0fbc8b71 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:43.599730 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b1de493a-7c2e-42f7-b2ca-9b2c0fbc8b71 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:43.631189 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b1de493a-7c2e-42f7-b2ca-9b2c0fbc8b71 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:43.631692 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b1de493a-7c2e-42f7-b2ca-9b2c0fbc8b71 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:43.632233 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b1de493a-7c2e-42f7-b2ca-9b2c0fbc8b71 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:43.632989 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b1de493a-7c2e-42f7-b2ca-9b2c0fbc8b71 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:43.633483 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b1de493a-7c2e-42f7-b2ca-9b2c0fbc8b71 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:43.633914 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b1de493a-7c2e-42f7-b2ca-9b2c0fbc8b71 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:44.119124 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-48eb223f-3aa8-43c6-93d7-66360b642460 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:44.119738 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-48eb223f-3aa8-43c6-93d7-66360b642460 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:44.136656 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-48eb223f-3aa8-43c6-93d7-66360b642460 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:44.137419 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-48eb223f-3aa8-43c6-93d7-66360b642460 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:44.138832 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-48eb223f-3aa8-43c6-93d7-66360b642460 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:44.139782 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-48eb223f-3aa8-43c6-93d7-66360b642460 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:44.141424 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-48eb223f-3aa8-43c6-93d7-66360b642460 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:44.143039 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-48eb223f-3aa8-43c6-93d7-66360b642460 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:45.165738 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-48eb223f-3aa8-43c6-93d7-66360b642460 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:45.165738 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-48eb223f-3aa8-43c6-93d7-66360b642460 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8" status: 200 len: 1317 microversion: 2.1 time: 1.046455 Aug 22 17:17:45.187462 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 664/1311] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:44 2022] GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 => generated 1317 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:45.202835 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-edfafe82-efe0-4179-bb95-5ced75fca425 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:45.204178 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-edfafe82-efe0-4179-bb95-5ced75fca425 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:45.223259 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-edfafe82-efe0-4179-bb95-5ced75fca425 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:45.224164 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-edfafe82-efe0-4179-bb95-5ced75fca425 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:45.224832 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-edfafe82-efe0-4179-bb95-5ced75fca425 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:45.225817 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-edfafe82-efe0-4179-bb95-5ced75fca425 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:45.226523 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-edfafe82-efe0-4179-bb95-5ced75fca425 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:45.227226 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-edfafe82-efe0-4179-bb95-5ced75fca425 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:45.549392 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b1de493a-7c2e-42f7-b2ca-9b2c0fbc8b71 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:45.558066 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b1de493a-7c2e-42f7-b2ca-9b2c0fbc8b71 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 200 len: 1311 microversion: 2.1 time: 1.964711 Aug 22 17:17:45.591603 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 648/1312] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:43 2022] GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 1311 bytes in 1999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:45.603637 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c26e67b5-8420-47a2-837f-8f1bc3e684e4 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f80096fb0d0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:45.700075 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c26e67b5-8420-47a2-837f-8f1bc3e684e4 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1427 microversion: 2.1 time: 0.106584 Aug 22 17:17:45.713528 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 649/1313] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:45 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:46.066889 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-376c1b60-a674-4064-ac2d-b21f0e17c5f0 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-421469264", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": "none"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:46.168474 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-376c1b60-a674-4064-ac2d-b21f0e17c5f0 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:17:46.171344 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-376c1b60-a674-4064-ac2d-b21f0e17c5f0 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:17:46.171344 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-376c1b60-a674-4064-ac2d-b21f0e17c5f0 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:17:46.171344 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-376c1b60-a674-4064-ac2d-b21f0e17c5f0 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:17:46.171344 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-376c1b60-a674-4064-ac2d-b21f0e17c5f0 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:17:46.187414 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-376c1b60-a674-4064-ac2d-b21f0e17c5f0 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:46.188552 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-376c1b60-a674-4064-ac2d-b21f0e17c5f0 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:46.189531 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-376c1b60-a674-4064-ac2d-b21f0e17c5f0 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:46.191116 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-376c1b60-a674-4064-ac2d-b21f0e17c5f0 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:46.191811 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-376c1b60-a674-4064-ac2d-b21f0e17c5f0 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:46.192479 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-376c1b60-a674-4064-ac2d-b21f0e17c5f0 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:46.221409 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-376c1b60-a674-4064-ac2d-b21f0e17c5f0 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Getting quotas for project ce70aa947d304b82a306da97a5d08282. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:17:46.234576 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-376c1b60-a674-4064-ac2d-b21f0e17c5f0 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Getting quotas for user 2746af57c0ac434f9d6b5d1ee7292913 and project ce70aa947d304b82a306da97a5d08282. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:17:46.262919 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-376c1b60-a674-4064-ac2d-b21f0e17c5f0 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Going to run 1 instances... {{(pid=123016) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:17:46.269055 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-376c1b60-a674-4064-ac2d-b21f0e17c5f0 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] [instance: 33454b47-5846-4cf6-9c3d-fc9e83cc79f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:17:46.443012 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-376c1b60-a674-4064-ac2d-b21f0e17c5f0 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.727753 Aug 22 17:17:46.451408 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 650/1314] 10.222.0.96 () {62 vars in 1188 bytes} [Mon Aug 22 17:17:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 22 17:17:46.462748 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b45a09cc-ec5f-4cf1-8de7-42b02758086b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:46.466814 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b45a09cc-ec5f-4cf1-8de7-42b02758086b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:46.519549 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b45a09cc-ec5f-4cf1-8de7-42b02758086b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:46.519549 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b45a09cc-ec5f-4cf1-8de7-42b02758086b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:46.519549 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b45a09cc-ec5f-4cf1-8de7-42b02758086b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:46.519549 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b45a09cc-ec5f-4cf1-8de7-42b02758086b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:46.519549 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b45a09cc-ec5f-4cf1-8de7-42b02758086b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:46.519549 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b45a09cc-ec5f-4cf1-8de7-42b02758086b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:47.588499 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-edfafe82-efe0-4179-bb95-5ced75fca425 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:47.606796 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-edfafe82-efe0-4179-bb95-5ced75fca425 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1472 microversion: 2.1 time: 2.417533 Aug 22 17:17:47.622085 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 665/1315] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:45 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1472 bytes in 2433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:47.633588 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-81643e8e-0951-4a97-9a4a-b45f6c19d946 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:47.634672 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-81643e8e-0951-4a97-9a4a-b45f6c19d946 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] [instance: 33454b47-5846-4cf6-9c3d-fc9e83cc79f8] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:47.867990 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b45a09cc-ec5f-4cf1-8de7-42b02758086b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:47.880708 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b45a09cc-ec5f-4cf1-8de7-42b02758086b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8" status: 200 len: 1317 microversion: 2.1 time: 1.426568 Aug 22 17:17:47.883041 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 651/1316] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:46 2022] GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 => generated 1317 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:47.896147 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e008a78e-7edd-4049-a5a0-14a0d97c810a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:47.899468 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e008a78e-7edd-4049-a5a0-14a0d97c810a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:47.925712 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e008a78e-7edd-4049-a5a0-14a0d97c810a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:47.927384 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e008a78e-7edd-4049-a5a0-14a0d97c810a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:47.928566 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e008a78e-7edd-4049-a5a0-14a0d97c810a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:47.931392 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e008a78e-7edd-4049-a5a0-14a0d97c810a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:47.932608 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e008a78e-7edd-4049-a5a0-14a0d97c810a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:47.934112 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e008a78e-7edd-4049-a5a0-14a0d97c810a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:48.057710 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-81643e8e-0951-4a97-9a4a-b45f6c19d946 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:48.070431 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-81643e8e-0951-4a97-9a4a-b45f6c19d946 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:48.072276 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-81643e8e-0951-4a97-9a4a-b45f6c19d946 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:48.073598 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-81643e8e-0951-4a97-9a4a-b45f6c19d946 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] 10.222.0.96 "GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8" status: 200 len: 1280 microversion: 2.47 time: 0.449694 Aug 22 17:17:48.074390 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 666/1317] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:17:47 2022] GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8 => generated 1280 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:17:48.083566 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-97ac46e0-92d2-4bc1-af28-cfea2668c094 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f8009624670>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:48.162833 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-97ac46e0-92d2-4bc1-af28-cfea2668c094 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1427 microversion: 2.1 time: 0.087202 Aug 22 17:17:48.165286 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 667/1318] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:48 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:48.305836 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-58755053-a23b-4bfc-8176-be817b3a47cc req-3e634c45-599e-4380-999a-090e6d664a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9699e0-8054-4491-91a6-2d8e34898838", "name": "network-vif-deleted", "tag": "0bc75a5b-a857-42d1-be9e-f441f5aad90b"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:48.333343 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-58755053-a23b-4bfc-8176-be817b3a47cc req-3e634c45-599e-4380-999a-090e6d664a5a service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:48.333343 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-58755053-a23b-4bfc-8176-be817b3a47cc req-3e634c45-599e-4380-999a-090e6d664a5a service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:48.333343 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-58755053-a23b-4bfc-8176-be817b3a47cc req-3e634c45-599e-4380-999a-090e6d664a5a service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:48.355929 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-58755053-a23b-4bfc-8176-be817b3a47cc req-3e634c45-599e-4380-999a-090e6d664a5a service nova] Creating event network-vif-deleted:0bc75a5b-a857-42d1-be9e-f441f5aad90b for instance 8a9699e0-8054-4491-91a6-2d8e34898838 on n-h2-854030-1 Aug 22 17:17:48.373716 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-58755053-a23b-4bfc-8176-be817b3a47cc req-3e634c45-599e-4380-999a-090e6d664a5a service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206873 Aug 22 17:17:48.376696 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 668/1319] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:48.631975 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f00ad232-a000-49a7-a037-2266f4df5879 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:48.633351 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f00ad232-a000-49a7-a037-2266f4df5879 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:48.646889 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f00ad232-a000-49a7-a037-2266f4df5879 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:48.647674 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f00ad232-a000-49a7-a037-2266f4df5879 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:48.648828 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f00ad232-a000-49a7-a037-2266f4df5879 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:48.650260 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f00ad232-a000-49a7-a037-2266f4df5879 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:48.675573 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f00ad232-a000-49a7-a037-2266f4df5879 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:48.683373 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f00ad232-a000-49a7-a037-2266f4df5879 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:48.792677 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e008a78e-7edd-4049-a5a0-14a0d97c810a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:48.822916 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e008a78e-7edd-4049-a5a0-14a0d97c810a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 200 len: 1311 microversion: 2.1 time: 0.934024 Aug 22 17:17:48.826125 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 652/1320] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:47 2022] GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 1311 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:48.847379 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f00ad232-a000-49a7-a037-2266f4df5879 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:48.860750 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f00ad232-a000-49a7-a037-2266f4df5879 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1302 microversion: 2.1 time: 0.233027 Aug 22 17:17:48.866063 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 669/1321] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:48 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1302 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:17:48.910745 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-774d4c0c-8cb0-4962-92fd-7307821b0ee1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:48.917413 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-774d4c0c-8cb0-4962-92fd-7307821b0ee1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:48.944176 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-774d4c0c-8cb0-4962-92fd-7307821b0ee1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:48.945184 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-774d4c0c-8cb0-4962-92fd-7307821b0ee1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:48.947313 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-774d4c0c-8cb0-4962-92fd-7307821b0ee1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:48.948554 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-774d4c0c-8cb0-4962-92fd-7307821b0ee1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:48.956206 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-774d4c0c-8cb0-4962-92fd-7307821b0ee1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:48.957037 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-774d4c0c-8cb0-4962-92fd-7307821b0ee1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:49.098633 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8d2873de-cf58-4395-9853-c85313ded06c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:49.099632 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8d2873de-cf58-4395-9853-c85313ded06c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] [instance: 33454b47-5846-4cf6-9c3d-fc9e83cc79f8] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:49.112267 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8d2873de-cf58-4395-9853-c85313ded06c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:49.113407 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8d2873de-cf58-4395-9853-c85313ded06c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:49.114907 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8d2873de-cf58-4395-9853-c85313ded06c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:49.120213 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8d2873de-cf58-4395-9853-c85313ded06c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:49.121608 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8d2873de-cf58-4395-9853-c85313ded06c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:49.123363 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8d2873de-cf58-4395-9853-c85313ded06c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:49.530937 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8d2873de-cf58-4395-9853-c85313ded06c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:49.550339 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8d2873de-cf58-4395-9853-c85313ded06c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:49.560594 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8d2873de-cf58-4395-9853-c85313ded06c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:49.574489 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8d2873de-cf58-4395-9853-c85313ded06c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] 10.222.0.96 "GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8" status: 200 len: 1284 microversion: 2.47 time: 0.469354 Aug 22 17:17:49.578312 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 670/1322] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:17:49 2022] GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8 => generated 1284 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:17:49.596692 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1f286051-1c3d-48ee-9ce1-cd18e0e8110a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f80095bf0d0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:49.724975 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1f286051-1c3d-48ee-9ce1-cd18e0e8110a tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1427 microversion: 2.1 time: 0.143960 Aug 22 17:17:49.727790 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 671/1323] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:49 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1427 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:49.737715 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-88fc4d14-739d-4dcb-96be-48ea09e7d5b3 req-0dc43358-125a-442d-8af8-636b343f4837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fefacb8-2e26-4e92-937d-58d3d7c720d8", "name": "network-vif-plugged", "status": "completed", "tag": "cc7c866e-c3d7-4575-a71e-4510cef135f5"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:49.773230 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-88fc4d14-739d-4dcb-96be-48ea09e7d5b3 req-0dc43358-125a-442d-8af8-636b343f4837 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:49.774242 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-88fc4d14-739d-4dcb-96be-48ea09e7d5b3 req-0dc43358-125a-442d-8af8-636b343f4837 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:49.774957 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-88fc4d14-739d-4dcb-96be-48ea09e7d5b3 req-0dc43358-125a-442d-8af8-636b343f4837 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:49.810937 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-88fc4d14-739d-4dcb-96be-48ea09e7d5b3 req-0dc43358-125a-442d-8af8-636b343f4837 service nova] Creating event network-vif-plugged:cc7c866e-c3d7-4575-a71e-4510cef135f5 for instance 9fefacb8-2e26-4e92-937d-58d3d7c720d8 on n-h2-854030-1 Aug 22 17:17:49.821972 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-88fc4d14-739d-4dcb-96be-48ea09e7d5b3 req-0dc43358-125a-442d-8af8-636b343f4837 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093999 Aug 22 17:17:49.823791 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 672/1324] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:49.850211 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3a7f02c5-d534-4044-aac2-4c9a19c984cb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:49.851885 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-3a7f02c5-d534-4044-aac2-4c9a19c984cb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:49.869528 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3a7f02c5-d534-4044-aac2-4c9a19c984cb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:49.870203 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3a7f02c5-d534-4044-aac2-4c9a19c984cb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:49.874336 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3a7f02c5-d534-4044-aac2-4c9a19c984cb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:49.875384 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3a7f02c5-d534-4044-aac2-4c9a19c984cb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:49.876087 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3a7f02c5-d534-4044-aac2-4c9a19c984cb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:49.877929 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3a7f02c5-d534-4044-aac2-4c9a19c984cb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:50.083658 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-774d4c0c-8cb0-4962-92fd-7307821b0ee1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:50.115050 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-774d4c0c-8cb0-4962-92fd-7307821b0ee1 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8" status: 200 len: 1317 microversion: 2.1 time: 1.208895 Aug 22 17:17:50.115998 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 653/1325] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:48 2022] GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 => generated 1317 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:50.147842 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8c88cb6a-4f88-4899-961b-d3a46aeffc9c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:50.148805 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-8c88cb6a-4f88-4899-961b-d3a46aeffc9c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:50.161025 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c88cb6a-4f88-4899-961b-d3a46aeffc9c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:50.161025 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c88cb6a-4f88-4899-961b-d3a46aeffc9c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:50.161025 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c88cb6a-4f88-4899-961b-d3a46aeffc9c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:50.161025 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c88cb6a-4f88-4899-961b-d3a46aeffc9c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:50.161877 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c88cb6a-4f88-4899-961b-d3a46aeffc9c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:50.164416 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c88cb6a-4f88-4899-961b-d3a46aeffc9c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:50.218228 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c88cb6a-4f88-4899-961b-d3a46aeffc9c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:50.219187 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c88cb6a-4f88-4899-961b-d3a46aeffc9c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:50.219857 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8c88cb6a-4f88-4899-961b-d3a46aeffc9c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:50.221339 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-8c88cb6a-4f88-4899-961b-d3a46aeffc9c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lazy-loading 'fault' on Instance uuid 8a9699e0-8054-4491-91a6-2d8e34898838 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:17:50.334367 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-8c88cb6a-4f88-4899-961b-d3a46aeffc9c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:50.361068 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8c88cb6a-4f88-4899-961b-d3a46aeffc9c tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 200 len: 1307 microversion: 2.1 time: 0.241213 Aug 22 17:17:50.361771 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 654/1326] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:50 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 1307 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:50.443111 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-3a7f02c5-d534-4044-aac2-4c9a19c984cb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:50.456463 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3a7f02c5-d534-4044-aac2-4c9a19c984cb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 200 len: 1311 microversion: 2.1 time: 0.609180 Aug 22 17:17:50.459007 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 673/1327] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:49 2022] GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 1311 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:50.600164 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c5cd8090-1bf5-4b96-9c90-8a3c79adaa30 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:50.600866 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c5cd8090-1bf5-4b96-9c90-8a3c79adaa30 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] [instance: 33454b47-5846-4cf6-9c3d-fc9e83cc79f8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:50.607847 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c5cd8090-1bf5-4b96-9c90-8a3c79adaa30 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:50.608349 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c5cd8090-1bf5-4b96-9c90-8a3c79adaa30 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:50.610031 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c5cd8090-1bf5-4b96-9c90-8a3c79adaa30 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:50.611131 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c5cd8090-1bf5-4b96-9c90-8a3c79adaa30 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:50.611805 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c5cd8090-1bf5-4b96-9c90-8a3c79adaa30 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:50.612462 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c5cd8090-1bf5-4b96-9c90-8a3c79adaa30 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:50.741821 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5023d2f3-c6b0-40cc-a350-bd55844b34f4 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f80095344c0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:50.823900 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5023d2f3-c6b0-40cc-a350-bd55844b34f4 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1427 microversion: 2.1 time: 0.086688 Aug 22 17:17:50.834938 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 674/1328] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:50 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:17:50.959251 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c5cd8090-1bf5-4b96-9c90-8a3c79adaa30 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:50.983373 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c5cd8090-1bf5-4b96-9c90-8a3c79adaa30 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:50.987734 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c5cd8090-1bf5-4b96-9c90-8a3c79adaa30 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:50.989360 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c5cd8090-1bf5-4b96-9c90-8a3c79adaa30 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] 10.222.0.96 "GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8" status: 200 len: 1332 microversion: 2.47 time: 0.395009 Aug 22 17:17:50.994126 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 655/1329] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:17:50 2022] GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8 => generated 1332 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:17:51.138355 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4d0ab8e6-3f0f-4aba-91d7-1b678cd9050a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:51.139191 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-4d0ab8e6-3f0f-4aba-91d7-1b678cd9050a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:51.168345 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4d0ab8e6-3f0f-4aba-91d7-1b678cd9050a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:51.168984 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4d0ab8e6-3f0f-4aba-91d7-1b678cd9050a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:51.171459 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4d0ab8e6-3f0f-4aba-91d7-1b678cd9050a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:51.174376 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4d0ab8e6-3f0f-4aba-91d7-1b678cd9050a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:51.178962 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4d0ab8e6-3f0f-4aba-91d7-1b678cd9050a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:51.183250 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4d0ab8e6-3f0f-4aba-91d7-1b678cd9050a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:51.387346 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e5d01d9a-f397-406e-a1e0-63250fc13ae7 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:51.387974 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e5d01d9a-f397-406e-a1e0-63250fc13ae7 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: 8a9699e0-8054-4491-91a6-2d8e34898838] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:51.414004 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5d01d9a-f397-406e-a1e0-63250fc13ae7 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:51.416437 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5d01d9a-f397-406e-a1e0-63250fc13ae7 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:51.417025 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5d01d9a-f397-406e-a1e0-63250fc13ae7 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:51.419547 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5d01d9a-f397-406e-a1e0-63250fc13ae7 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:51.420150 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5d01d9a-f397-406e-a1e0-63250fc13ae7 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:51.422007 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5d01d9a-f397-406e-a1e0-63250fc13ae7 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:51.458111 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-e5d01d9a-f397-406e-a1e0-63250fc13ae7 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] HTTP exception thrown: Instance 8a9699e0-8054-4491-91a6-2d8e34898838 could not be found. Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e5d01d9a-f397-406e-a1e0-63250fc13ae7 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Request method failure captured: Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 HTTP/1.1 Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7l9IQoxtr-0d_haFW92VXjLmwRqd695TctDsW0id2vdQKV1p2wdKcFrQGCW1ycQHNPwLhS6XcvhmbxAZ68vfyl_S8vFnfIWniZNcdnA3bqtJAG2QOxUAJbkDHRARvbKyzjqtqOpT6S76W4xXWj02A0vZXSQp3BXZuANO5cwDk-zVfY Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: dbbae9406ad347fcb1d302b7950d0025 Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ListImageFiltersTestJSON-1820567929 Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/dbbae9406ad347fcb1d302b7950d0025"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_dbbae9406ad347fcb1d302b7950d0025", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/dbbae9406ad347fcb1d302b7950d0025"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/dbbae9406ad347fcb1d302b7950d0025"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ListImageFiltersTestJSON-1820567929 Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: dbbae9406ad347fcb1d302b7950d0025 Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1820567929 Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ListImageFiltersTestJSON-1820567929-project Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: db950ad892d347049134d767232d170a Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ListImageFiltersTestJSON-1820567929-project Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance 8a9699e0-8054-4491-91a6-2d8e34898838 could not be found. Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '8a9699e0-8054-4491-91a6-2d8e34898838'} Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a9699e0-8054-4491-91a6-2d8e34898838 could not be found. Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a9699e0-8054-4491-91a6-2d8e34898838 could not be found. Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:51.463305 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:51.468216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:51.468216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:51.468216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:51.468216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:51.468216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:51.468216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a9699e0-8054-4491-91a6-2d8e34898838 could not be found. Aug 22 17:17:51.468216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:51.473608 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e5d01d9a-f397-406e-a1e0-63250fc13ae7 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Returning 404 to user: Instance 8a9699e0-8054-4491-91a6-2d8e34898838 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:51.478441 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e5d01d9a-f397-406e-a1e0-63250fc13ae7 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838" status: 404 len: 111 microversion: 2.1 time: 0.094800 Aug 22 17:17:51.478441 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 656/1330] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:51 2022] GET /compute/v2.1/servers/8a9699e0-8054-4491-91a6-2d8e34898838 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:17:51.626002 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0d9fde6e-b404-4524-afe9-acae9e36a6c5 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1748106405", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "94c676df-2aa2-4df2-9663-9a84eb3842f4"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:51.706671 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-0d9fde6e-b404-4524-afe9-acae9e36a6c5 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] validate_networks() for [('94c676df-2aa2-4df2-9663-9a84eb3842f4', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:17:51.871935 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-4d0ab8e6-3f0f-4aba-91d7-1b678cd9050a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:51.899123 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-4d0ab8e6-3f0f-4aba-91d7-1b678cd9050a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8" status: 200 len: 1317 microversion: 2.1 time: 0.762585 Aug 22 17:17:51.924075 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 675/1331] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:51 2022] GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 => generated 1317 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:51.938164 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0c7a522c-940e-4a4e-81c8-94aedd6dac2f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:51.941339 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0c7a522c-940e-4a4e-81c8-94aedd6dac2f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:51.956299 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:51.963283 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0c7a522c-940e-4a4e-81c8-94aedd6dac2f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:51.963283 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0c7a522c-940e-4a4e-81c8-94aedd6dac2f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:51.978552 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0c7a522c-940e-4a4e-81c8-94aedd6dac2f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:51.980210 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0c7a522c-940e-4a4e-81c8-94aedd6dac2f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:51.980210 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0c7a522c-940e-4a4e-81c8-94aedd6dac2f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:51.980833 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0c7a522c-940e-4a4e-81c8-94aedd6dac2f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:52.280054 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0c7a522c-940e-4a4e-81c8-94aedd6dac2f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:52.292117 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0c7a522c-940e-4a4e-81c8-94aedd6dac2f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 200 len: 1311 microversion: 2.1 time: 0.366558 Aug 22 17:17:52.293426 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 676/1332] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:51 2022] GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 1311 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:52.309440 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-06b5dfed-a363-44b6-8bb6-0bbe45c713fb tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:52.311111 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-06b5dfed-a363-44b6-8bb6-0bbe45c713fb tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: b9d1e79a-48e9-436e-a233-7a950de59886] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:52.326428 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-06b5dfed-a363-44b6-8bb6-0bbe45c713fb tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:52.327326 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-06b5dfed-a363-44b6-8bb6-0bbe45c713fb tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:52.328401 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-06b5dfed-a363-44b6-8bb6-0bbe45c713fb tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:52.331585 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-06b5dfed-a363-44b6-8bb6-0bbe45c713fb tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:52.332324 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-06b5dfed-a363-44b6-8bb6-0bbe45c713fb tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:52.334369 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-06b5dfed-a363-44b6-8bb6-0bbe45c713fb tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-0d9fde6e-b404-4524-afe9-acae9e36a6c5 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cfce5c3f-ee45-4f9a-b57e-7b426e52394a) Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:17:52.380693 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:17:52.385469 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:17:52.385469 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:17:52.385469 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:17:52.385469 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:17:52.385469 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:17:52.385469 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:17:52.385469 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:17:52.385469 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:17:52.385469 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:17:52.385469 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:17:52.385469 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:17:52.385469 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:17:52.385469 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:17:52.385469 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:17:52.385469 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cfce5c3f-ee45-4f9a-b57e-7b426e52394a) Aug 22 17:17:52.385469 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:52.389388 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-0d9fde6e-b404-4524-afe9-acae9e36a6c5 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:52.389388 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0d9fde6e-b404-4524-afe9-acae9e36a6c5 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] Request method failure captured: Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 200 Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7o_nYa2qtW9oHtuLKrrN9e3zLhbtwLUfjdRABmswVLyEL_XN7ZZE8m_Dw5BcP6iDrkoFabVv77EMIypu61-I2V-lx1ZqAT2HBcNMK4q1gLWE58VoSTcFTorIYHfDZ_GFLAObD84OyA3miIEycEX7sHObE49RPkv5maifQIisRz2NtE Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: ba8f3ab955ba4aab870f03445a0c15d1 Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ImagesTestJSON-1416332045 Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ba8f3ab955ba4aab870f03445a0c15d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_ba8f3ab955ba4aab870f03445a0c15d1", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ba8f3ab955ba4aab870f03445a0c15d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/ba8f3ab955ba4aab870f03445a0c15d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ImagesTestJSON-1416332045 Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: ba8f3ab955ba4aab870f03445a0c15d1 Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ImagesTestJSON-1416332045 Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ImagesTestJSON-1416332045-project Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: d0e3f2bea7d8497ab0e3e34ba49918ed Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ImagesTestJSON-1416332045-project Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-ImagesTestJSON-server-1748106405", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "94c676df-2aa2-4df2-9663-9a84eb3842f4"}]}} Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-1748106405', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '94c676df-2aa2-4df2-9663-9a84eb3842f4'}]}}} Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:17:52.394620 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cfce5c3f-ee45-4f9a-b57e-7b426e52394a) Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:17:52.400916 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:52.409021 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:52.409021 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:52.409021 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:52.409021 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:52.409021 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:52.409021 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:52.409021 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:52.409021 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:52.409021 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:52.409021 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:52.409021 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:52.409021 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:52.414420 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0d9fde6e-b404-4524-afe9-acae9e36a6c5 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:52.414420 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:52.415801 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0d9fde6e-b404-4524-afe9-acae9e36a6c5 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.937316 Aug 22 17:17:52.420084 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 657/1333] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:17:51 2022] POST /compute/v2.1/servers => generated 214 bytes in 942 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:17:52.426652 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0ef64505-e3bd-4692-ade5-4e642c9984cd tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f8009a0ca60>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:52.443902 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-06b5dfed-a363-44b6-8bb6-0bbe45c713fb tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: b9d1e79a-48e9-436e-a233-7a950de59886] Going to try to terminate instance {{(pid=123015) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:17:52.545551 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0ef64505-e3bd-4692-ade5-4e642c9984cd tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1427 microversion: 2.1 time: 0.120656 Aug 22 17:17:52.546576 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 658/1334] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:52 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:52.562149 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-43fd841f-645f-4b59-b8ff-fcdc20560bf9 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:52.567900 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-43fd841f-645f-4b59-b8ff-fcdc20560bf9 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] [instance: 33454b47-5846-4cf6-9c3d-fc9e83cc79f8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:52.571243 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:52.582524 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-43fd841f-645f-4b59-b8ff-fcdc20560bf9 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:52.585858 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-43fd841f-645f-4b59-b8ff-fcdc20560bf9 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:52.608866 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-43fd841f-645f-4b59-b8ff-fcdc20560bf9 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:52.608866 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-43fd841f-645f-4b59-b8ff-fcdc20560bf9 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:52.608866 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-43fd841f-645f-4b59-b8ff-fcdc20560bf9 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:52.608866 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-43fd841f-645f-4b59-b8ff-fcdc20560bf9 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:52.957467 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-06b5dfed-a363-44b6-8bb6-0bbe45c713fb tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "DELETE /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886" status: 204 len: 0 microversion: 2.1 time: 0.662153 Aug 22 17:17:52.959958 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 677/1335] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:17:52 2022] DELETE /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:17:52.972614 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ec8ec18e-3751-4846-b60e-c6806d71e232 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-346181407", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "94c676df-2aa2-4df2-9663-9a84eb3842f4"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:53.097406 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-43fd841f-645f-4b59-b8ff-fcdc20560bf9 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:53.111792 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-43fd841f-645f-4b59-b8ff-fcdc20560bf9 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:53.114801 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-43fd841f-645f-4b59-b8ff-fcdc20560bf9 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:53.127509 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-43fd841f-645f-4b59-b8ff-fcdc20560bf9 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] 10.222.0.96 "GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8" status: 200 len: 1338 microversion: 2.47 time: 0.559741 Aug 22 17:17:53.132662 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-ec8ec18e-3751-4846-b60e-c6806d71e232 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] validate_networks() for [('94c676df-2aa2-4df2-9663-9a84eb3842f4', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:17:53.141557 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 659/1336] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:17:52 2022] GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8 => generated 1338 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:17:53.153318 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d227554a-121d-48b2-94ba-d2d771f8da60 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:53.154067 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-d227554a-121d-48b2-94ba-d2d771f8da60 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:53.162111 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d227554a-121d-48b2-94ba-d2d771f8da60 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:53.163801 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d227554a-121d-48b2-94ba-d2d771f8da60 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:53.164499 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d227554a-121d-48b2-94ba-d2d771f8da60 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:53.165563 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d227554a-121d-48b2-94ba-d2d771f8da60 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:53.172128 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d227554a-121d-48b2-94ba-d2d771f8da60 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:53.172128 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d227554a-121d-48b2-94ba-d2d771f8da60 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:53.348304 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-d227554a-121d-48b2-94ba-d2d771f8da60 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:53.362213 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d227554a-121d-48b2-94ba-d2d771f8da60 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8" status: 200 len: 1467 microversion: 2.1 time: 0.218430 Aug 22 17:17:53.364808 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 660/1337] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:53 2022] GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 => generated 1467 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:53.386192 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b08267f3-1262-43dc-9817-d9220ab7fc4d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:53.388008 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b08267f3-1262-43dc-9817-d9220ab7fc4d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: b9d1e79a-48e9-436e-a233-7a950de59886] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:53.406824 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b08267f3-1262-43dc-9817-d9220ab7fc4d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:53.410584 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b08267f3-1262-43dc-9817-d9220ab7fc4d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:53.411372 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b08267f3-1262-43dc-9817-d9220ab7fc4d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:53.412415 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b08267f3-1262-43dc-9817-d9220ab7fc4d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:53.413286 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b08267f3-1262-43dc-9817-d9220ab7fc4d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:53.415487 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b08267f3-1262-43dc-9817-d9220ab7fc4d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:53.715976 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b08267f3-1262-43dc-9817-d9220ab7fc4d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:53.732475 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b08267f3-1262-43dc-9817-d9220ab7fc4d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886" status: 200 len: 1473 microversion: 2.1 time: 0.364567 Aug 22 17:17:53.739689 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 661/1338] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:53 2022] GET /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886 => generated 1473 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:53.746013 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7a32debb-ebfd-4c3a-9f24-145dd0af8d97 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:53.747161 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-7a32debb-ebfd-4c3a-9f24-145dd0af8d97 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:53.757790 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7a32debb-ebfd-4c3a-9f24-145dd0af8d97 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:53.759721 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7a32debb-ebfd-4c3a-9f24-145dd0af8d97 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:53.759902 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7a32debb-ebfd-4c3a-9f24-145dd0af8d97 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:53.760727 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7a32debb-ebfd-4c3a-9f24-145dd0af8d97 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:53.761503 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7a32debb-ebfd-4c3a-9f24-145dd0af8d97 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:53.762392 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7a32debb-ebfd-4c3a-9f24-145dd0af8d97 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-ec8ec18e-3751-4846-b60e-c6806d71e232 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-da3d055d-28d1-4e06-bb5e-d7d25da6df42) Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:17:53.811614 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-da3d055d-28d1-4e06-bb5e-d7d25da6df42) Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-ec8ec18e-3751-4846-b60e-c6806d71e232 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ec8ec18e-3751-4846-b60e-c6806d71e232 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] Request method failure captured: Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 199 Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7o_nYa2qtW9oHtuLKrrN9e3zLhbtwLUfjdRABmswVLyEL_XN7ZZE8m_Dw5BcP6iDrkoFabVv77EMIypu61-I2V-lx1ZqAT2HBcNMK4q1gLWE58VoSTcFTorIYHfDZ_GFLAObD84OyA3miIEycEX7sHObE49RPkv5maifQIisRz2NtE Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: ba8f3ab955ba4aab870f03445a0c15d1 Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ImagesTestJSON-1416332045 Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ba8f3ab955ba4aab870f03445a0c15d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_ba8f3ab955ba4aab870f03445a0c15d1", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ba8f3ab955ba4aab870f03445a0c15d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/ba8f3ab955ba4aab870f03445a0c15d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ImagesTestJSON-1416332045 Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: ba8f3ab955ba4aab870f03445a0c15d1 Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ImagesTestJSON-1416332045 Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ImagesTestJSON-1416332045-project Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: d0e3f2bea7d8497ab0e3e34ba49918ed Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ImagesTestJSON-1416332045-project Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ImagesTestJSON-server-346181407", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "94c676df-2aa2-4df2-9663-9a84eb3842f4"}]}} Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-346181407', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '94c676df-2aa2-4df2-9663-9a84eb3842f4'}]}}} Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:53.824155 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:17:53.834203 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-da3d055d-28d1-4e06-bb5e-d7d25da6df42) Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ec8ec18e-3751-4846-b60e-c6806d71e232 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ec8ec18e-3751-4846-b60e-c6806d71e232 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.872747 Aug 22 17:17:53.838362 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 678/1339] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:17:52 2022] POST /compute/v2.1/servers => generated 214 bytes in 875 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:17:53.857760 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-97b36683-7d9f-40b6-bc4f-0b326b096cd0 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:53.869523 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-97b36683-7d9f-40b6-bc4f-0b326b096cd0 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:53.886124 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-97b36683-7d9f-40b6-bc4f-0b326b096cd0 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:53.886622 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-97b36683-7d9f-40b6-bc4f-0b326b096cd0 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:53.887062 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-97b36683-7d9f-40b6-bc4f-0b326b096cd0 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:53.887786 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-97b36683-7d9f-40b6-bc4f-0b326b096cd0 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:53.888247 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-97b36683-7d9f-40b6-bc4f-0b326b096cd0 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:53.888677 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-97b36683-7d9f-40b6-bc4f-0b326b096cd0 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:54.146288 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-7a32debb-ebfd-4c3a-9f24-145dd0af8d97 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:54.155198 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7a32debb-ebfd-4c3a-9f24-145dd0af8d97 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 200 len: 1311 microversion: 2.1 time: 0.414260 Aug 22 17:17:54.156327 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 662/1340] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:53 2022] GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 1311 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:54.163175 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2935c5c8-a027-484e-a250-33a5de3a5a12 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f8009a2f8b0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:54.243183 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2935c5c8-a027-484e-a250-33a5de3a5a12 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1427 microversion: 2.1 time: 0.085650 Aug 22 17:17:54.243941 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 663/1341] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:54 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:54.254851 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7b355ce1-c793-426a-b19f-8d3945bee371 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1941530592", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "94c676df-2aa2-4df2-9663-9a84eb3842f4"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:54.347803 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-7b355ce1-c793-426a-b19f-8d3945bee371 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] validate_networks() for [('94c676df-2aa2-4df2-9663-9a84eb3842f4', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-7b355ce1-c793-426a-b19f-8d3945bee371 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-65e64362-841a-4d2b-a033-d34f62262e39) Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:17:54.727453 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:17:54.732419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:17:54.732419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:17:54.732419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:17:54.732419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:17:54.732419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:17:54.732419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:17:54.732419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:17:54.732419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:17:54.732419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:17:54.732419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:17:54.732419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:17:54.732419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:17:54.732419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:17:54.732419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:17:54.732419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-65e64362-841a-4d2b-a033-d34f62262e39) Aug 22 17:17:54.732419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:54.732419 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-7b355ce1-c793-426a-b19f-8d3945bee371 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:54.732419 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7b355ce1-c793-426a-b19f-8d3945bee371 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] Request method failure captured: Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 200 Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7o_nYa2qtW9oHtuLKrrN9e3zLhbtwLUfjdRABmswVLyEL_XN7ZZE8m_Dw5BcP6iDrkoFabVv77EMIypu61-I2V-lx1ZqAT2HBcNMK4q1gLWE58VoSTcFTorIYHfDZ_GFLAObD84OyA3miIEycEX7sHObE49RPkv5maifQIisRz2NtE Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: ba8f3ab955ba4aab870f03445a0c15d1 Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ImagesTestJSON-1416332045 Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ba8f3ab955ba4aab870f03445a0c15d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_ba8f3ab955ba4aab870f03445a0c15d1", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ba8f3ab955ba4aab870f03445a0c15d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/ba8f3ab955ba4aab870f03445a0c15d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ImagesTestJSON-1416332045 Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: ba8f3ab955ba4aab870f03445a0c15d1 Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ImagesTestJSON-1416332045 Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ImagesTestJSON-1416332045-project Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: d0e3f2bea7d8497ab0e3e34ba49918ed Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ImagesTestJSON-1416332045-project Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-ImagesTestJSON-server-1941530592", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "94c676df-2aa2-4df2-9663-9a84eb3842f4"}]}} Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-1941530592', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '94c676df-2aa2-4df2-9663-9a84eb3842f4'}]}}} Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:17:54.736216 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-65e64362-841a-4d2b-a033-d34f62262e39) Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:17:54.741687 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:54.760935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:54.760935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:54.760935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:54.760935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:54.760935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:54.760935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:54.760935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:54.760935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:54.760935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:54.760935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:54.760935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:54.760935 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:54.760935 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7b355ce1-c793-426a-b19f-8d3945bee371 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:54.760935 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:54.760935 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7b355ce1-c793-426a-b19f-8d3945bee371 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.502109 Aug 22 17:17:54.760935 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 664/1342] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:17:54 2022] POST /compute/v2.1/servers => generated 214 bytes in 503 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:17:54.788179 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-23f59b6e-8441-46ce-8feb-6dbbf4f265a6 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:54.789197 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-23f59b6e-8441-46ce-8feb-6dbbf4f265a6 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] [instance: 33454b47-5846-4cf6-9c3d-fc9e83cc79f8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:54.805720 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-23f59b6e-8441-46ce-8feb-6dbbf4f265a6 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:54.808196 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-23f59b6e-8441-46ce-8feb-6dbbf4f265a6 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:54.808849 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-23f59b6e-8441-46ce-8feb-6dbbf4f265a6 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:54.811638 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-23f59b6e-8441-46ce-8feb-6dbbf4f265a6 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:54.812464 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-23f59b6e-8441-46ce-8feb-6dbbf4f265a6 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:54.813149 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-23f59b6e-8441-46ce-8feb-6dbbf4f265a6 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:54.839825 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-97b36683-7d9f-40b6-bc4f-0b326b096cd0 tempest-ServersOnMultiNodesTest-2038521597 tempest-ServersOnMultiNodesTest-2038521597-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8" status: 200 len: 1618 microversion: 2.1 time: 1.003074 Aug 22 17:17:54.849915 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 679/1343] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:53 2022] GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 => generated 1618 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:54.868995 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-614d6372-472c-478d-88ee-b9d945140c46 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:54.887027 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-614d6372-472c-478d-88ee-b9d945140c46 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: b9d1e79a-48e9-436e-a233-7a950de59886] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:54.893808 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-614d6372-472c-478d-88ee-b9d945140c46 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:54.894295 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-614d6372-472c-478d-88ee-b9d945140c46 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:54.894727 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-614d6372-472c-478d-88ee-b9d945140c46 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:54.896316 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-614d6372-472c-478d-88ee-b9d945140c46 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:54.897074 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-614d6372-472c-478d-88ee-b9d945140c46 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:54.897691 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-614d6372-472c-478d-88ee-b9d945140c46 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:54.927050 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-23f59b6e-8441-46ce-8feb-6dbbf4f265a6 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:54.941991 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-23f59b6e-8441-46ce-8feb-6dbbf4f265a6 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:54.944081 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-23f59b6e-8441-46ce-8feb-6dbbf4f265a6 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:54.945896 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-23f59b6e-8441-46ce-8feb-6dbbf4f265a6 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] 10.222.0.96 "GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8" status: 200 len: 1338 microversion: 2.47 time: 0.174664 Aug 22 17:17:54.953188 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 665/1344] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:17:54 2022] GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8 => generated 1338 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:17:54.954048 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f63007d2-1542-4159-ae4d-5e564d3bf889 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-299513106", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "94c676df-2aa2-4df2-9663-9a84eb3842f4"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:55.077041 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-f63007d2-1542-4159-ae4d-5e564d3bf889 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] validate_networks() for [('94c676df-2aa2-4df2-9663-9a84eb3842f4', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:17:55.442606 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-614d6372-472c-478d-88ee-b9d945140c46 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:55.459535 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-614d6372-472c-478d-88ee-b9d945140c46 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886" status: 200 len: 1473 microversion: 2.1 time: 0.608212 Aug 22 17:17:55.460301 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 680/1345] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:54 2022] GET /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886 => generated 1473 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:55.482601 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3b477528-7849-44a5-92e1-e199cac1d335 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:55.493986 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-3b477528-7849-44a5-92e1-e199cac1d335 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:55.502808 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3b477528-7849-44a5-92e1-e199cac1d335 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:55.503422 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3b477528-7849-44a5-92e1-e199cac1d335 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:55.504124 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3b477528-7849-44a5-92e1-e199cac1d335 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:55.504969 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3b477528-7849-44a5-92e1-e199cac1d335 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:55.516074 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3b477528-7849-44a5-92e1-e199cac1d335 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:55.521014 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3b477528-7849-44a5-92e1-e199cac1d335 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:55.585308 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-3b477528-7849-44a5-92e1-e199cac1d335 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Going to try to terminate instance {{(pid=123015) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:17:55.670013 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-f63007d2-1542-4159-ae4d-5e564d3bf889 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b590d75c-ab13-4cd3-9fde-5ef304b8f92c) Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:17:55.678386 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b590d75c-ab13-4cd3-9fde-5ef304b8f92c) Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-f63007d2-1542-4159-ae4d-5e564d3bf889 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f63007d2-1542-4159-ae4d-5e564d3bf889 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] Request method failure captured: Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 199 Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7o_nYa2qtW9oHtuLKrrN9e3zLhbtwLUfjdRABmswVLyEL_XN7ZZE8m_Dw5BcP6iDrkoFabVv77EMIypu61-I2V-lx1ZqAT2HBcNMK4q1gLWE58VoSTcFTorIYHfDZ_GFLAObD84OyA3miIEycEX7sHObE49RPkv5maifQIisRz2NtE Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: ba8f3ab955ba4aab870f03445a0c15d1 Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ImagesTestJSON-1416332045 Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ba8f3ab955ba4aab870f03445a0c15d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_ba8f3ab955ba4aab870f03445a0c15d1", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ba8f3ab955ba4aab870f03445a0c15d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/ba8f3ab955ba4aab870f03445a0c15d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ImagesTestJSON-1416332045 Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: ba8f3ab955ba4aab870f03445a0c15d1 Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ImagesTestJSON-1416332045 Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ImagesTestJSON-1416332045-project Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: d0e3f2bea7d8497ab0e3e34ba49918ed Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ImagesTestJSON-1416332045-project Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-ImagesTestJSON-server-299513106", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "94c676df-2aa2-4df2-9663-9a84eb3842f4"}]}} Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-299513106', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '94c676df-2aa2-4df2-9663-9a84eb3842f4'}]}}} Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:17:55.692901 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:17:55.701912 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b590d75c-ab13-4cd3-9fde-5ef304b8f92c) Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f63007d2-1542-4159-ae4d-5e564d3bf889 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f63007d2-1542-4159-ae4d-5e564d3bf889 tempest-ImagesTestJSON-1416332045 tempest-ImagesTestJSON-1416332045-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.735402 Aug 22 17:17:55.709758 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 666/1346] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:17:54 2022] POST /compute/v2.1/servers => generated 214 bytes in 738 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:17:55.722258 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-e301f0b6-1e83-4bc4-b76e-88a5de21b48a req-9d1eb69c-103c-4121-8b61-e323394254b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473177e8-4286-43c9-abb3-f54b110ac7ce", "name": "network-vif-plugged", "status": "completed", "tag": "639dea3e-d6be-4635-a511-ce9ac0735ba1"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:55.761169 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-e301f0b6-1e83-4bc4-b76e-88a5de21b48a req-9d1eb69c-103c-4121-8b61-e323394254b6 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:55.763334 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-e301f0b6-1e83-4bc4-b76e-88a5de21b48a req-9d1eb69c-103c-4121-8b61-e323394254b6 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:55.766474 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-e301f0b6-1e83-4bc4-b76e-88a5de21b48a req-9d1eb69c-103c-4121-8b61-e323394254b6 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:55.797425 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-e301f0b6-1e83-4bc4-b76e-88a5de21b48a req-9d1eb69c-103c-4121-8b61-e323394254b6 service nova] Creating event network-vif-plugged:639dea3e-d6be-4635-a511-ce9ac0735ba1 for instance 473177e8-4286-43c9-abb3-f54b110ac7ce on n-h2-854030-1 Aug 22 17:17:55.824527 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-e301f0b6-1e83-4bc4-b76e-88a5de21b48a req-9d1eb69c-103c-4121-8b61-e323394254b6 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131664 Aug 22 17:17:55.826311 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 667/1347] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:55.837192 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-789bdb55-9a3b-4e3c-8c51-d7b5c421c58e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:55.838622 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-789bdb55-9a3b-4e3c-8c51-d7b5c421c58e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:55.852716 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-789bdb55-9a3b-4e3c-8c51-d7b5c421c58e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:55.854041 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-789bdb55-9a3b-4e3c-8c51-d7b5c421c58e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:55.854806 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-789bdb55-9a3b-4e3c-8c51-d7b5c421c58e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:55.857507 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-789bdb55-9a3b-4e3c-8c51-d7b5c421c58e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:55.858461 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-789bdb55-9a3b-4e3c-8c51-d7b5c421c58e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:55.859331 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-789bdb55-9a3b-4e3c-8c51-d7b5c421c58e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:56.203083 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:56.246878 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=6 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:56.324058 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-789bdb55-9a3b-4e3c-8c51-d7b5c421c58e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:56.333979 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-789bdb55-9a3b-4e3c-8c51-d7b5c421c58e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 200 len: 1311 microversion: 2.1 time: 0.505153 Aug 22 17:17:56.335041 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 668/1348] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:55 2022] GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 1311 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:56.344723 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2df73414-c1b5-4b32-bcc9-0d06366b553e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f800971cb80>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:56.419140 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2df73414-c1b5-4b32-bcc9-0d06366b553e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1427 microversion: 2.1 time: 0.079006 Aug 22 17:17:56.429463 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 669/1349] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:56 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:56.438305 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c64124d1-f493-4a7d-bc35-cf6c4843f998 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:56.439959 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c64124d1-f493-4a7d-bc35-cf6c4843f998 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] [instance: 33454b47-5846-4cf6-9c3d-fc9e83cc79f8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:56.453584 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c64124d1-f493-4a7d-bc35-cf6c4843f998 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:56.455966 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c64124d1-f493-4a7d-bc35-cf6c4843f998 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:56.456638 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c64124d1-f493-4a7d-bc35-cf6c4843f998 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:56.457666 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c64124d1-f493-4a7d-bc35-cf6c4843f998 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:56.458129 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c64124d1-f493-4a7d-bc35-cf6c4843f998 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:56.458547 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c64124d1-f493-4a7d-bc35-cf6c4843f998 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:56.539846 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3b477528-7849-44a5-92e1-e199cac1d335 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "DELETE /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8" status: 204 len: 0 microversion: 2.1 time: 1.065037 Aug 22 17:17:56.540508 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 681/1350] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:17:55 2022] DELETE /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 => generated 0 bytes in 1080 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:17:56.548776 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-72778542-3a65-4dfe-9553-bc9b42e94373 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:56.549711 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-72778542-3a65-4dfe-9553-bc9b42e94373 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: b9d1e79a-48e9-436e-a233-7a950de59886] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:56.571014 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-72778542-3a65-4dfe-9553-bc9b42e94373 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:56.571523 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-72778542-3a65-4dfe-9553-bc9b42e94373 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:56.571957 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-72778542-3a65-4dfe-9553-bc9b42e94373 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:56.572691 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-72778542-3a65-4dfe-9553-bc9b42e94373 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:56.573319 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-72778542-3a65-4dfe-9553-bc9b42e94373 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:56.573584 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-72778542-3a65-4dfe-9553-bc9b42e94373 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:56.608115 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c64124d1-f493-4a7d-bc35-cf6c4843f998 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:56.630233 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c64124d1-f493-4a7d-bc35-cf6c4843f998 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:56.631945 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c64124d1-f493-4a7d-bc35-cf6c4843f998 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:56.633269 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c64124d1-f493-4a7d-bc35-cf6c4843f998 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] 10.222.0.96 "GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8" status: 200 len: 1338 microversion: 2.47 time: 0.201427 Aug 22 17:17:56.641526 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 670/1351] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:17:56 2022] GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8 => generated 1338 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:17:56.647835 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-03db4bcc-7d54-40b0-b429-8e9a078ae462 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:56.648712 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-03db4bcc-7d54-40b0-b429-8e9a078ae462 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:56.664027 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-03db4bcc-7d54-40b0-b429-8e9a078ae462 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:56.664917 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-03db4bcc-7d54-40b0-b429-8e9a078ae462 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:56.665687 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-03db4bcc-7d54-40b0-b429-8e9a078ae462 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:56.666626 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-03db4bcc-7d54-40b0-b429-8e9a078ae462 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:56.669016 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-03db4bcc-7d54-40b0-b429-8e9a078ae462 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:56.669676 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-03db4bcc-7d54-40b0-b429-8e9a078ae462 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:56.908350 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-72778542-3a65-4dfe-9553-bc9b42e94373 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:56.921611 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-72778542-3a65-4dfe-9553-bc9b42e94373 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886" status: 200 len: 1473 microversion: 2.1 time: 0.377159 Aug 22 17:17:56.933320 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 682/1352] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:56 2022] GET /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886 => generated 1473 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:57.250893 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-03db4bcc-7d54-40b0-b429-8e9a078ae462 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:57.263776 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-03db4bcc-7d54-40b0-b429-8e9a078ae462 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8" status: 200 len: 1473 microversion: 2.1 time: 0.619102 Aug 22 17:17:57.277123 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 671/1353] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:56 2022] GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 => generated 1473 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:57.354944 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-85e245b8-e2e8-4a21-bf64-674746ea6143 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:57.355558 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-85e245b8-e2e8-4a21-bf64-674746ea6143 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:57.368381 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-85e245b8-e2e8-4a21-bf64-674746ea6143 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:57.368612 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-85e245b8-e2e8-4a21-bf64-674746ea6143 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:57.368993 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-85e245b8-e2e8-4a21-bf64-674746ea6143 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:57.369829 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-85e245b8-e2e8-4a21-bf64-674746ea6143 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:57.370291 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-85e245b8-e2e8-4a21-bf64-674746ea6143 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:57.370774 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-85e245b8-e2e8-4a21-bf64-674746ea6143 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:57.434993 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f2640f09-7fe3-4b52-9c25-5e1784cdb549 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f80096fb550>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:57.549353 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f2640f09-7fe3-4b52-9c25-5e1784cdb549 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1427 microversion: 2.1 time: 0.117767 Aug 22 17:17:57.551719 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 672/1354] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:57 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:17:57.592235 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-d1b2292a-c6eb-4b51-8be2-21b09f1aca6f req-c6cfe3df-e114-41fd-9b0f-3379fba97a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d1e79a-48e9-436e-a233-7a950de59886", "name": "network-vif-deleted", "tag": "6f8bb3a8-685e-4d62-8584-0402c1743657"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:57.623851 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-d1b2292a-c6eb-4b51-8be2-21b09f1aca6f req-c6cfe3df-e114-41fd-9b0f-3379fba97a4c service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:57.624351 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-d1b2292a-c6eb-4b51-8be2-21b09f1aca6f req-c6cfe3df-e114-41fd-9b0f-3379fba97a4c service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:57.624789 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-d1b2292a-c6eb-4b51-8be2-21b09f1aca6f req-c6cfe3df-e114-41fd-9b0f-3379fba97a4c service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:57.680943 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-d1b2292a-c6eb-4b51-8be2-21b09f1aca6f req-c6cfe3df-e114-41fd-9b0f-3379fba97a4c service nova] Creating event network-vif-deleted:6f8bb3a8-685e-4d62-8584-0402c1743657 for instance b9d1e79a-48e9-436e-a233-7a950de59886 on n-h2-854030-1 Aug 22 17:17:57.704396 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-d1b2292a-c6eb-4b51-8be2-21b09f1aca6f req-c6cfe3df-e114-41fd-9b0f-3379fba97a4c service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111262 Aug 22 17:17:57.706652 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 673/1355] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:17:57.711694 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-85e245b8-e2e8-4a21-bf64-674746ea6143 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:57.728892 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-85e245b8-e2e8-4a21-bf64-674746ea6143 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 200 len: 1311 microversion: 2.1 time: 0.376414 Aug 22 17:17:57.732306 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 683/1356] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:57 2022] GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 1311 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:17:57.743841 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-148b62d6-f878-44b3-956a-403e380a1ff7 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:57.744663 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-148b62d6-f878-44b3-956a-403e380a1ff7 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] [instance: 33454b47-5846-4cf6-9c3d-fc9e83cc79f8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:57.777937 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-148b62d6-f878-44b3-956a-403e380a1ff7 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:57.778968 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-148b62d6-f878-44b3-956a-403e380a1ff7 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:57.779417 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-148b62d6-f878-44b3-956a-403e380a1ff7 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:57.780153 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-148b62d6-f878-44b3-956a-403e380a1ff7 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:57.780607 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-148b62d6-f878-44b3-956a-403e380a1ff7 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:57.794086 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-148b62d6-f878-44b3-956a-403e380a1ff7 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:57.850603 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=100 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:57.946380 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f3d22550-6d55-472b-91e5-b0ebe05ac8f5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:57.947375 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f3d22550-6d55-472b-91e5-b0ebe05ac8f5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: b9d1e79a-48e9-436e-a233-7a950de59886] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:57.967684 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f3d22550-6d55-472b-91e5-b0ebe05ac8f5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:57.978130 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f3d22550-6d55-472b-91e5-b0ebe05ac8f5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:57.979021 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f3d22550-6d55-472b-91e5-b0ebe05ac8f5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:57.980606 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f3d22550-6d55-472b-91e5-b0ebe05ac8f5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:57.981409 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f3d22550-6d55-472b-91e5-b0ebe05ac8f5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:57.982245 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f3d22550-6d55-472b-91e5-b0ebe05ac8f5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:58.019117 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-148b62d6-f878-44b3-956a-403e380a1ff7 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:58.028394 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-148b62d6-f878-44b3-956a-403e380a1ff7 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:58.029990 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-148b62d6-f878-44b3-956a-403e380a1ff7 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:58.031210 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-148b62d6-f878-44b3-956a-403e380a1ff7 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] 10.222.0.96 "GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8" status: 200 len: 1359 microversion: 2.47 time: 0.323099 Aug 22 17:17:58.031766 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 674/1357] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:17:57 2022] GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8 => generated 1359 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:17:58.082118 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:17:58.102410 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-03339ab7-bb85-4157-99d4-7af420dd1d46 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1629902108"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:17:58.104842 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-03339ab7-bb85-4157-99d4-7af420dd1d46 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] [instance: 33454b47-5846-4cf6-9c3d-fc9e83cc79f8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:58.147198 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-03339ab7-bb85-4157-99d4-7af420dd1d46 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:58.147694 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-03339ab7-bb85-4157-99d4-7af420dd1d46 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:58.148132 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-03339ab7-bb85-4157-99d4-7af420dd1d46 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:58.148850 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-03339ab7-bb85-4157-99d4-7af420dd1d46 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:58.157626 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-03339ab7-bb85-4157-99d4-7af420dd1d46 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:58.160408 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-03339ab7-bb85-4157-99d4-7af420dd1d46 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:58.226578 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f3d22550-6d55-472b-91e5-b0ebe05ac8f5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:58.244439 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f3d22550-6d55-472b-91e5-b0ebe05ac8f5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886" status: 200 len: 1431 microversion: 2.1 time: 0.303526 Aug 22 17:17:58.249722 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 684/1358] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:57 2022] GET /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886 => generated 1431 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:58.291591 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1caada3c-be38-487d-b61e-a3a2b47158e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:58.292901 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-1caada3c-be38-487d-b61e-a3a2b47158e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:58.325844 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1caada3c-be38-487d-b61e-a3a2b47158e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:58.334205 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1caada3c-be38-487d-b61e-a3a2b47158e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:58.335576 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1caada3c-be38-487d-b61e-a3a2b47158e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:58.339238 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1caada3c-be38-487d-b61e-a3a2b47158e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:58.344645 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1caada3c-be38-487d-b61e-a3a2b47158e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:58.351164 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1caada3c-be38-487d-b61e-a3a2b47158e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:58.831460 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1caada3c-be38-487d-b61e-a3a2b47158e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:58.846170 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1caada3c-be38-487d-b61e-a3a2b47158e3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8" status: 200 len: 1473 microversion: 2.1 time: 0.559516 Aug 22 17:17:58.848085 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 685/1359] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:58 2022] GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 => generated 1473 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:17:58.858616 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cd82048a-7591-481e-bf7a-0ee9c3b93512 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f80094ef790>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:58.983702 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-cd82048a-7591-481e-bf7a-0ee9c3b93512 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1427 microversion: 2.1 time: 0.133033 Aug 22 17:17:58.992759 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 686/1360] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:17:58 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1427 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:59.004915 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1abd5191-a782-4d3c-9e88-4e221cb15ae6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:59.006463 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-1abd5191-a782-4d3c-9e88-4e221cb15ae6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:59.009207 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-03339ab7-bb85-4157-99d4-7af420dd1d46 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] 10.222.0.96 "POST /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8/action" status: 202 len: 52 microversion: 2.47 time: 0.914314 Aug 22 17:17:59.010181 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 675/1361] 10.222.0.96 () {62 vars in 1319 bytes} [Mon Aug 22 17:17:58 2022] POST /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8/action => generated 52 bytes in 916 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 22 17:17:59.016466 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1abd5191-a782-4d3c-9e88-4e221cb15ae6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:59.018079 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1abd5191-a782-4d3c-9e88-4e221cb15ae6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:59.019002 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1abd5191-a782-4d3c-9e88-4e221cb15ae6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:59.020135 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1abd5191-a782-4d3c-9e88-4e221cb15ae6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:59.020946 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1abd5191-a782-4d3c-9e88-4e221cb15ae6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:59.021627 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1abd5191-a782-4d3c-9e88-4e221cb15ae6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:59.093496 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c23b90dd-eb01-4987-be90-7bae988a6e8c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:59.093496 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c23b90dd-eb01-4987-be90-7bae988a6e8c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] [instance: 33454b47-5846-4cf6-9c3d-fc9e83cc79f8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:59.109483 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c23b90dd-eb01-4987-be90-7bae988a6e8c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:59.110417 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c23b90dd-eb01-4987-be90-7bae988a6e8c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:59.111187 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c23b90dd-eb01-4987-be90-7bae988a6e8c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:59.112452 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c23b90dd-eb01-4987-be90-7bae988a6e8c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:59.113595 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c23b90dd-eb01-4987-be90-7bae988a6e8c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:59.114325 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c23b90dd-eb01-4987-be90-7bae988a6e8c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:59.162512 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c23b90dd-eb01-4987-be90-7bae988a6e8c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] [instance: 33454b47-5846-4cf6-9c3d-fc9e83cc79f8] Going to try to terminate instance {{(pid=123016) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:17:59.270275 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1abd5191-a782-4d3c-9e88-4e221cb15ae6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:59.280091 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1abd5191-a782-4d3c-9e88-4e221cb15ae6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 200 len: 1461 microversion: 2.1 time: 0.280728 Aug 22 17:17:59.281042 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 687/1362] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:58 2022] GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 1461 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:59.287082 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3673595f-610b-45df-8107-932cccd1047d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:59.287646 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-3673595f-610b-45df-8107-932cccd1047d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: b9d1e79a-48e9-436e-a233-7a950de59886] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:59.295744 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3673595f-610b-45df-8107-932cccd1047d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:59.296247 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3673595f-610b-45df-8107-932cccd1047d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:59.296678 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3673595f-610b-45df-8107-932cccd1047d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:59.297445 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3673595f-610b-45df-8107-932cccd1047d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:59.299934 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3673595f-610b-45df-8107-932cccd1047d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:59.300386 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3673595f-610b-45df-8107-932cccd1047d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:59.343637 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3673595f-610b-45df-8107-932cccd1047d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:59.344046 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3673595f-610b-45df-8107-932cccd1047d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:59.344463 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3673595f-610b-45df-8107-932cccd1047d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:59.345492 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-3673595f-610b-45df-8107-932cccd1047d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lazy-loading 'fault' on Instance uuid b9d1e79a-48e9-436e-a233-7a950de59886 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:17:59.427659 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-3673595f-610b-45df-8107-932cccd1047d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db950ad892d347049134d767232d170a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbae9406ad347fcb1d302b7950d0025', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:17:59.443563 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3673595f-610b-45df-8107-932cccd1047d tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886" status: 200 len: 1307 microversion: 2.1 time: 0.161382 Aug 22 17:17:59.446700 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 688/1363] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:59 2022] GET /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886 => generated 1307 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:17:59.718575 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c23b90dd-eb01-4987-be90-7bae988a6e8c tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] 10.222.0.96 "DELETE /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8" status: 204 len: 0 microversion: 2.47 time: 0.629814 Aug 22 17:17:59.719794 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 676/1364] 10.222.0.96 () {60 vars in 1280 bytes} [Mon Aug 22 17:17:59 2022] DELETE /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 17:17:59.733954 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-46d2d83f-e8f4-4ce8-ada7-0224eae1403e tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:59.739615 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-46d2d83f-e8f4-4ce8-ada7-0224eae1403e tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] [instance: 33454b47-5846-4cf6-9c3d-fc9e83cc79f8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:59.741362 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-98466fd1-e3d2-4c73-8303-9db2fd14ccdd tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:59.747729 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-98466fd1-e3d2-4c73-8303-9db2fd14ccdd tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Searching by: {'deleted': False, 'project_id': '755a8316e24346c680afbfc787095c6e'} {{(pid=123015) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 22 17:17:59.750681 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-46d2d83f-e8f4-4ce8-ada7-0224eae1403e tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:59.751476 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-46d2d83f-e8f4-4ce8-ada7-0224eae1403e tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:59.752369 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-46d2d83f-e8f4-4ce8-ada7-0224eae1403e tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:59.753759 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-46d2d83f-e8f4-4ce8-ada7-0224eae1403e tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:59.759414 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-46d2d83f-e8f4-4ce8-ada7-0224eae1403e tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:59.759414 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-46d2d83f-e8f4-4ce8-ada7-0224eae1403e tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:59.759696 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98466fd1-e3d2-4c73-8303-9db2fd14ccdd tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:59.759696 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98466fd1-e3d2-4c73-8303-9db2fd14ccdd tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:59.759696 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98466fd1-e3d2-4c73-8303-9db2fd14ccdd tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:59.759696 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98466fd1-e3d2-4c73-8303-9db2fd14ccdd tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:59.759696 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98466fd1-e3d2-4c73-8303-9db2fd14ccdd tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:59.760209 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98466fd1-e3d2-4c73-8303-9db2fd14ccdd tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:59.893588 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-98466fd1-e3d2-4c73-8303-9db2fd14ccdd tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.442632 Aug 22 17:17:59.901799 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 689/1365] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:17:59 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:17:59.901799 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-76438c21-5110-4ba3-ba10-3374aa91f3a9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:17:59.901799 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-76438c21-5110-4ba3-ba10-3374aa91f3a9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:17:59.909823 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-76438c21-5110-4ba3-ba10-3374aa91f3a9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:59.910710 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-76438c21-5110-4ba3-ba10-3374aa91f3a9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:59.911351 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-76438c21-5110-4ba3-ba10-3374aa91f3a9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:17:59.912274 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-76438c21-5110-4ba3-ba10-3374aa91f3a9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:17:59.913106 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-76438c21-5110-4ba3-ba10-3374aa91f3a9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:17:59.913896 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-76438c21-5110-4ba3-ba10-3374aa91f3a9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:00.068121 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-46d2d83f-e8f4-4ce8-ada7-0224eae1403e tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:00.085160 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-46d2d83f-e8f4-4ce8-ada7-0224eae1403e tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:00.090436 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-46d2d83f-e8f4-4ce8-ada7-0224eae1403e tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:00.092722 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-46d2d83f-e8f4-4ce8-ada7-0224eae1403e tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] 10.222.0.96 "GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8" status: 200 len: 1365 microversion: 2.47 time: 0.367550 Aug 22 17:18:00.109253 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 677/1366] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:17:59 2022] GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8 => generated 1365 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:18:00.126227 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-86822d24-0e73-446a-a8c4-52769d8e2087 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:00.141244 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-86822d24-0e73-446a-a8c4-52769d8e2087 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Searching by: {'deleted': False} {{(pid=123016) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 22 17:18:00.150544 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86822d24-0e73-446a-a8c4-52769d8e2087 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:00.151167 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86822d24-0e73-446a-a8c4-52769d8e2087 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:00.151725 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86822d24-0e73-446a-a8c4-52769d8e2087 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:00.155094 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86822d24-0e73-446a-a8c4-52769d8e2087 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:00.157968 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86822d24-0e73-446a-a8c4-52769d8e2087 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:00.157968 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86822d24-0e73-446a-a8c4-52769d8e2087 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:00.289144 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-76438c21-5110-4ba3-ba10-3374aa91f3a9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:00.308259 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-76438c21-5110-4ba3-ba10-3374aa91f3a9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8" status: 200 len: 1473 microversion: 2.1 time: 0.411304 Aug 22 17:18:00.320937 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 690/1367] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:17:59 2022] GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 => generated 1473 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:00.358888 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9a268cc8-6314-4c60-b907-4f4d3ad89d32 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f80095348b0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:00.476122 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.multi_cell_list [None req-86822d24-0e73-446a-a8c4-52769d8e2087 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=123016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 22 17:18:00.543791 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9a268cc8-6314-4c60-b907-4f4d3ad89d32 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1436 microversion: 2.1 time: 0.195778 Aug 22 17:18:00.547492 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 691/1368] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:18:00 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1436 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:00.562043 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-b2a3ab42-82f8-4685-86ea-07c9efad8075 req-fa938567-fd4d-4016-bea5-8ec8a3664b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fefacb8-2e26-4e92-937d-58d3d7c720d8", "name": "network-vif-deleted", "tag": "cc7c866e-c3d7-4575-a71e-4510cef135f5"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:00.602142 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-b2a3ab42-82f8-4685-86ea-07c9efad8075 req-fa938567-fd4d-4016-bea5-8ec8a3664b80 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:00.603093 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-b2a3ab42-82f8-4685-86ea-07c9efad8075 req-fa938567-fd4d-4016-bea5-8ec8a3664b80 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:00.604399 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-b2a3ab42-82f8-4685-86ea-07c9efad8075 req-fa938567-fd4d-4016-bea5-8ec8a3664b80 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:00.622241 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-b2a3ab42-82f8-4685-86ea-07c9efad8075 req-fa938567-fd4d-4016-bea5-8ec8a3664b80 service nova] Creating event network-vif-deleted:cc7c866e-c3d7-4575-a71e-4510cef135f5 for instance 9fefacb8-2e26-4e92-937d-58d3d7c720d8 on n-h2-854030-1 Aug 22 17:18:00.630659 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-b2a3ab42-82f8-4685-86ea-07c9efad8075 req-fa938567-fd4d-4016-bea5-8ec8a3664b80 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080366 Aug 22 17:18:00.631761 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 692/1369] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:00.638641 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fedc35f9-fa3f-44e8-9327-984cc901ae1a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:00.639782 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-fedc35f9-fa3f-44e8-9327-984cc901ae1a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] [instance: b9d1e79a-48e9-436e-a233-7a950de59886] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:00.649532 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fedc35f9-fa3f-44e8-9327-984cc901ae1a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:00.653737 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fedc35f9-fa3f-44e8-9327-984cc901ae1a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:00.653737 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fedc35f9-fa3f-44e8-9327-984cc901ae1a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:00.653737 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fedc35f9-fa3f-44e8-9327-984cc901ae1a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:00.653737 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fedc35f9-fa3f-44e8-9327-984cc901ae1a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:00.653737 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fedc35f9-fa3f-44e8-9327-984cc901ae1a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:00.670971 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-fedc35f9-fa3f-44e8-9327-984cc901ae1a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] HTTP exception thrown: Instance b9d1e79a-48e9-436e-a233-7a950de59886 could not be found. Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fedc35f9-fa3f-44e8-9327-984cc901ae1a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Request method failure captured: Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886 HTTP/1.1 Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7l9IQoxtr-0d_haFW92VXjLmwRqd695TctDsW0id2vdQKV1p2wdKcFrQGCW1ycQHNPwLhS6XcvhmbxAZ68vfyl_S8vFnfIWniZNcdnA3bqtJAG2QOxUAJbkDHRARvbKyzjqtqOpT6S76W4xXWj02A0vZXSQp3BXZuANO5cwDk-zVfY Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: dbbae9406ad347fcb1d302b7950d0025 Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ListImageFiltersTestJSON-1820567929 Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/dbbae9406ad347fcb1d302b7950d0025"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_dbbae9406ad347fcb1d302b7950d0025", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/dbbae9406ad347fcb1d302b7950d0025"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/dbbae9406ad347fcb1d302b7950d0025"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ListImageFiltersTestJSON-1820567929 Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: dbbae9406ad347fcb1d302b7950d0025 Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1820567929 Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ListImageFiltersTestJSON-1820567929-project Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: db950ad892d347049134d767232d170a Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ListImageFiltersTestJSON-1820567929-project Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance b9d1e79a-48e9-436e-a233-7a950de59886 could not be found. Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'b9d1e79a-48e9-436e-a233-7a950de59886'} Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d1e79a-48e9-436e-a233-7a950de59886 could not be found. Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d1e79a-48e9-436e-a233-7a950de59886 could not be found. Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:00.674703 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:00.684513 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:00.684513 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:00.684513 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:00.684513 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:00.684513 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:00.684513 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d1e79a-48e9-436e-a233-7a950de59886 could not be found. Aug 22 17:18:00.684513 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:00.685017 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86822d24-0e73-446a-a8c4-52769d8e2087 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:00.685669 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fedc35f9-fa3f-44e8-9327-984cc901ae1a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Returning 404 to user: Instance b9d1e79a-48e9-436e-a233-7a950de59886 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:00.685778 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86822d24-0e73-446a-a8c4-52769d8e2087 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:00.685867 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fedc35f9-fa3f-44e8-9327-984cc901ae1a tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "GET /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886" status: 404 len: 111 microversion: 2.1 time: 0.046954 Aug 22 17:18:00.685951 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86822d24-0e73-446a-a8c4-52769d8e2087 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:00.686035 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 693/1370] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:00 2022] GET /compute/v2.1/servers/b9d1e79a-48e9-436e-a233-7a950de59886 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:18:00.693110 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0c91e2e4-63fc-4445-81cc-b9b202700529 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f8009624670>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:00.759989 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0c91e2e4-63fc-4445-81cc-b9b202700529 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 200 len: 1436 microversion: 2.1 time: 0.078075 Aug 22 17:18:00.760964 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 694/1371] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:18:00 2022] GET /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 1436 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:00.778622 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-86cc428a-2de0-43af-921c-05a3ab0a32cc tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80094ef280>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:01.660905 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-86822d24-0e73-446a-a8c4-52769d8e2087 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 20699 microversion: 2.1 time: 1.549915 Aug 22 17:18:01.662825 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 678/1372] 10.222.0.96 () {58 vars in 1171 bytes} [Mon Aug 22 17:18:00 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 20699 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:18:01.668022 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-eda14fcd-8b9d-4925-9fcf-4bcd474fed1b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:01.672416 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-eda14fcd-8b9d-4925-9fcf-4bcd474fed1b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:01.695137 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eda14fcd-8b9d-4925-9fcf-4bcd474fed1b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:01.696213 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eda14fcd-8b9d-4925-9fcf-4bcd474fed1b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:01.696859 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eda14fcd-8b9d-4925-9fcf-4bcd474fed1b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:01.697832 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eda14fcd-8b9d-4925-9fcf-4bcd474fed1b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:01.698463 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eda14fcd-8b9d-4925-9fcf-4bcd474fed1b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:01.699051 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eda14fcd-8b9d-4925-9fcf-4bcd474fed1b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:02.168548 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-86cc428a-2de0-43af-921c-05a3ab0a32cc tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "DELETE /compute/v2.1/images/ebdc6e3f-132d-4e9c-9c6c-096999a0f82b" status: 204 len: 0 microversion: 2.1 time: 1.394260 Aug 22 17:18:02.187293 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 695/1373] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:00 2022] DELETE /compute/v2.1/images/ebdc6e3f-132d-4e9c-9c6c-096999a0f82b => generated 0 bytes in 1397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:18:02.187293 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a6351b48-c99b-4026-81a4-188de18d7a7b tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:02.187293 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a6351b48-c99b-4026-81a4-188de18d7a7b tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] [instance: 33454b47-5846-4cf6-9c3d-fc9e83cc79f8] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:02.195130 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a6351b48-c99b-4026-81a4-188de18d7a7b tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:02.195700 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a6351b48-c99b-4026-81a4-188de18d7a7b tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:02.198382 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a6351b48-c99b-4026-81a4-188de18d7a7b tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:02.199635 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a6351b48-c99b-4026-81a4-188de18d7a7b tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:02.205984 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a6351b48-c99b-4026-81a4-188de18d7a7b tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:02.206649 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a6351b48-c99b-4026-81a4-188de18d7a7b tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:02.396064 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-eda14fcd-8b9d-4925-9fcf-4bcd474fed1b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:02.398139 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a6351b48-c99b-4026-81a4-188de18d7a7b tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:02.430763 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-eda14fcd-8b9d-4925-9fcf-4bcd474fed1b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1467 microversion: 2.1 time: 0.766551 Aug 22 17:18:02.432715 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 679/1374] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:01 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1467 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:02.433306 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a6351b48-c99b-4026-81a4-188de18d7a7b tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:02.441707 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a6351b48-c99b-4026-81a4-188de18d7a7b tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:02.448938 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a6351b48-c99b-4026-81a4-188de18d7a7b tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] 10.222.0.96 "GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8" status: 200 len: 1365 microversion: 2.47 time: 0.276820 Aug 22 17:18:02.450491 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a6757151-6882-4ff0-a8cb-7941a88fc48d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:02.451754 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 696/1375] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:18:02 2022] GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8 => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:18:02.458430 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-a6757151-6882-4ff0-a8cb-7941a88fc48d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 9fefacb8-2e26-4e92-937d-58d3d7c720d8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:02.468170 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-98ba52af-b9b0-4a3f-8865-ccd1d07d8dda tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:02.472351 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a6757151-6882-4ff0-a8cb-7941a88fc48d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:02.482127 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a6757151-6882-4ff0-a8cb-7941a88fc48d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:02.482127 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a6757151-6882-4ff0-a8cb-7941a88fc48d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:02.482127 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a6757151-6882-4ff0-a8cb-7941a88fc48d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:02.482127 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a6757151-6882-4ff0-a8cb-7941a88fc48d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:02.482127 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a6757151-6882-4ff0-a8cb-7941a88fc48d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:02.487490 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-98ba52af-b9b0-4a3f-8865-ccd1d07d8dda tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Searching by: {'deleted': False, 'project_id': '755a8316e24346c680afbfc787095c6e'} {{(pid=123015) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 22 17:18:02.506243 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98ba52af-b9b0-4a3f-8865-ccd1d07d8dda tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:02.507380 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98ba52af-b9b0-4a3f-8865-ccd1d07d8dda tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:02.509328 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98ba52af-b9b0-4a3f-8865-ccd1d07d8dda tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:02.510375 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98ba52af-b9b0-4a3f-8865-ccd1d07d8dda tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:02.511023 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98ba52af-b9b0-4a3f-8865-ccd1d07d8dda tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:02.518646 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98ba52af-b9b0-4a3f-8865-ccd1d07d8dda tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:02.518844 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-a6757151-6882-4ff0-a8cb-7941a88fc48d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] HTTP exception thrown: Instance 9fefacb8-2e26-4e92-937d-58d3d7c720d8 could not be found. Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a6757151-6882-4ff0-a8cb-7941a88fc48d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Request method failure captured: Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 HTTP/1.1 Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7lgSm4FKTHXtIz1Gx3tknJOMgFMA7b9cAHDnITnAh8xWgKu_QooBsvcVa7rpSsMIJ6ZKXC66_UbsLY8HsWtLPA5uE9Pus_XRXBiWc4yypjcu3nCl--V0IVy0QYTFoToZbtM4oNXEEZt6kW8A07lFUNftp3OyGh5k6tT3dZfr8k0e20 Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: d789047469894e1fbe5af3a109a95b4c Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_d789047469894e1fbe5af3a109a95b4c", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: d789047469894e1fbe5af3a109a95b4c Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServersOnMultiNodesTest-1888665690-project Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 43188026fda44118ad642b7065108966 Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServersOnMultiNodesTest-1888665690-project Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance 9fefacb8-2e26-4e92-937d-58d3d7c720d8 could not be found. Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '9fefacb8-2e26-4e92-937d-58d3d7c720d8'} Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fefacb8-2e26-4e92-937d-58d3d7c720d8 could not be found. Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fefacb8-2e26-4e92-937d-58d3d7c720d8 could not be found. Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:02.520392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:02.527679 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:02.527679 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:02.527679 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:02.527679 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:02.527679 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:02.527679 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fefacb8-2e26-4e92-937d-58d3d7c720d8 could not be found. Aug 22 17:18:02.527679 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:02.527679 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a6757151-6882-4ff0-a8cb-7941a88fc48d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Returning 404 to user: Instance 9fefacb8-2e26-4e92-937d-58d3d7c720d8 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:02.527679 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a6757151-6882-4ff0-a8cb-7941a88fc48d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8" status: 404 len: 111 microversion: 2.1 time: 0.085191 Aug 22 17:18:02.527679 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 680/1376] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:02 2022] GET /compute/v2.1/servers/9fefacb8-2e26-4e92-937d-58d3d7c720d8 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:18:02.535189 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7732a059-1962-4f62-bc5e-9b508f0e75a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80096f4d30>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:02.568612 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-98ba52af-b9b0-4a3f-8865-ccd1d07d8dda tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/detail?tenant_id=d2ecfb79c01d4d40850d84c3cced9240" status: 200 len: 15 microversion: 2.1 time: 0.115033 Aug 22 17:18:02.586426 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 697/1377] 10.222.0.96 () {58 vars in 1231 bytes} [Mon Aug 22 17:18:02 2022] GET /compute/v2.1/servers/detail?tenant_id=d2ecfb79c01d4d40850d84c3cced9240 => generated 15 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:18:02.586426 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3ae09f3d-3c7c-49fc-ada9-ae6e199d7102 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f8009527040>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:03.295302 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7732a059-1962-4f62-bc5e-9b508f0e75a1 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "DELETE /compute/v2.1/images/6ae2b917-249e-47ef-a231-b408ad8559e3" status: 204 len: 0 microversion: 2.1 time: 0.764808 Aug 22 17:18:03.295907 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 681/1378] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:02 2022] DELETE /compute/v2.1/images/6ae2b917-249e-47ef-a231-b408ad8559e3 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:18:03.301353 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-31155236-3fb8-406b-b04c-345247ecf3d3 req-4fcc9912-7bb4-43e3-afd7-80f91911460c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9580929a-e453-41ef-a4e9-330cede53f01", "name": "network-vif-unplugged", "status": "completed", "tag": "ae70627f-e44d-42a8-9bae-1081a5f5e717"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:03.318533 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-31155236-3fb8-406b-b04c-345247ecf3d3 req-4fcc9912-7bb4-43e3-afd7-80f91911460c service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:03.319449 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-31155236-3fb8-406b-b04c-345247ecf3d3 req-4fcc9912-7bb4-43e3-afd7-80f91911460c service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:03.322937 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-31155236-3fb8-406b-b04c-345247ecf3d3 req-4fcc9912-7bb4-43e3-afd7-80f91911460c service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:03.336406 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-31155236-3fb8-406b-b04c-345247ecf3d3 req-4fcc9912-7bb4-43e3-afd7-80f91911460c service nova] Creating event network-vif-unplugged:ae70627f-e44d-42a8-9bae-1081a5f5e717 for instance 9580929a-e453-41ef-a4e9-330cede53f01 on n-h2-854030-1 Aug 22 17:18:03.344667 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-31155236-3fb8-406b-b04c-345247ecf3d3 req-4fcc9912-7bb4-43e3-afd7-80f91911460c service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047437 Aug 22 17:18:03.346617 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 682/1379] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:03.353353 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-76111d14-9319-44b0-86f7-2edbd2003361 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:03.354899 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-76111d14-9319-44b0-86f7-2edbd2003361 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:03.372963 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-76111d14-9319-44b0-86f7-2edbd2003361 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:03.373513 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-76111d14-9319-44b0-86f7-2edbd2003361 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:03.373947 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-76111d14-9319-44b0-86f7-2edbd2003361 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:03.374872 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-76111d14-9319-44b0-86f7-2edbd2003361 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:03.375337 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-76111d14-9319-44b0-86f7-2edbd2003361 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:03.375831 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-76111d14-9319-44b0-86f7-2edbd2003361 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:03.433352 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-76111d14-9319-44b0-86f7-2edbd2003361 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Going to try to terminate instance {{(pid=123016) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:18:03.948516 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-76111d14-9319-44b0-86f7-2edbd2003361 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "DELETE /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 204 len: 0 microversion: 2.1 time: 0.600125 Aug 22 17:18:03.952276 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 683/1380] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:18:03 2022] DELETE /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:18:03.968552 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2f35fbd2-81fb-4173-b90b-0fafb7d93f53 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:03.994848 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-2f35fbd2-81fb-4173-b90b-0fafb7d93f53 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Searching by: {'tenant_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'deleted': False} {{(pid=123016) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 22 17:18:04.003814 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2f35fbd2-81fb-4173-b90b-0fafb7d93f53 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:04.004452 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2f35fbd2-81fb-4173-b90b-0fafb7d93f53 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:04.005024 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2f35fbd2-81fb-4173-b90b-0fafb7d93f53 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:04.005875 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2f35fbd2-81fb-4173-b90b-0fafb7d93f53 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:04.010709 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2f35fbd2-81fb-4173-b90b-0fafb7d93f53 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:04.010709 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2f35fbd2-81fb-4173-b90b-0fafb7d93f53 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:04.146307 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.multi_cell_list [None req-2f35fbd2-81fb-4173-b90b-0fafb7d93f53 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 22 17:18:04.269151 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2f35fbd2-81fb-4173-b90b-0fafb7d93f53 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:04.271060 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2f35fbd2-81fb-4173-b90b-0fafb7d93f53 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:04.272860 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2f35fbd2-81fb-4173-b90b-0fafb7d93f53 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:04.661213 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3ae09f3d-3c7c-49fc-ada9-ae6e199d7102 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "DELETE /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24" status: 204 len: 0 microversion: 2.1 time: 2.085021 Aug 22 17:18:04.661213 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 698/1381] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:02 2022] DELETE /compute/v2.1/images/76e4c8e8-88d7-4bfc-b416-f79fa4475d24 => generated 0 bytes in 2086 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:18:04.667193 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8ee70970-b8cc-4cc0-af00-07954ecf5de5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] Calling method '.version_select at 0x7f80095fcf70>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:04.780564 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2f35fbd2-81fb-4173-b90b-0fafb7d93f53 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d2ecfb79c01d4d40850d84c3cced9240" status: 200 len: 4823 microversion: 2.1 time: 0.823601 Aug 22 17:18:04.781699 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 684/1382] 10.222.0.96 () {58 vars in 1257 bytes} [Mon Aug 22 17:18:03 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d2ecfb79c01d4d40850d84c3cced9240 => generated 4823 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:04.786717 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-44275e35-8901-4436-b95e-2804e36151aa tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:04.787468 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-44275e35-8901-4436-b95e-2804e36151aa tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] [instance: 33454b47-5846-4cf6-9c3d-fc9e83cc79f8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:04.808073 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-44275e35-8901-4436-b95e-2804e36151aa tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:04.809039 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-44275e35-8901-4436-b95e-2804e36151aa tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:04.809702 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-44275e35-8901-4436-b95e-2804e36151aa tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:04.810835 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-44275e35-8901-4436-b95e-2804e36151aa tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:04.811311 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-44275e35-8901-4436-b95e-2804e36151aa tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:04.811748 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-44275e35-8901-4436-b95e-2804e36151aa tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:04.999764 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-44275e35-8901-4436-b95e-2804e36151aa tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:05.009837 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-44275e35-8901-4436-b95e-2804e36151aa tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:05.011704 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-44275e35-8901-4436-b95e-2804e36151aa tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:05.019800 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-44275e35-8901-4436-b95e-2804e36151aa tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] 10.222.0.96 "GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8" status: 200 len: 1365 microversion: 2.47 time: 0.236944 Aug 22 17:18:05.033877 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 685/1383] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:18:04 2022] GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:18:05.057659 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4f11c59b-5dae-428a-9df6-b8524bd58387 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:05.058946 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-4f11c59b-5dae-428a-9df6-b8524bd58387 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:05.068352 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4f11c59b-5dae-428a-9df6-b8524bd58387 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:05.069531 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4f11c59b-5dae-428a-9df6-b8524bd58387 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:05.070228 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4f11c59b-5dae-428a-9df6-b8524bd58387 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:05.071199 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4f11c59b-5dae-428a-9df6-b8524bd58387 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:05.072092 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4f11c59b-5dae-428a-9df6-b8524bd58387 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:05.072754 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4f11c59b-5dae-428a-9df6-b8524bd58387 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:05.304145 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-4f11c59b-5dae-428a-9df6-b8524bd58387 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:05.314343 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4f11c59b-5dae-428a-9df6-b8524bd58387 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1472 microversion: 2.1 time: 0.278519 Aug 22 17:18:05.324700 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 686/1384] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:05 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1472 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:05.324700 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6860fc72-cca4-46ed-867c-edab382152e9 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '.version_select at 0x7f80096fbb80>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:05.372455 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8ee70970-b8cc-4cc0-af00-07954ecf5de5 tempest-ListImageFiltersTestJSON-1820567929 tempest-ListImageFiltersTestJSON-1820567929-project] 10.222.0.96 "DELETE /compute/v2.1/images/fe5e2235-fe7f-4080-a7ea-af5a4d98ebb4" status: 204 len: 0 microversion: 2.1 time: 0.712632 Aug 22 17:18:05.373063 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 699/1385] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:04 2022] DELETE /compute/v2.1/images/fe5e2235-fe7f-4080-a7ea-af5a4d98ebb4 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:18:05.378269 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-86cd9560-30b9-4f96-9dde-d81db2cc890b tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:05.384562 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-86cd9560-30b9-4f96-9dde-d81db2cc890b tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Searching by: {'tenant_id': '755a8316e24346c680afbfc787095c6e', 'deleted': False} {{(pid=123015) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 22 17:18:05.384781 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-6860fc72-cca4-46ed-867c-edab382152e9 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] HTTP exception thrown: Image not found. Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6860fc72-cca4-46ed-867c-edab382152e9 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Request method failure captured: Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: request: DELETE /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2 HTTP/1.1 Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7ngkkZYmh6Y0J1fzsOeHzKO9bIe1stZizPI1KvB5U0w04QK5uCT_3S109vOdtLJk18ANslR1IH0MnH6FPM7jTzhn6hyufK1r3sFJWHSAt39QtywwAnfsB-R5Bpw5ZdPrIoG3WwzbM4ucuM18f_F9SwWggoQbMg-Q4EUt7fj5WwSSLI Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 81a86484222946699be05f1087e2d005 Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ImagesOneServerTestJSON-653112909 Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/81a86484222946699be05f1087e2d005"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_81a86484222946699be05f1087e2d005", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/81a86484222946699be05f1087e2d005"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/81a86484222946699be05f1087e2d005"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ImagesOneServerTestJSON-653112909 Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 81a86484222946699be05f1087e2d005 Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-653112909 Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ImagesOneServerTestJSON-653112909-project Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: c2367b6e03a249b69e17156366ebbb53 Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ImagesOneServerTestJSON-653112909-project Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: exception: Image not found. Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '8c0f8380-2106-4601-abae-0ba6246a4cb2'} Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8c0f8380-2106-4601-abae-0ba6246a4cb2 to delete Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8c0f8380-2106-4601-abae-0ba6246a4cb2 could not be found. Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:05.389651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:05.396053 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6860fc72-cca4-46ed-867c-edab382152e9 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Returning 404 to user: Image not found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:05.398060 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-6860fc72-cca4-46ed-867c-edab382152e9 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "DELETE /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2" status: 404 len: 62 microversion: 2.1 time: 0.079064 Aug 22 17:18:05.398724 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-86cd9560-30b9-4f96-9dde-d81db2cc890b tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:05.399350 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 687/1386] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:05 2022] DELETE /compute/v2.1/images/8c0f8380-2106-4601-abae-0ba6246a4cb2 => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:18:05.400526 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-86cd9560-30b9-4f96-9dde-d81db2cc890b tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:05.401003 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-86cd9560-30b9-4f96-9dde-d81db2cc890b tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:05.405593 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-86cd9560-30b9-4f96-9dde-d81db2cc890b tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:05.405593 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-86cd9560-30b9-4f96-9dde-d81db2cc890b tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:05.405593 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-86cd9560-30b9-4f96-9dde-d81db2cc890b tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:05.421730 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e099306d-94c6-4364-bb92-7744c9cbd20e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:05.422665 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e099306d-94c6-4364-bb92-7744c9cbd20e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:05.432600 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e099306d-94c6-4364-bb92-7744c9cbd20e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:05.433332 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e099306d-94c6-4364-bb92-7744c9cbd20e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:05.434670 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e099306d-94c6-4364-bb92-7744c9cbd20e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:05.435303 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e099306d-94c6-4364-bb92-7744c9cbd20e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:05.435784 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e099306d-94c6-4364-bb92-7744c9cbd20e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:05.436192 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e099306d-94c6-4364-bb92-7744c9cbd20e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:05.444573 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:05.461790 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-86cd9560-30b9-4f96-9dde-d81db2cc890b tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=755a8316e24346c680afbfc787095c6e" status: 200 len: 15 microversion: 2.1 time: 0.077507 Aug 22 17:18:05.462447 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 700/1387] 10.222.0.96 () {58 vars in 1257 bytes} [Mon Aug 22 17:18:05 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=755a8316e24346c680afbfc787095c6e => generated 15 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:18:05.484133 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3edc3a77-0dbd-43d5-a8c1-424b7937b0b8 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:05.486092 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e099306d-94c6-4364-bb92-7744c9cbd20e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Going to try to terminate instance {{(pid=123016) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:18:05.496616 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3edc3a77-0dbd-43d5-a8c1-424b7937b0b8 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.015212 Aug 22 17:18:05.497998 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 701/1388] 10.222.0.96 () {58 vars in 1189 bytes} [Mon Aug 22 17:18:05 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:18:05.518425 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9588d4c6-03ae-4691-9ff2-83eb526aeb0e tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:05.521413 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9588d4c6-03ae-4691-9ff2-83eb526aeb0e tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:05.528640 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9588d4c6-03ae-4691-9ff2-83eb526aeb0e tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:05.529529 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9588d4c6-03ae-4691-9ff2-83eb526aeb0e tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:05.530223 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9588d4c6-03ae-4691-9ff2-83eb526aeb0e tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:05.531356 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9588d4c6-03ae-4691-9ff2-83eb526aeb0e tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:05.533019 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9588d4c6-03ae-4691-9ff2-83eb526aeb0e tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:05.534277 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9588d4c6-03ae-4691-9ff2-83eb526aeb0e tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:06.019401 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9588d4c6-03ae-4691-9ff2-83eb526aeb0e tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893/action" status: 202 len: 0 microversion: 2.1 time: 0.505519 Aug 22 17:18:06.023562 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 702/1389] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:18:05 2022] POST /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:18:06.030545 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9d14eda6-b451-46cb-aa29-ad7b7a048693 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:06.031831 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e099306d-94c6-4364-bb92-7744c9cbd20e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "DELETE /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 204 len: 0 microversion: 2.1 time: 0.613395 Aug 22 17:18:06.031831 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 688/1390] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:18:05 2022] DELETE /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:18:06.037347 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9d14eda6-b451-46cb-aa29-ad7b7a048693 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:06.038467 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9d14eda6-b451-46cb-aa29-ad7b7a048693 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240'} {{(pid=123015) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 22 17:18:06.040044 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-458827e0-d99b-43a9-b643-5c461a2ab5a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:06.042315 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-458827e0-d99b-43a9-b643-5c461a2ab5a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:06.047482 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9d14eda6-b451-46cb-aa29-ad7b7a048693 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:06.048638 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-458827e0-d99b-43a9-b643-5c461a2ab5a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:06.048776 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9d14eda6-b451-46cb-aa29-ad7b7a048693 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:06.049167 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-458827e0-d99b-43a9-b643-5c461a2ab5a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:06.049615 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-458827e0-d99b-43a9-b643-5c461a2ab5a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:06.049837 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9d14eda6-b451-46cb-aa29-ad7b7a048693 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:06.050331 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-458827e0-d99b-43a9-b643-5c461a2ab5a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:06.051120 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9d14eda6-b451-46cb-aa29-ad7b7a048693 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:06.051830 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9d14eda6-b451-46cb-aa29-ad7b7a048693 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:06.052743 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9d14eda6-b451-46cb-aa29-ad7b7a048693 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:06.054967 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-458827e0-d99b-43a9-b643-5c461a2ab5a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:06.055416 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-458827e0-d99b-43a9-b643-5c461a2ab5a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:06.203849 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.multi_cell_list [None req-9d14eda6-b451-46cb-aa29-ad7b7a048693 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123015) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 22 17:18:06.295963 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9d14eda6-b451-46cb-aa29-ad7b7a048693 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.270897 Aug 22 17:18:06.296763 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 703/1391] 10.222.0.96 () {58 vars in 1150 bytes} [Mon Aug 22 17:18:06 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:06.322992 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0b39fb22-b981-4667-b126-2d01bc8ed5ed tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:06.324815 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0b39fb22-b981-4667-b126-2d01bc8ed5ed tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] [instance: 33454b47-5846-4cf6-9c3d-fc9e83cc79f8] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:06.336691 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b39fb22-b981-4667-b126-2d01bc8ed5ed tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:06.337291 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b39fb22-b981-4667-b126-2d01bc8ed5ed tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:06.337744 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b39fb22-b981-4667-b126-2d01bc8ed5ed tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:06.338569 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b39fb22-b981-4667-b126-2d01bc8ed5ed tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:06.346118 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b39fb22-b981-4667-b126-2d01bc8ed5ed tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:06.347227 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b39fb22-b981-4667-b126-2d01bc8ed5ed tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:06.353795 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-458827e0-d99b-43a9-b643-5c461a2ab5a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:06.365234 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-458827e0-d99b-43a9-b643-5c461a2ab5a6 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1473 microversion: 2.1 time: 0.329357 Aug 22 17:18:06.367884 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 689/1392] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:06 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1473 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:06.383339 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b67c29c3-f3b1-4c05-b0b5-9334a6b9c569 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:06.386557 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b67c29c3-f3b1-4c05-b0b5-9334a6b9c569 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:06.402108 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b67c29c3-f3b1-4c05-b0b5-9334a6b9c569 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:06.402615 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b67c29c3-f3b1-4c05-b0b5-9334a6b9c569 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:06.403214 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b67c29c3-f3b1-4c05-b0b5-9334a6b9c569 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:06.403796 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b67c29c3-f3b1-4c05-b0b5-9334a6b9c569 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:06.404257 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b67c29c3-f3b1-4c05-b0b5-9334a6b9c569 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:06.404687 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b67c29c3-f3b1-4c05-b0b5-9334a6b9c569 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:06.471430 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0b39fb22-b981-4667-b126-2d01bc8ed5ed tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:06.480524 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0b39fb22-b981-4667-b126-2d01bc8ed5ed tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:06.482250 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0b39fb22-b981-4667-b126-2d01bc8ed5ed tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:06.490058 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0b39fb22-b981-4667-b126-2d01bc8ed5ed tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] 10.222.0.96 "GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8" status: 200 len: 1365 microversion: 2.47 time: 0.179641 Aug 22 17:18:06.493472 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 704/1393] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:18:06 2022] GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:18:06.498304 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1bab7b2f-3f91-45d6-b920-6c4099280c09 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:06.498914 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-1bab7b2f-3f91-45d6-b920-6c4099280c09 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:06.519691 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1bab7b2f-3f91-45d6-b920-6c4099280c09 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:06.520444 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1bab7b2f-3f91-45d6-b920-6c4099280c09 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:06.521123 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1bab7b2f-3f91-45d6-b920-6c4099280c09 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:06.521858 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1bab7b2f-3f91-45d6-b920-6c4099280c09 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:06.522320 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1bab7b2f-3f91-45d6-b920-6c4099280c09 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:06.522751 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1bab7b2f-3f91-45d6-b920-6c4099280c09 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:06.767903 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1bab7b2f-3f91-45d6-b920-6c4099280c09 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:06.783175 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1bab7b2f-3f91-45d6-b920-6c4099280c09 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1472 microversion: 2.1 time: 0.288510 Aug 22 17:18:06.783894 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 705/1394] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:06 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1472 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:06.852708 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b67c29c3-f3b1-4c05-b0b5-9334a6b9c569 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893/action" status: 202 len: 0 microversion: 2.1 time: 0.483479 Aug 22 17:18:06.863543 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d39d2caf-f1ba-4d59-ae56-766c66685966 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:06.864129 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 690/1395] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:18:06 2022] POST /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:18:06.864255 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d39d2caf-f1ba-4d59-ae56-766c66685966 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:06.880199 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d39d2caf-f1ba-4d59-ae56-766c66685966 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:06.880692 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d39d2caf-f1ba-4d59-ae56-766c66685966 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:06.881147 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d39d2caf-f1ba-4d59-ae56-766c66685966 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:06.887602 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d39d2caf-f1ba-4d59-ae56-766c66685966 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:06.888850 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d39d2caf-f1ba-4d59-ae56-766c66685966 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:06.891680 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d39d2caf-f1ba-4d59-ae56-766c66685966 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:06.914085 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:07.207015 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d39d2caf-f1ba-4d59-ae56-766c66685966 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1614 microversion: 2.1 time: 0.347198 Aug 22 17:18:07.221258 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 706/1396] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:06 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1614 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:18:07.239564 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-60ad62e7-0236-4260-89a5-803f2f8fb971 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:07.240333 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-60ad62e7-0236-4260-89a5-803f2f8fb971 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:07.249224 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-60ad62e7-0236-4260-89a5-803f2f8fb971 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:07.249713 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-60ad62e7-0236-4260-89a5-803f2f8fb971 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:07.250252 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-60ad62e7-0236-4260-89a5-803f2f8fb971 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:07.251334 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-60ad62e7-0236-4260-89a5-803f2f8fb971 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:07.253345 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-60ad62e7-0236-4260-89a5-803f2f8fb971 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:07.254655 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-60ad62e7-0236-4260-89a5-803f2f8fb971 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:07.396325 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-05a32fe7-b635-4910-8392-287fe785c67b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:07.399168 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-05a32fe7-b635-4910-8392-287fe785c67b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:07.407854 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-05a32fe7-b635-4910-8392-287fe785c67b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:07.408675 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-05a32fe7-b635-4910-8392-287fe785c67b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:07.409153 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-05a32fe7-b635-4910-8392-287fe785c67b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:07.410202 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-05a32fe7-b635-4910-8392-287fe785c67b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:07.410763 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-05a32fe7-b635-4910-8392-287fe785c67b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:07.411958 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-05a32fe7-b635-4910-8392-287fe785c67b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:07.664130 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-60ad62e7-0236-4260-89a5-803f2f8fb971 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1614 microversion: 2.1 time: 0.427542 Aug 22 17:18:07.665425 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 691/1397] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:07 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1614 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:07.673920 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-cbf362dd-11c7-4a88-89ef-f3bc4818cae3 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:07.676920 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-cbf362dd-11c7-4a88-89ef-f3bc4818cae3 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] [instance: 33454b47-5846-4cf6-9c3d-fc9e83cc79f8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:07.701376 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cbf362dd-11c7-4a88-89ef-f3bc4818cae3 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:07.702998 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cbf362dd-11c7-4a88-89ef-f3bc4818cae3 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:07.704074 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cbf362dd-11c7-4a88-89ef-f3bc4818cae3 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:07.706676 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cbf362dd-11c7-4a88-89ef-f3bc4818cae3 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:07.707874 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cbf362dd-11c7-4a88-89ef-f3bc4818cae3 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:07.708532 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cbf362dd-11c7-4a88-89ef-f3bc4818cae3 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:07.789408 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-05a32fe7-b635-4910-8392-287fe785c67b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:07.812365 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-05a32fe7-b635-4910-8392-287fe785c67b tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1473 microversion: 2.1 time: 0.427120 Aug 22 17:18:07.813093 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 707/1398] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:07 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1473 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:18:07.825680 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-df81c2d8-e9af-431b-9f22-bb5deecb73eb tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:07.840096 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cbf362dd-11c7-4a88-89ef-f3bc4818cae3 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:07.840597 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cbf362dd-11c7-4a88-89ef-f3bc4818cae3 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:07.841024 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cbf362dd-11c7-4a88-89ef-f3bc4818cae3 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:07.841624 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-cbf362dd-11c7-4a88-89ef-f3bc4818cae3 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lazy-loading 'fault' on Instance uuid 33454b47-5846-4cf6-9c3d-fc9e83cc79f8 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:18:07.852893 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-df81c2d8-e9af-431b-9f22-bb5deecb73eb tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Searching by: {'host': 'n-h2-854030-1', 'deleted': False} {{(pid=123015) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 22 17:18:07.875025 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-df81c2d8-e9af-431b-9f22-bb5deecb73eb tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:07.886031 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-df81c2d8-e9af-431b-9f22-bb5deecb73eb tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:07.886031 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-df81c2d8-e9af-431b-9f22-bb5deecb73eb tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:07.886031 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-df81c2d8-e9af-431b-9f22-bb5deecb73eb tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:07.886031 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-df81c2d8-e9af-431b-9f22-bb5deecb73eb tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:07.886031 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-df81c2d8-e9af-431b-9f22-bb5deecb73eb tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:08.239866 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.multi_cell_list [None req-df81c2d8-e9af-431b-9f22-bb5deecb73eb tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=123015) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 22 17:18:08.289502 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-cbf362dd-11c7-4a88-89ef-f3bc4818cae3 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:08.299008 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-cbf362dd-11c7-4a88-89ef-f3bc4818cae3 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:08.311116 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-cbf362dd-11c7-4a88-89ef-f3bc4818cae3 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2746af57c0ac434f9d6b5d1ee7292913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70aa947d304b82a306da97a5d08282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:08.313855 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-cbf362dd-11c7-4a88-89ef-f3bc4818cae3 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] 10.222.0.96 "GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8" status: 200 len: 1370 microversion: 2.47 time: 0.646004 Aug 22 17:18:08.314702 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 692/1399] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:18:07 2022] GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8 => generated 1370 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:18:08.320763 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-de5d6315-0bce-4e54-bc74-ee982f7c00a1 req-229fbeef-12ab-41a7-adb0-a351a5d17910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283c0e37-bf44-4514-9a22-78f349663102", "name": "network-vif-deleted", "tag": "6ae81955-3017-4ea8-9dd4-92356f7e4dbc"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:08.350503 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-de5d6315-0bce-4e54-bc74-ee982f7c00a1 req-229fbeef-12ab-41a7-adb0-a351a5d17910 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:08.351265 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-de5d6315-0bce-4e54-bc74-ee982f7c00a1 req-229fbeef-12ab-41a7-adb0-a351a5d17910 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:08.351947 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-de5d6315-0bce-4e54-bc74-ee982f7c00a1 req-229fbeef-12ab-41a7-adb0-a351a5d17910 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:08.365378 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-de5d6315-0bce-4e54-bc74-ee982f7c00a1 req-229fbeef-12ab-41a7-adb0-a351a5d17910 service nova] Creating event network-vif-deleted:6ae81955-3017-4ea8-9dd4-92356f7e4dbc for instance 283c0e37-bf44-4514-9a22-78f349663102 on n-h1-854030-1 Aug 22 17:18:08.387227 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-de5d6315-0bce-4e54-bc74-ee982f7c00a1 req-229fbeef-12ab-41a7-adb0-a351a5d17910 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070822 Aug 22 17:18:08.388154 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 693/1400] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:08.395207 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a6e86515-b09d-4223-aedf-c5964e95d7de tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:08.395914 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-a6e86515-b09d-4223-aedf-c5964e95d7de tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:08.423922 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a6e86515-b09d-4223-aedf-c5964e95d7de tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:08.424722 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a6e86515-b09d-4223-aedf-c5964e95d7de tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:08.425544 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a6e86515-b09d-4223-aedf-c5964e95d7de tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:08.426823 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a6e86515-b09d-4223-aedf-c5964e95d7de tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:08.428215 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a6e86515-b09d-4223-aedf-c5964e95d7de tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:08.428356 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a6e86515-b09d-4223-aedf-c5964e95d7de tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:08.475864 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-df81c2d8-e9af-431b-9f22-bb5deecb73eb tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] 10.222.0.96 "GET /compute/v2.1/servers?host=n-h2-854030-1&all_tenants=1" status: 200 len: 1975 microversion: 2.1 time: 0.657924 Aug 22 17:18:08.477118 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 708/1401] 10.222.0.96 () {58 vars in 1190 bytes} [Mon Aug 22 17:18:07 2022] GET /compute/v2.1/servers?host=n-h2-854030-1&all_tenants=1 => generated 1975 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:08.488135 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a6e86515-b09d-4223-aedf-c5964e95d7de tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:08.488135 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a6e86515-b09d-4223-aedf-c5964e95d7de tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:08.488135 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a6e86515-b09d-4223-aedf-c5964e95d7de tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:08.488135 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-a6e86515-b09d-4223-aedf-c5964e95d7de tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lazy-loading 'fault' on Instance uuid 283c0e37-bf44-4514-9a22-78f349663102 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:18:08.499773 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0e8d5414-d5e1-4d96-b687-9415ece818a1 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:08.519150 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0e8d5414-d5e1-4d96-b687-9415ece818a1 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=123015) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 22 17:18:08.526182 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0e8d5414-d5e1-4d96-b687-9415ece818a1 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:08.533386 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0e8d5414-d5e1-4d96-b687-9415ece818a1 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:08.533386 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0e8d5414-d5e1-4d96-b687-9415ece818a1 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:08.533386 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0e8d5414-d5e1-4d96-b687-9415ece818a1 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:08.533386 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0e8d5414-d5e1-4d96-b687-9415ece818a1 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:08.533386 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0e8d5414-d5e1-4d96-b687-9415ece818a1 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:08.559636 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0e8d5414-d5e1-4d96-b687-9415ece818a1 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] 10.222.0.96 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.067749 Aug 22 17:18:08.561128 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 709/1402] 10.222.0.96 () {58 vars in 1196 bytes} [Mon Aug 22 17:18:08 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:18:08.576627 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e5be8f36-fd52-49f0-8e4b-e34001de01ca tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:08.580844 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-e5be8f36-fd52-49f0-8e4b-e34001de01ca tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:08.587777 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e5be8f36-fd52-49f0-8e4b-e34001de01ca tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:08.592519 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e5be8f36-fd52-49f0-8e4b-e34001de01ca tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:08.592519 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e5be8f36-fd52-49f0-8e4b-e34001de01ca tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:08.592519 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e5be8f36-fd52-49f0-8e4b-e34001de01ca tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:08.592519 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e5be8f36-fd52-49f0-8e4b-e34001de01ca tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:08.592519 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e5be8f36-fd52-49f0-8e4b-e34001de01ca tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:08.663338 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a6e86515-b09d-4223-aedf-c5964e95d7de tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:08.689700 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a6e86515-b09d-4223-aedf-c5964e95d7de tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 200 len: 1306 microversion: 2.1 time: 0.299302 Aug 22 17:18:08.695713 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 694/1403] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:08 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 1306 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:08.855563 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b092d4de-c91c-4ab6-92cd-22fa05e57df2 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:08.856345 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b092d4de-c91c-4ab6-92cd-22fa05e57df2 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:08.864316 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b092d4de-c91c-4ab6-92cd-22fa05e57df2 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:08.865695 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b092d4de-c91c-4ab6-92cd-22fa05e57df2 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:08.866504 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b092d4de-c91c-4ab6-92cd-22fa05e57df2 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:08.868091 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b092d4de-c91c-4ab6-92cd-22fa05e57df2 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:08.868091 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b092d4de-c91c-4ab6-92cd-22fa05e57df2 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:08.868581 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b092d4de-c91c-4ab6-92cd-22fa05e57df2 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:09.046423 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e5be8f36-fd52-49f0-8e4b-e34001de01ca tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893/action" status: 202 len: 0 microversion: 2.1 time: 0.469503 Aug 22 17:18:09.046423 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 710/1404] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:18:08 2022] POST /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:18:09.052869 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:09.056525 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:09.068816 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:09.070155 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:09.070869 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:09.072218 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:09.072932 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:09.073634 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:09.194067 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:18:09.194490 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:18:09.194959 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:18:09.198282 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:18:09.198282 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:18:09.324893 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b092d4de-c91c-4ab6-92cd-22fa05e57df2 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:09.336626 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b092d4de-c91c-4ab6-92cd-22fa05e57df2 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1473 microversion: 2.1 time: 0.485321 Aug 22 17:18:09.342060 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 695/1405] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:08 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1473 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:09.366459 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5a8922ec-f68d-4890-994b-d89b41a91a83 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:09.367340 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5a8922ec-f68d-4890-994b-d89b41a91a83 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] [instance: 33454b47-5846-4cf6-9c3d-fc9e83cc79f8] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:09.376226 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5a8922ec-f68d-4890-994b-d89b41a91a83 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:09.377409 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5a8922ec-f68d-4890-994b-d89b41a91a83 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:09.377987 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5a8922ec-f68d-4890-994b-d89b41a91a83 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:09.378571 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5a8922ec-f68d-4890-994b-d89b41a91a83 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:09.379030 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5a8922ec-f68d-4890-994b-d89b41a91a83 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:09.379482 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5a8922ec-f68d-4890-994b-d89b41a91a83 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:09.399358 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-5a8922ec-f68d-4890-994b-d89b41a91a83 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] HTTP exception thrown: Instance 33454b47-5846-4cf6-9c3d-fc9e83cc79f8 could not be found. Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5a8922ec-f68d-4890-994b-d89b41a91a83 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Request method failure captured: Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8 HTTP/1.1 Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7o5rP1qbwpic1DqiaoMqlu51apwAhF2Ezmb8DNO6_qy666uUc7miI0rjhKgRBTlvUPDc66IhnU1guuwmkv44uJT8acKQ6jvJ1kKW3CImG04n5eF2KVklr4CBDvo_poAK6VAFSUFTcoboSv47ZEASDPUw3jmLI_pHWY9QNxxfd9vlSs Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-Openstack-Nova-Api-Version: 2.47 Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: ce70aa947d304b82a306da97a5d08282 Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServersAaction247Test-848156845 Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ce70aa947d304b82a306da97a5d08282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_ce70aa947d304b82a306da97a5d08282", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ce70aa947d304b82a306da97a5d08282"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/ce70aa947d304b82a306da97a5d08282"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServersAaction247Test-848156845 Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: ce70aa947d304b82a306da97a5d08282 Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServersAaction247Test-848156845 Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServersAaction247Test-848156845-project Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 2746af57c0ac434f9d6b5d1ee7292913 Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServersAaction247Test-848156845-project Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance 33454b47-5846-4cf6-9c3d-fc9e83cc79f8 could not be found. Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '33454b47-5846-4cf6-9c3d-fc9e83cc79f8'} Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33454b47-5846-4cf6-9c3d-fc9e83cc79f8 could not be found. Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33454b47-5846-4cf6-9c3d-fc9e83cc79f8 could not be found. Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:09.401941 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:09.411053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:09.411053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:09.411053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:09.411053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:09.411053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:09.411053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33454b47-5846-4cf6-9c3d-fc9e83cc79f8 could not be found. Aug 22 17:18:09.411053 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:09.411053 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5a8922ec-f68d-4890-994b-d89b41a91a83 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] Returning 404 to user: Instance 33454b47-5846-4cf6-9c3d-fc9e83cc79f8 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:09.411053 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5a8922ec-f68d-4890-994b-d89b41a91a83 tempest-ServersAaction247Test-848156845 tempest-ServersAaction247Test-848156845-project] 10.222.0.96 "GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8" status: 404 len: 111 microversion: 2.47 time: 0.045850 Aug 22 17:18:09.413178 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 696/1406] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:18:09 2022] GET /compute/v2.1/servers/33454b47-5846-4cf6-9c3d-fc9e83cc79f8 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:18:09.471558 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:09.478593 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:09.479706 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:09.480252 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:09.481231 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:09.481746 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:09.482173 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:09.514580 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a835c054-98be-4ec8-883f-fc0def21cfd3 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "POST /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893/action" status: 202 len: 1067 microversion: 2.1 time: 0.466935 Aug 22 17:18:09.515223 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 711/1407] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:18:09 2022] POST /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893/action => generated 1067 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 22 17:18:09.533193 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9505029e-87a2-4ae3-bec3-2ba9a84c381d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:09.534059 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-9505029e-87a2-4ae3-bec3-2ba9a84c381d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:09.540853 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9505029e-87a2-4ae3-bec3-2ba9a84c381d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:09.541552 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9505029e-87a2-4ae3-bec3-2ba9a84c381d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:09.542270 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9505029e-87a2-4ae3-bec3-2ba9a84c381d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:09.543026 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9505029e-87a2-4ae3-bec3-2ba9a84c381d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:09.543492 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9505029e-87a2-4ae3-bec3-2ba9a84c381d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:09.544101 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9505029e-87a2-4ae3-bec3-2ba9a84c381d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:09.722803 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-73b00ac2-ad51-43a7-83a4-e31e602f5069 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:09.724977 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-73b00ac2-ad51-43a7-83a4-e31e602f5069 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 283c0e37-bf44-4514-9a22-78f349663102] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:09.736644 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-73b00ac2-ad51-43a7-83a4-e31e602f5069 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:09.737602 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-73b00ac2-ad51-43a7-83a4-e31e602f5069 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:09.738768 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-73b00ac2-ad51-43a7-83a4-e31e602f5069 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:09.740478 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-73b00ac2-ad51-43a7-83a4-e31e602f5069 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:09.741258 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-73b00ac2-ad51-43a7-83a4-e31e602f5069 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:09.741823 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-73b00ac2-ad51-43a7-83a4-e31e602f5069 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:09.762212 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-73b00ac2-ad51-43a7-83a4-e31e602f5069 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] HTTP exception thrown: Instance 283c0e37-bf44-4514-9a22-78f349663102 could not be found. Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-73b00ac2-ad51-43a7-83a4-e31e602f5069 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Request method failure captured: Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 HTTP/1.1 Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7lgSm4FKTHXtIz1Gx3tknJOMgFMA7b9cAHDnITnAh8xWgKu_QooBsvcVa7rpSsMIJ6ZKXC66_UbsLY8HsWtLPA5uE9Pus_XRXBiWc4yypjcu3nCl--V0IVy0QYTFoToZbtM4oNXEEZt6kW8A07lFUNftp3OyGh5k6tT3dZfr8k0e20 Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: d789047469894e1fbe5af3a109a95b4c Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_d789047469894e1fbe5af3a109a95b4c", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: d789047469894e1fbe5af3a109a95b4c Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersOnMultiNodesTest-1888665690-project Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 43188026fda44118ad642b7065108966 Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersOnMultiNodesTest-1888665690-project Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance 283c0e37-bf44-4514-9a22-78f349663102 could not be found. Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '283c0e37-bf44-4514-9a22-78f349663102'} Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 283c0e37-bf44-4514-9a22-78f349663102 could not be found. Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 283c0e37-bf44-4514-9a22-78f349663102 could not be found. Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:09.763916 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:09.776071 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:09.776071 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:09.776071 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:09.776071 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:09.776071 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:09.776071 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 283c0e37-bf44-4514-9a22-78f349663102 could not be found. Aug 22 17:18:09.776071 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:09.776071 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-73b00ac2-ad51-43a7-83a4-e31e602f5069 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Returning 404 to user: Instance 283c0e37-bf44-4514-9a22-78f349663102 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:09.776071 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-73b00ac2-ad51-43a7-83a4-e31e602f5069 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102" status: 404 len: 111 microversion: 2.1 time: 0.052018 Aug 22 17:18:09.776071 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 712/1408] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:09 2022] GET /compute/v2.1/servers/283c0e37-bf44-4514-9a22-78f349663102 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:18:09.782503 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-866db6f4-b0d1-4cb6-b9fb-660b95af67d6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:09.783205 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-866db6f4-b0d1-4cb6-b9fb-660b95af67d6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:09.790320 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-866db6f4-b0d1-4cb6-b9fb-660b95af67d6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:09.791280 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-866db6f4-b0d1-4cb6-b9fb-660b95af67d6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:09.791951 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-866db6f4-b0d1-4cb6-b9fb-660b95af67d6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:09.793013 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-866db6f4-b0d1-4cb6-b9fb-660b95af67d6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:09.793870 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-866db6f4-b0d1-4cb6-b9fb-660b95af67d6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:09.795955 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-866db6f4-b0d1-4cb6-b9fb-660b95af67d6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:09.854710 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-866db6f4-b0d1-4cb6-b9fb-660b95af67d6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Going to try to terminate instance {{(pid=123015) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:18:10.160739 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9505029e-87a2-4ae3-bec3-2ba9a84c381d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:10.169457 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9505029e-87a2-4ae3-bec3-2ba9a84c381d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1471 microversion: 2.1 time: 0.640288 Aug 22 17:18:10.181406 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 697/1409] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:09 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1471 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:10.184968 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-866db6f4-b0d1-4cb6-b9fb-660b95af67d6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "DELETE /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef" status: 204 len: 0 microversion: 2.1 time: 0.408103 Aug 22 17:18:10.185752 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 713/1410] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:18:09 2022] DELETE /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:18:10.205407 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-efde2148-1f52-4a1a-a22d-c2f6f2d14118 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:10.205407 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-efde2148-1f52-4a1a-a22d-c2f6f2d14118 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:10.216645 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-efde2148-1f52-4a1a-a22d-c2f6f2d14118 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:10.218660 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-efde2148-1f52-4a1a-a22d-c2f6f2d14118 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:10.220354 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-efde2148-1f52-4a1a-a22d-c2f6f2d14118 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:10.222802 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-b33bebcf-e796-4333-aa25-af893c41a067 req-7677ddd9-8f8b-457d-ac56-b927d2f46ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9580929a-e453-41ef-a4e9-330cede53f01", "name": "network-vif-deleted", "tag": "ae70627f-e44d-42a8-9bae-1081a5f5e717"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:10.225592 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-efde2148-1f52-4a1a-a22d-c2f6f2d14118 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:10.226762 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-efde2148-1f52-4a1a-a22d-c2f6f2d14118 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:10.228448 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-efde2148-1f52-4a1a-a22d-c2f6f2d14118 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:10.242199 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-b33bebcf-e796-4333-aa25-af893c41a067 req-7677ddd9-8f8b-457d-ac56-b927d2f46ac5 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:10.242679 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-b33bebcf-e796-4333-aa25-af893c41a067 req-7677ddd9-8f8b-457d-ac56-b927d2f46ac5 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:10.243109 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-b33bebcf-e796-4333-aa25-af893c41a067 req-7677ddd9-8f8b-457d-ac56-b927d2f46ac5 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:10.265829 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-b33bebcf-e796-4333-aa25-af893c41a067 req-7677ddd9-8f8b-457d-ac56-b927d2f46ac5 service nova] Creating event network-vif-deleted:ae70627f-e44d-42a8-9bae-1081a5f5e717 for instance 9580929a-e453-41ef-a4e9-330cede53f01 on n-h2-854030-1 Aug 22 17:18:10.273944 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-b33bebcf-e796-4333-aa25-af893c41a067 req-7677ddd9-8f8b-457d-ac56-b927d2f46ac5 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056343 Aug 22 17:18:10.274546 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 714/1411] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:18:10.361356 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a40c4c41-a200-4a15-aad7-582c54f5c447 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:10.362080 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a40c4c41-a200-4a15-aad7-582c54f5c447 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:10.385287 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a40c4c41-a200-4a15-aad7-582c54f5c447 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:10.385656 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a40c4c41-a200-4a15-aad7-582c54f5c447 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:10.386104 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a40c4c41-a200-4a15-aad7-582c54f5c447 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:10.386840 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a40c4c41-a200-4a15-aad7-582c54f5c447 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:10.387299 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a40c4c41-a200-4a15-aad7-582c54f5c447 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:10.387725 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a40c4c41-a200-4a15-aad7-582c54f5c447 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:10.788225 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-efde2148-1f52-4a1a-a22d-c2f6f2d14118 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:10.805343 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-efde2148-1f52-4a1a-a22d-c2f6f2d14118 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef" status: 200 len: 1471 microversion: 2.1 time: 0.606646 Aug 22 17:18:10.815566 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a40c4c41-a200-4a15-aad7-582c54f5c447 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2367b6e03a249b69e17156366ebbb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a86484222946699be05f1087e2d005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:10.819739 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 698/1412] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:10 2022] GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef => generated 1471 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:18:10.853979 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a40c4c41-a200-4a15-aad7-582c54f5c447 tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 200 len: 1302 microversion: 2.1 time: 0.495206 Aug 22 17:18:10.857650 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 715/1413] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:10 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 1302 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:18:11.214903 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-65a85a1e-f2a3-452f-9053-e13718a558e8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:11.215773 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-65a85a1e-f2a3-452f-9053-e13718a558e8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:11.227874 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-65a85a1e-f2a3-452f-9053-e13718a558e8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:11.228690 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-65a85a1e-f2a3-452f-9053-e13718a558e8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:11.230015 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-65a85a1e-f2a3-452f-9053-e13718a558e8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:11.231161 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-65a85a1e-f2a3-452f-9053-e13718a558e8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:11.231813 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-65a85a1e-f2a3-452f-9053-e13718a558e8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:11.232404 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-65a85a1e-f2a3-452f-9053-e13718a558e8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:11.629903 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-65a85a1e-f2a3-452f-9053-e13718a558e8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:11.696470 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-65a85a1e-f2a3-452f-9053-e13718a558e8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1471 microversion: 2.1 time: 0.487755 Aug 22 17:18:11.698846 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 699/1414] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:11 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1471 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:11.829865 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-72f8f1f1-ffed-4bb6-8630-5a73601fe5d4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:11.830497 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-72f8f1f1-ffed-4bb6-8630-5a73601fe5d4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:11.847015 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-72f8f1f1-ffed-4bb6-8630-5a73601fe5d4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:11.847535 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-72f8f1f1-ffed-4bb6-8630-5a73601fe5d4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:11.847988 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-72f8f1f1-ffed-4bb6-8630-5a73601fe5d4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:11.848855 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-72f8f1f1-ffed-4bb6-8630-5a73601fe5d4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:11.849356 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-72f8f1f1-ffed-4bb6-8630-5a73601fe5d4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:11.849991 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-72f8f1f1-ffed-4bb6-8630-5a73601fe5d4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:11.903677 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-84f200bb-01d2-470f-8d85-e8a6fa54278e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:11.910124 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-84f200bb-01d2-470f-8d85-e8a6fa54278e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] [instance: 9580929a-e453-41ef-a4e9-330cede53f01] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:11.945374 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-84f200bb-01d2-470f-8d85-e8a6fa54278e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:11.949030 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-84f200bb-01d2-470f-8d85-e8a6fa54278e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:11.950022 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-84f200bb-01d2-470f-8d85-e8a6fa54278e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:11.951765 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-84f200bb-01d2-470f-8d85-e8a6fa54278e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:11.972739 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-84f200bb-01d2-470f-8d85-e8a6fa54278e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:11.974271 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-84f200bb-01d2-470f-8d85-e8a6fa54278e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:12.008460 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-84f200bb-01d2-470f-8d85-e8a6fa54278e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] HTTP exception thrown: Instance 9580929a-e453-41ef-a4e9-330cede53f01 could not be found. Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-84f200bb-01d2-470f-8d85-e8a6fa54278e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Request method failure captured: Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 HTTP/1.1 Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7ngkkZYmh6Y0J1fzsOeHzKO9bIe1stZizPI1KvB5U0w04QK5uCT_3S109vOdtLJk18ANslR1IH0MnH6FPM7jTzhn6hyufK1r3sFJWHSAt39QtywwAnfsB-R5Bpw5ZdPrIoG3WwzbM4ucuM18f_F9SwWggoQbMg-Q4EUt7fj5WwSSLI Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 81a86484222946699be05f1087e2d005 Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ImagesOneServerTestJSON-653112909 Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/81a86484222946699be05f1087e2d005"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_81a86484222946699be05f1087e2d005", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/81a86484222946699be05f1087e2d005"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/81a86484222946699be05f1087e2d005"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ImagesOneServerTestJSON-653112909 Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 81a86484222946699be05f1087e2d005 Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-653112909 Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ImagesOneServerTestJSON-653112909-project Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: c2367b6e03a249b69e17156366ebbb53 Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ImagesOneServerTestJSON-653112909-project Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance 9580929a-e453-41ef-a4e9-330cede53f01 could not be found. Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '9580929a-e453-41ef-a4e9-330cede53f01'} Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9580929a-e453-41ef-a4e9-330cede53f01 could not be found. Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9580929a-e453-41ef-a4e9-330cede53f01 could not be found. Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:12.010419 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:12.015360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:12.015360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:12.015360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:12.015360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:12.015360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:12.015360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9580929a-e453-41ef-a4e9-330cede53f01 could not be found. Aug 22 17:18:12.015360 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:12.018526 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-84f200bb-01d2-470f-8d85-e8a6fa54278e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] Returning 404 to user: Instance 9580929a-e453-41ef-a4e9-330cede53f01 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:12.019409 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-84f200bb-01d2-470f-8d85-e8a6fa54278e tempest-ImagesOneServerTestJSON-653112909 tempest-ImagesOneServerTestJSON-653112909-project] 10.222.0.96 "GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01" status: 404 len: 111 microversion: 2.1 time: 0.137163 Aug 22 17:18:12.020007 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 700/1415] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:11 2022] GET /compute/v2.1/servers/9580929a-e453-41ef-a4e9-330cede53f01 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:18:12.196022 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-72f8f1f1-ffed-4bb6-8630-5a73601fe5d4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:12.210803 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-72f8f1f1-ffed-4bb6-8630-5a73601fe5d4 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef" status: 200 len: 1471 microversion: 2.1 time: 0.387729 Aug 22 17:18:12.216043 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 716/1416] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:11 2022] GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef => generated 1471 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:12.725433 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4ad210f5-3466-48fe-8011-1f5524378e29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:12.738556 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-4ad210f5-3466-48fe-8011-1f5524378e29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:12.760140 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:12.765763 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4ad210f5-3466-48fe-8011-1f5524378e29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:12.766287 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4ad210f5-3466-48fe-8011-1f5524378e29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:12.771127 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4ad210f5-3466-48fe-8011-1f5524378e29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:12.774705 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4ad210f5-3466-48fe-8011-1f5524378e29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:12.775241 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4ad210f5-3466-48fe-8011-1f5524378e29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:12.777442 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4ad210f5-3466-48fe-8011-1f5524378e29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:13.564251 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5fad9427-3070-4e6d-b341-1e405e4da522 tempest-ListServerFiltersTestJSON-693212699 tempest-ListServerFiltersTestJSON-693212699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-546224936", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "dd84ebc4-e9f3-48fe-b7b6-433c212868ea"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:13.574948 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-4ad210f5-3466-48fe-8011-1f5524378e29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:13.626899 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4ad210f5-3466-48fe-8011-1f5524378e29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1471 microversion: 2.1 time: 0.901035 Aug 22 17:18:13.642066 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 701/1417] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:12 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1471 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:13.649341 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b10701be-2de4-41ad-9ea6-d16177e34170 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:13.654559 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b10701be-2de4-41ad-9ea6-d16177e34170 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:13.659310 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b10701be-2de4-41ad-9ea6-d16177e34170 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:13.660240 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b10701be-2de4-41ad-9ea6-d16177e34170 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:13.660989 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b10701be-2de4-41ad-9ea6-d16177e34170 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:13.662392 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b10701be-2de4-41ad-9ea6-d16177e34170 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:13.663128 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b10701be-2de4-41ad-9ea6-d16177e34170 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:13.664169 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b10701be-2de4-41ad-9ea6-d16177e34170 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:13.702019 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-5fad9427-3070-4e6d-b341-1e405e4da522 tempest-ListServerFiltersTestJSON-693212699 tempest-ListServerFiltersTestJSON-693212699-project] validate_networks() for [('dd84ebc4-e9f3-48fe-b7b6-433c212868ea', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:18:14.046573 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:14.184845 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b10701be-2de4-41ad-9ea6-d16177e34170 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:14.198834 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b10701be-2de4-41ad-9ea6-d16177e34170 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef" status: 200 len: 1471 microversion: 2.1 time: 0.554093 Aug 22 17:18:14.200185 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 702/1418] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:13 2022] GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef => generated 1471 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:14.649950 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-17eec2ce-5681-47dd-9c5f-4c071d9600d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:14.651383 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-17eec2ce-5681-47dd-9c5f-4c071d9600d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:14.659302 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:14.680722 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17eec2ce-5681-47dd-9c5f-4c071d9600d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:14.683332 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17eec2ce-5681-47dd-9c5f-4c071d9600d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:14.684222 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17eec2ce-5681-47dd-9c5f-4c071d9600d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:14.687310 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17eec2ce-5681-47dd-9c5f-4c071d9600d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:14.692357 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17eec2ce-5681-47dd-9c5f-4c071d9600d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:14.693001 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17eec2ce-5681-47dd-9c5f-4c071d9600d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:14.750084 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-5fad9427-3070-4e6d-b341-1e405e4da522 tempest-ListServerFiltersTestJSON-693212699 tempest-ListServerFiltersTestJSON-693212699-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-336bdc85-5dd7-4bb9-bcb5-20b7f826d322) Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:18:15.370540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-336bdc85-5dd7-4bb9-bcb5-20b7f826d322) Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-5fad9427-3070-4e6d-b341-1e405e4da522 tempest-ListServerFiltersTestJSON-693212699 tempest-ListServerFiltersTestJSON-693212699-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5fad9427-3070-4e6d-b341-1e405e4da522 tempest-ListServerFiltersTestJSON-693212699 tempest-ListServerFiltersTestJSON-693212699-project] Request method failure captured: Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 212 Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7pUWOsCCkTCuma2EvIjJ3K1gZ065RwItDYwZ3yC-rQYEYFBCNLTjLYVcPba4nZCKtxIL-ICR3yyfA91ojPHnqPgYaqqesDz9-fnBx-64yHxn7j1USz61fqfeHv-VWMccRh_RkyyHmMK4Wna46qwBi2oDVtBPqt42nM2uvpsOOZdQKI Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 81ebe8aa69a6437191ef8ad58ad71cc7 Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ListServerFiltersTestJSON-693212699 Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/81ebe8aa69a6437191ef8ad58ad71cc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_81ebe8aa69a6437191ef8ad58ad71cc7", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/81ebe8aa69a6437191ef8ad58ad71cc7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/81ebe8aa69a6437191ef8ad58ad71cc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ListServerFiltersTestJSON-693212699 Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 81ebe8aa69a6437191ef8ad58ad71cc7 Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-693212699 Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ListServerFiltersTestJSON-693212699-project Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: cff4448cdf034beeb0df58bbb6482803 Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ListServerFiltersTestJSON-693212699-project Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-546224936", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "dd84ebc4-e9f3-48fe-b7b6-433c212868ea"}]}} Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:18:15.388493 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ListServerFiltersTestJSON-instance-546224936', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'dd84ebc4-e9f3-48fe-b7b6-433c212868ea'}]}}} Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:18:15.405655 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-336bdc85-5dd7-4bb9-bcb5-20b7f826d322) Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5fad9427-3070-4e6d-b341-1e405e4da522 tempest-ListServerFiltersTestJSON-693212699 tempest-ListServerFiltersTestJSON-693212699-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5fad9427-3070-4e6d-b341-1e405e4da522 tempest-ListServerFiltersTestJSON-693212699 tempest-ListServerFiltersTestJSON-693212699-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.256065 Aug 22 17:18:15.421981 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 717/1419] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:18:13 2022] POST /compute/v2.1/servers => generated 214 bytes in 2276 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:18:15.435052 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4a135537-e0a3-47cb-80d7-ad8180fae14d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:15.441973 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-4a135537-e0a3-47cb-80d7-ad8180fae14d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:15.483719 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:15.493296 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4a135537-e0a3-47cb-80d7-ad8180fae14d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:15.500168 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4a135537-e0a3-47cb-80d7-ad8180fae14d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:15.506068 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4a135537-e0a3-47cb-80d7-ad8180fae14d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:15.507470 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4a135537-e0a3-47cb-80d7-ad8180fae14d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:15.508309 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4a135537-e0a3-47cb-80d7-ad8180fae14d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:15.509066 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4a135537-e0a3-47cb-80d7-ad8180fae14d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:16.036353 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-4a135537-e0a3-47cb-80d7-ad8180fae14d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:16.066497 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-4a135537-e0a3-47cb-80d7-ad8180fae14d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef" status: 200 len: 1429 microversion: 2.1 time: 0.658687 Aug 22 17:18:16.068188 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 718/1420] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:15 2022] GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef => generated 1429 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:16.074511 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-b17cae61-59d6-4abd-a218-011f9dbf117f req-3c388792-4240-45f4-b52f-bc2151a14f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef", "name": "network-vif-deleted", "tag": "b352d2eb-caa0-497b-9514-da6f7dd81bb0"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:16.088863 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-b17cae61-59d6-4abd-a218-011f9dbf117f req-3c388792-4240-45f4-b52f-bc2151a14f1f service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:16.090669 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-b17cae61-59d6-4abd-a218-011f9dbf117f req-3c388792-4240-45f4-b52f-bc2151a14f1f service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:16.091598 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-b17cae61-59d6-4abd-a218-011f9dbf117f req-3c388792-4240-45f4-b52f-bc2151a14f1f service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:16.117603 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-b17cae61-59d6-4abd-a218-011f9dbf117f req-3c388792-4240-45f4-b52f-bc2151a14f1f service nova] Creating event network-vif-deleted:b352d2eb-caa0-497b-9514-da6f7dd81bb0 for instance 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef on n-h1-854030-1 Aug 22 17:18:16.146247 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-b17cae61-59d6-4abd-a218-011f9dbf117f req-3c388792-4240-45f4-b52f-bc2151a14f1f service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074899 Aug 22 17:18:16.150867 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 719/1421] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:16.289343 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-17eec2ce-5681-47dd-9c5f-4c071d9600d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:16.304166 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-17eec2ce-5681-47dd-9c5f-4c071d9600d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1471 microversion: 2.1 time: 1.655849 Aug 22 17:18:16.305548 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 703/1422] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:14 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1471 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:17.109926 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7752c147-fad9-4074-9bd9-7da57f95d18c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:17.109926 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-7752c147-fad9-4074-9bd9-7da57f95d18c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:17.123215 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7752c147-fad9-4074-9bd9-7da57f95d18c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:17.123711 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7752c147-fad9-4074-9bd9-7da57f95d18c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:17.124845 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7752c147-fad9-4074-9bd9-7da57f95d18c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:17.126520 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7752c147-fad9-4074-9bd9-7da57f95d18c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:17.127231 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7752c147-fad9-4074-9bd9-7da57f95d18c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:17.128069 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7752c147-fad9-4074-9bd9-7da57f95d18c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:17.148956 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-7752c147-fad9-4074-9bd9-7da57f95d18c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] HTTP exception thrown: Instance 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef could not be found. Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7752c147-fad9-4074-9bd9-7da57f95d18c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Request method failure captured: Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef HTTP/1.1 Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7lgSm4FKTHXtIz1Gx3tknJOMgFMA7b9cAHDnITnAh8xWgKu_QooBsvcVa7rpSsMIJ6ZKXC66_UbsLY8HsWtLPA5uE9Pus_XRXBiWc4yypjcu3nCl--V0IVy0QYTFoToZbtM4oNXEEZt6kW8A07lFUNftp3OyGh5k6tT3dZfr8k0e20 Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: d789047469894e1fbe5af3a109a95b4c Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_d789047469894e1fbe5af3a109a95b4c", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: d789047469894e1fbe5af3a109a95b4c Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersOnMultiNodesTest-1888665690-project Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 43188026fda44118ad642b7065108966 Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersOnMultiNodesTest-1888665690-project Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef could not be found. Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef'} Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef could not be found. Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef could not be found. Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:17.151231 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:17.159590 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:17.159590 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:17.159590 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:17.159590 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:17.159590 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:17.159590 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef could not be found. Aug 22 17:18:17.159590 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:17.160276 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7752c147-fad9-4074-9bd9-7da57f95d18c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Returning 404 to user: Instance 92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:17.161530 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7752c147-fad9-4074-9bd9-7da57f95d18c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef" status: 404 len: 111 microversion: 2.1 time: 0.059256 Aug 22 17:18:17.178233 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 720/1423] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:17 2022] GET /compute/v2.1/servers/92d14ad9-48e5-4ec5-b2fa-ab8c41dc93ef => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:18:17.182414 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-992a14f2-8bd2-4fc7-a761-2f21566b8e39 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:17.183307 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-992a14f2-8bd2-4fc7-a761-2f21566b8e39 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: fdf44444-5aec-46a8-a23a-d9d6621684a6] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:17.209069 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-992a14f2-8bd2-4fc7-a761-2f21566b8e39 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:17.210024 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-992a14f2-8bd2-4fc7-a761-2f21566b8e39 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:17.210839 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-992a14f2-8bd2-4fc7-a761-2f21566b8e39 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:17.212433 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-992a14f2-8bd2-4fc7-a761-2f21566b8e39 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:17.213347 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-992a14f2-8bd2-4fc7-a761-2f21566b8e39 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:17.214263 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-992a14f2-8bd2-4fc7-a761-2f21566b8e39 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:17.308605 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-992a14f2-8bd2-4fc7-a761-2f21566b8e39 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: fdf44444-5aec-46a8-a23a-d9d6621684a6] Going to try to terminate instance {{(pid=123016) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:18:17.375243 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-359b9e33-0c4b-4017-ae72-63f47f79c7d2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:17.383695 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-359b9e33-0c4b-4017-ae72-63f47f79c7d2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:17.435321 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-359b9e33-0c4b-4017-ae72-63f47f79c7d2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:17.440258 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-359b9e33-0c4b-4017-ae72-63f47f79c7d2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:17.444231 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-359b9e33-0c4b-4017-ae72-63f47f79c7d2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:17.450924 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-359b9e33-0c4b-4017-ae72-63f47f79c7d2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:17.457643 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-359b9e33-0c4b-4017-ae72-63f47f79c7d2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:17.460593 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-359b9e33-0c4b-4017-ae72-63f47f79c7d2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:17.524070 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:17.951432 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-992a14f2-8bd2-4fc7-a761-2f21566b8e39 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "DELETE /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6" status: 204 len: 0 microversion: 2.1 time: 0.778299 Aug 22 17:18:17.954836 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 704/1424] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:18:17 2022] DELETE /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:18:18.386317 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fdd06f30-d04c-42dc-9856-da52cc0bf6b5 tempest-ServerRescueTestJSON-965561421 tempest-ServerRescueTestJSON-965561421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1704437153", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:18.464903 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-fdd06f30-d04c-42dc-9856-da52cc0bf6b5 tempest-ServerRescueTestJSON-965561421 tempest-ServerRescueTestJSON-965561421-project] validate_networks() for [('648758cd-e6d7-4987-b6da-14acdd9e24ea', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:18:18.545295 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=12 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-fdd06f30-d04c-42dc-9856-da52cc0bf6b5 tempest-ServerRescueTestJSON-965561421 tempest-ServerRescueTestJSON-965561421-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bbf98221-a022-4f12-8eec-a28503ee22aa) Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:18:18.703154 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bbf98221-a022-4f12-8eec-a28503ee22aa) Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-fdd06f30-d04c-42dc-9856-da52cc0bf6b5 tempest-ServerRescueTestJSON-965561421 tempest-ServerRescueTestJSON-965561421-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fdd06f30-d04c-42dc-9856-da52cc0bf6b5 tempest-ServerRescueTestJSON-965561421 tempest-ServerRescueTestJSON-965561421-project] Request method failure captured: Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 238 Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7pZvxd1V5-kTR29cQKqOyA2h4YkmY46Lc1oLdmC_aIP28di9lyYxUGjUbgkSC39Cj3KQD1uCpEk6QvufCG36cssKUbmKyBQ9SmIho8yEZl3XcYjrRcTO_n1U41yD9Sosc_tyioxjK4EXLnPrT_J3EWgb5wu2sX0EkoqszuaiCxhTt0 Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 6fe91d987ccf4a98929e46eb949ae4d0 Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServerRescueTestJSON-965561421 Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/6fe91d987ccf4a98929e46eb949ae4d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_6fe91d987ccf4a98929e46eb949ae4d0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/6fe91d987ccf4a98929e46eb949ae4d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/6fe91d987ccf4a98929e46eb949ae4d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServerRescueTestJSON-965561421 Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 6fe91d987ccf4a98929e46eb949ae4d0 Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServerRescueTestJSON-965561421 Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServerRescueTestJSON-965561421-project Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 81f945dae4db434c93d17e6f81489d42 Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServerRescueTestJSON-965561421-project Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-ServerRescueTestJSON-server-1704437153", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "T6!&zeU&HRnaZki", "networks": [{"uuid": "648758cd-e6d7-4987-b6da-14acdd9e24ea"}]}} Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-ServerRescueTestJSON-server-1704437153', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'adminPass': 'T6!&zeU&HRnaZki', 'networks': [{'uuid': '648758cd-e6d7-4987-b6da-14acdd9e24ea'}]}}} Aug 22 17:18:18.712980 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:18:18.723908 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bbf98221-a022-4f12-8eec-a28503ee22aa) Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fdd06f30-d04c-42dc-9856-da52cc0bf6b5 tempest-ServerRescueTestJSON-965561421 tempest-ServerRescueTestJSON-965561421-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-fdd06f30-d04c-42dc-9856-da52cc0bf6b5 tempest-ServerRescueTestJSON-965561421 tempest-ServerRescueTestJSON-965561421-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.752338 Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 705/1425] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:18:17 2022] POST /compute/v2.1/servers => generated 214 bytes in 754 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6baf9c89-85a0-46e3-81e0-5ea1d1eb65dd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-6baf9c89-85a0-46e3-81e0-5ea1d1eb65dd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:18.741329 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6baf9c89-85a0-46e3-81e0-5ea1d1eb65dd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:18.749169 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6baf9c89-85a0-46e3-81e0-5ea1d1eb65dd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:18.749169 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6baf9c89-85a0-46e3-81e0-5ea1d1eb65dd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:18.749169 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6baf9c89-85a0-46e3-81e0-5ea1d1eb65dd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:18.749169 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6baf9c89-85a0-46e3-81e0-5ea1d1eb65dd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:18.749169 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6baf9c89-85a0-46e3-81e0-5ea1d1eb65dd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:18.800243 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-6baf9c89-85a0-46e3-81e0-5ea1d1eb65dd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Going to try to terminate instance {{(pid=123016) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:18:19.022151 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-359b9e33-0c4b-4017-ae72-63f47f79c7d2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:19.038657 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-359b9e33-0c4b-4017-ae72-63f47f79c7d2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1471 microversion: 2.1 time: 1.698105 Aug 22 17:18:19.053118 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 721/1426] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:17 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1471 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:19.146508 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f37de013-9817-400a-b7cd-1efb5e7ac32c tempest-ListImageFiltersNegativeTestJSON-1505574831 tempest-ListImageFiltersNegativeTestJSON-1505574831-project] Calling method '.version_select at 0x7f8009372820>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:19.189490 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-f37de013-9817-400a-b7cd-1efb5e7ac32c tempest-ListImageFiltersNegativeTestJSON-1505574831 tempest-ListImageFiltersNegativeTestJSON-1505574831-project] HTTP exception thrown: Image not found. Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f37de013-9817-400a-b7cd-1efb5e7ac32c tempest-ListImageFiltersNegativeTestJSON-1505574831 tempest-ListImageFiltersNegativeTestJSON-1505574831-project] Request method failure captured: Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/images/d442fccf-64dd-46f4-96f5-a8b2f9d7d15b HTTP/1.1 Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7paWPHYWTLLIWtG6X_JTUdGhoEHzfssLpdoI_t3KtXf_ILt4uHZ5v5-nCTnwb-qXr18IK8FUWmvRYjMlCMFS-Bzf17kEL2z6nwbcMmYoOwMIliQHlthjQCBPnDZqy1YIP6zam4fr4fHf8a-ibFBL_A5EHMoCaJNjzc_jndXCeIs0dg Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 33446841ec194d228fb5005e7b6479ec Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1505574831 Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/33446841ec194d228fb5005e7b6479ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_33446841ec194d228fb5005e7b6479ec", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/33446841ec194d228fb5005e7b6479ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/33446841ec194d228fb5005e7b6479ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1505574831 Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 33446841ec194d228fb5005e7b6479ec Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1505574831 Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ListImageFiltersNegativeTestJSON-1505574831-project Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 7912d0e701574a2a8a319740ae318146 Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1505574831-project Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: exception: Image not found. Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'd442fccf-64dd-46f4-96f5-a8b2f9d7d15b'} Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d442fccf-64dd-46f4-96f5-a8b2f9d7d15b Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 22 17:18:19.191695 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d442fccf-64dd-46f4-96f5-a8b2f9d7d15b could not be found. Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f37de013-9817-400a-b7cd-1efb5e7ac32c tempest-ListImageFiltersNegativeTestJSON-1505574831 tempest-ListImageFiltersNegativeTestJSON-1505574831-project] Returning 404 to user: Image not found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f37de013-9817-400a-b7cd-1efb5e7ac32c tempest-ListImageFiltersNegativeTestJSON-1505574831 tempest-ListImageFiltersNegativeTestJSON-1505574831-project] 10.222.0.96 "GET /compute/v2.1/images/d442fccf-64dd-46f4-96f5-a8b2f9d7d15b" status: 404 len: 62 microversion: 2.1 time: 0.152024 Aug 22 17:18:19.199391 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 722/1427] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:18:19 2022] GET /compute/v2.1/images/d442fccf-64dd-46f4-96f5-a8b2f9d7d15b => generated 62 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:18:19.219826 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-6baf9c89-85a0-46e3-81e0-5ea1d1eb65dd tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "DELETE /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 204 len: 0 microversion: 2.1 time: 0.507982 Aug 22 17:18:19.221749 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 706/1428] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:18:18 2022] DELETE /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:18:19.239763 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e1762ba2-36b1-4a7e-9f8f-ec08177c71fc tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:19.240675 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-e1762ba2-36b1-4a7e-9f8f-ec08177c71fc tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: fdf44444-5aec-46a8-a23a-d9d6621684a6] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:19.736453 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e1762ba2-36b1-4a7e-9f8f-ec08177c71fc tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:19.737206 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e1762ba2-36b1-4a7e-9f8f-ec08177c71fc tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:19.739563 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e1762ba2-36b1-4a7e-9f8f-ec08177c71fc tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:19.743494 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e1762ba2-36b1-4a7e-9f8f-ec08177c71fc tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:19.743995 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e1762ba2-36b1-4a7e-9f8f-ec08177c71fc tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:19.744443 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e1762ba2-36b1-4a7e-9f8f-ec08177c71fc tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:20.069936 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1c3e9a10-94ca-419c-bcfe-c873c6accec0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:20.074898 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-1c3e9a10-94ca-419c-bcfe-c873c6accec0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:20.113611 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1c3e9a10-94ca-419c-bcfe-c873c6accec0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:20.115830 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1c3e9a10-94ca-419c-bcfe-c873c6accec0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:20.118749 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1c3e9a10-94ca-419c-bcfe-c873c6accec0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:20.124943 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1c3e9a10-94ca-419c-bcfe-c873c6accec0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:20.152796 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1c3e9a10-94ca-419c-bcfe-c873c6accec0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:20.154387 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1c3e9a10-94ca-419c-bcfe-c873c6accec0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:20.605048 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e1762ba2-36b1-4a7e-9f8f-ec08177c71fc tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:20.620737 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e1762ba2-36b1-4a7e-9f8f-ec08177c71fc tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6" status: 200 len: 1474 microversion: 2.1 time: 1.386342 Aug 22 17:18:20.621562 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 723/1429] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:19 2022] GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6 => generated 1474 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:20.907360 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ade37759-49b4-4dac-afa8-aac3e324b383 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Calling method '.version_select at 0x7f8009692af0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:21.307617 n-d-854030-1 devstack@n-api.service[123015]: DEBUG neutronclient.v2_0.client [None req-ade37759-49b4-4dac-afa8-aac3e324b383 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a9722f35-c677-48c8-a5d3-a318c5bbff91 does not exist", "detail": ""}} {{(pid=123015) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:18:21.308229 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.security_group_api [None req-ade37759-49b4-4dac-afa8-aac3e324b383 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Neutron security group a9722f35-c677-48c8-a5d3-a318c5bbff91 not found {{(pid=123015) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 22 17:18:21.308792 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-ade37759-49b4-4dac-afa8-aac3e324b383 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] HTTP exception thrown: Security group a9722f35-c677-48c8-a5d3-a318c5bbff91 does not exist Aug 22 17:18:21.308792 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-ea4f265a-c99d-43f5-b072-3cfdc26613d8'] Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ade37759-49b4-4dac-afa8-aac3e324b383 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Request method failure captured: Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/os-security-groups/a9722f35-c677-48c8-a5d3-a318c5bbff91 HTTP/1.1 Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7pciEfGmmnUYdXQxwW7XmXSGdcf6rvO0NV2oHS7SeuP9Rhtr-D47wRzgKJOX0O5wnlK_nLOn2TwYtgB8ZP0c3diinb_chTPohVDTuiF24-R7oR-zELeTYw4JsEd_ZilW5bN4-DEKXTIHqB5RiW9cZwaL_qH630SAY0rKcqRJH2UUek Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 85189e3df53e4be4b8280aee56c0c30d Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1083687109 Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/85189e3df53e4be4b8280aee56c0c30d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_85189e3df53e4be4b8280aee56c0c30d", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/85189e3df53e4be4b8280aee56c0c30d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/85189e3df53e4be4b8280aee56c0c30d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1083687109 Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 85189e3df53e4be4b8280aee56c0c30d Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1083687109 Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-SecurityGroupsNegativeTestJSON-1083687109-project Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 9cc37fe71700415bb2d26530f65d19fe Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1083687109-project Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: exception: Security group a9722f35-c677-48c8-a5d3-a318c5bbff91 does not exist Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-ea4f265a-c99d-43f5-b072-3cfdc26613d8'] Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'a9722f35-c677-48c8-a5d3-a318c5bbff91'} Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 22 17:18:21.312065 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a9722f35-c677-48c8-a5d3-a318c5bbff91 does not exist Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea4f265a-c99d-43f5-b072-3cfdc26613d8'] Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a9722f35-c677-48c8-a5d3-a318c5bbff91 does not exist Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea4f265a-c99d-43f5-b072-3cfdc26613d8'] Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a9722f35-c677-48c8-a5d3-a318c5bbff91 does not exist Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea4f265a-c99d-43f5-b072-3cfdc26613d8'] Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a9722f35-c677-48c8-a5d3-a318c5bbff91 does not exist Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea4f265a-c99d-43f5-b072-3cfdc26613d8'] Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ade37759-49b4-4dac-afa8-aac3e324b383 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Returning 404 to user: Security group a9722f35-c677-48c8-a5d3-a318c5bbff91 does not exist Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-ea4f265a-c99d-43f5-b072-3cfdc26613d8'] {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ade37759-49b4-4dac-afa8-aac3e324b383 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/a9722f35-c677-48c8-a5d3-a318c5bbff91" status: 404 len: 194 microversion: 2.1 time: 0.689425 Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 724/1430] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:18:20 2022] DELETE /compute/v2.1/os-security-groups/a9722f35-c677-48c8-a5d3-a318c5bbff91 => generated 194 bytes in 690 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3a8ac17c-47d0-482e-aea8-99918df010b4 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003911 Aug 22 17:18:21.333361 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 725/1431] 10.222.0.96 () {58 vars in 1164 bytes} [Mon Aug 22 17:18:21 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 22 17:18:21.349868 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b86b3fcf-61f0-48b1-9fe1-0b9f99178737 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Calling method '.version_select at 0x7f8009372ca0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:21.550873 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-1c3e9a10-94ca-419c-bcfe-c873c6accec0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:21.567322 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1c3e9a10-94ca-419c-bcfe-c873c6accec0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1471 microversion: 2.1 time: 1.508348 Aug 22 17:18:21.572442 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 707/1432] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:20 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1471 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:21.660790 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4db25329-9a23-4fd0-a2f7-c1089a3be76f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:21.662179 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-4db25329-9a23-4fd0-a2f7-c1089a3be76f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: fdf44444-5aec-46a8-a23a-d9d6621684a6] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:21.672274 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4db25329-9a23-4fd0-a2f7-c1089a3be76f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:21.672773 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4db25329-9a23-4fd0-a2f7-c1089a3be76f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:21.673284 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4db25329-9a23-4fd0-a2f7-c1089a3be76f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:21.680006 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4db25329-9a23-4fd0-a2f7-c1089a3be76f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:21.680285 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4db25329-9a23-4fd0-a2f7-c1089a3be76f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:21.680669 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4db25329-9a23-4fd0-a2f7-c1089a3be76f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:22.271031 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b86b3fcf-61f0-48b1-9fe1-0b9f99178737 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] 10.222.0.96 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.935792 Aug 22 17:18:22.271627 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 726/1433] 10.222.0.96 () {58 vars in 1158 bytes} [Mon Aug 22 17:18:21 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:22.291294 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c1940669-f464-4060-8e27-7809f2e8e859 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Calling method '.version_select at 0x7f80099f7af0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:22.508322 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-4db25329-9a23-4fd0-a2f7-c1089a3be76f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:22.523863 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4db25329-9a23-4fd0-a2f7-c1089a3be76f tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6" status: 200 len: 1474 microversion: 2.1 time: 0.860675 Aug 22 17:18:22.524567 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 708/1434] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:21 2022] GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6 => generated 1474 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:18:22.631571 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0d84ec3d-5b33-49ab-856c-c8556da9792c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:22.631571 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-0d84ec3d-5b33-49ab-856c-c8556da9792c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:22.652110 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d84ec3d-5b33-49ab-856c-c8556da9792c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:22.662150 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d84ec3d-5b33-49ab-856c-c8556da9792c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:22.662756 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d84ec3d-5b33-49ab-856c-c8556da9792c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:22.666061 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d84ec3d-5b33-49ab-856c-c8556da9792c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:22.666061 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d84ec3d-5b33-49ab-856c-c8556da9792c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:22.666061 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d84ec3d-5b33-49ab-856c-c8556da9792c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:23.274448 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-0d84ec3d-5b33-49ab-856c-c8556da9792c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:23.284270 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0d84ec3d-5b33-49ab-856c-c8556da9792c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1471 microversion: 2.1 time: 0.674643 Aug 22 17:18:23.286679 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 709/1435] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:22 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1471 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:18:23.291786 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-32c76405-fd0e-4e05-8904-c513b086936b req-f32c2e96-f619-4637-84d2-b320b33d13a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf44444-5aec-46a8-a23a-d9d6621684a6", "name": "network-vif-deleted", "tag": "2a775859-4ec3-400e-838a-c3566ff49e77"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:23.302883 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-32c76405-fd0e-4e05-8904-c513b086936b req-f32c2e96-f619-4637-84d2-b320b33d13a4 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:23.303709 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-32c76405-fd0e-4e05-8904-c513b086936b req-f32c2e96-f619-4637-84d2-b320b33d13a4 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:23.304334 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-32c76405-fd0e-4e05-8904-c513b086936b req-f32c2e96-f619-4637-84d2-b320b33d13a4 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:23.320207 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-32c76405-fd0e-4e05-8904-c513b086936b req-f32c2e96-f619-4637-84d2-b320b33d13a4 service nova] Creating event network-vif-deleted:2a775859-4ec3-400e-838a-c3566ff49e77 for instance fdf44444-5aec-46a8-a23a-d9d6621684a6 on n-h1-854030-1 Aug 22 17:18:23.328113 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-32c76405-fd0e-4e05-8904-c513b086936b req-f32c2e96-f619-4637-84d2-b320b33d13a4 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039831 Aug 22 17:18:23.330171 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 710/1436] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:23.555418 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-556cca2c-d36e-4eae-a5c9-2b52ec3004d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:23.556277 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-556cca2c-d36e-4eae-a5c9-2b52ec3004d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: fdf44444-5aec-46a8-a23a-d9d6621684a6] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:23.577607 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-556cca2c-d36e-4eae-a5c9-2b52ec3004d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:23.578127 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-556cca2c-d36e-4eae-a5c9-2b52ec3004d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:23.579641 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-556cca2c-d36e-4eae-a5c9-2b52ec3004d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:23.580618 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-556cca2c-d36e-4eae-a5c9-2b52ec3004d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:23.581539 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-556cca2c-d36e-4eae-a5c9-2b52ec3004d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:23.582154 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-556cca2c-d36e-4eae-a5c9-2b52ec3004d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:23.629713 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-556cca2c-d36e-4eae-a5c9-2b52ec3004d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:23.630716 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-556cca2c-d36e-4eae-a5c9-2b52ec3004d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:23.631336 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-556cca2c-d36e-4eae-a5c9-2b52ec3004d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:23.632176 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-556cca2c-d36e-4eae-a5c9-2b52ec3004d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lazy-loading 'fault' on Instance uuid fdf44444-5aec-46a8-a23a-d9d6621684a6 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:18:23.737603 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-556cca2c-d36e-4eae-a5c9-2b52ec3004d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:23.764646 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-556cca2c-d36e-4eae-a5c9-2b52ec3004d3 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6" status: 200 len: 1308 microversion: 2.1 time: 0.214251 Aug 22 17:18:23.783381 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 711/1437] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:23 2022] GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6 => generated 1308 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:18:23.809343 n-d-854030-1 devstack@n-api.service[123015]: DEBUG neutronclient.v2_0.client [None req-c1940669-f464-4060-8e27-7809f2e8e859 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=123015) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:18:23.811137 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-c1940669-f464-4060-8e27-7809f2e8e859 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 22 17:18:23.811137 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-532f7b53-3872-4b56-a097-e7816765205f'] Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c1940669-f464-4060-8e27-7809f2e8e859 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Request method failure captured: Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/os-security-groups/4577460b-efef-4347-9189-e08f9c4f1f28 HTTP/1.1 Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7pciEfGmmnUYdXQxwW7XmXSGdcf6rvO0NV2oHS7SeuP9Rhtr-D47wRzgKJOX0O5wnlK_nLOn2TwYtgB8ZP0c3diinb_chTPohVDTuiF24-R7oR-zELeTYw4JsEd_ZilW5bN4-DEKXTIHqB5RiW9cZwaL_qH630SAY0rKcqRJH2UUek Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 85189e3df53e4be4b8280aee56c0c30d Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1083687109 Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/85189e3df53e4be4b8280aee56c0c30d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_85189e3df53e4be4b8280aee56c0c30d", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/85189e3df53e4be4b8280aee56c0c30d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/85189e3df53e4be4b8280aee56c0c30d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1083687109 Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 85189e3df53e4be4b8280aee56c0c30d Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1083687109 Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-SecurityGroupsNegativeTestJSON-1083687109-project Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 9cc37fe71700415bb2d26530f65d19fe Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1083687109-project Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: exception: Insufficient rights for removing default security group. Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-532f7b53-3872-4b56-a097-e7816765205f'] Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '4577460b-efef-4347-9189-e08f9c4f1f28'} Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 22 17:18:23.813719 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-532f7b53-3872-4b56-a097-e7816765205f'] Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-532f7b53-3872-4b56-a097-e7816765205f'] Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-532f7b53-3872-4b56-a097-e7816765205f'] Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-532f7b53-3872-4b56-a097-e7816765205f'] Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c1940669-f464-4060-8e27-7809f2e8e859 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-532f7b53-3872-4b56-a097-e7816765205f'] {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:23.820533 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c1940669-f464-4060-8e27-7809f2e8e859 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/4577460b-efef-4347-9189-e08f9c4f1f28" status: 400 len: 182 microversion: 2.1 time: 1.533509 Aug 22 17:18:23.828249 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 727/1438] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:18:22 2022] DELETE /compute/v2.1/os-security-groups/4577460b-efef-4347-9189-e08f9c4f1f28 => generated 182 bytes in 1548 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:18:23.842187 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f90aa182-2cdf-4e48-ba5f-989ba22c7258 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Calling method '.version_select at 0x7f8009493040>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:23.910766 n-d-854030-1 devstack@n-api.service[123016]: DEBUG neutronclient.v2_0.client [None req-f90aa182-2cdf-4e48-ba5f-989ba22c7258 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cf50267c-0e35-4e8c-b086-9a27f9c4fab3 does not exist", "detail": ""}} {{(pid=123016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:18:23.910766 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.security_group_api [None req-f90aa182-2cdf-4e48-ba5f-989ba22c7258 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Neutron security group cf50267c-0e35-4e8c-b086-9a27f9c4fab3 not found {{(pid=123016) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 22 17:18:23.910766 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-f90aa182-2cdf-4e48-ba5f-989ba22c7258 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] HTTP exception thrown: Security group cf50267c-0e35-4e8c-b086-9a27f9c4fab3 does not exist Aug 22 17:18:23.910766 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-4b2b2386-05a2-47f2-9991-6adc225e99d4'] Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f90aa182-2cdf-4e48-ba5f-989ba22c7258 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Request method failure captured: Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-security-groups/cf50267c-0e35-4e8c-b086-9a27f9c4fab3 HTTP/1.1 Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7pciEfGmmnUYdXQxwW7XmXSGdcf6rvO0NV2oHS7SeuP9Rhtr-D47wRzgKJOX0O5wnlK_nLOn2TwYtgB8ZP0c3diinb_chTPohVDTuiF24-R7oR-zELeTYw4JsEd_ZilW5bN4-DEKXTIHqB5RiW9cZwaL_qH630SAY0rKcqRJH2UUek Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 85189e3df53e4be4b8280aee56c0c30d Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1083687109 Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/85189e3df53e4be4b8280aee56c0c30d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_85189e3df53e4be4b8280aee56c0c30d", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/85189e3df53e4be4b8280aee56c0c30d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/85189e3df53e4be4b8280aee56c0c30d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1083687109 Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 85189e3df53e4be4b8280aee56c0c30d Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1083687109 Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-SecurityGroupsNegativeTestJSON-1083687109-project Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 9cc37fe71700415bb2d26530f65d19fe Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1083687109-project Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: exception: Security group cf50267c-0e35-4e8c-b086-9a27f9c4fab3 does not exist Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-4b2b2386-05a2-47f2-9991-6adc225e99d4'] Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'cf50267c-0e35-4e8c-b086-9a27f9c4fab3'} Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 22 17:18:23.912794 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cf50267c-0e35-4e8c-b086-9a27f9c4fab3 does not exist Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b2b2386-05a2-47f2-9991-6adc225e99d4'] Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cf50267c-0e35-4e8c-b086-9a27f9c4fab3 does not exist Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b2b2386-05a2-47f2-9991-6adc225e99d4'] Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cf50267c-0e35-4e8c-b086-9a27f9c4fab3 does not exist Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b2b2386-05a2-47f2-9991-6adc225e99d4'] Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cf50267c-0e35-4e8c-b086-9a27f9c4fab3 does not exist Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b2b2386-05a2-47f2-9991-6adc225e99d4'] Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f90aa182-2cdf-4e48-ba5f-989ba22c7258 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Returning 404 to user: Security group cf50267c-0e35-4e8c-b086-9a27f9c4fab3 does not exist Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-4b2b2386-05a2-47f2-9991-6adc225e99d4'] {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f90aa182-2cdf-4e48-ba5f-989ba22c7258 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] 10.222.0.96 "GET /compute/v2.1/os-security-groups/cf50267c-0e35-4e8c-b086-9a27f9c4fab3" status: 404 len: 194 microversion: 2.1 time: 0.076161 Aug 22 17:18:23.918112 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 712/1439] 10.222.0.96 () {58 vars in 1269 bytes} [Mon Aug 22 17:18:23 2022] GET /compute/v2.1/os-security-groups/cf50267c-0e35-4e8c-b086-9a27f9c4fab3 => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:18:23.927556 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c17475d5-fe94-4be7-a785-54fcb538d787 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Action: 'update', calling method: .version_select at 0x7f8009372940>, body: {"security_group": {"name": "tempest-sg-716610966", "description": "tempest-description-1164418124"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:24.339040 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-dcb9c78c-2940-4de0-b9a6-98f5aa3bf44d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:24.340194 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-dcb9c78c-2940-4de0-b9a6-98f5aa3bf44d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:24.369518 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dcb9c78c-2940-4de0-b9a6-98f5aa3bf44d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:24.370207 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dcb9c78c-2940-4de0-b9a6-98f5aa3bf44d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:24.370772 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dcb9c78c-2940-4de0-b9a6-98f5aa3bf44d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:24.388907 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dcb9c78c-2940-4de0-b9a6-98f5aa3bf44d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:24.389024 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dcb9c78c-2940-4de0-b9a6-98f5aa3bf44d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:24.389656 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dcb9c78c-2940-4de0-b9a6-98f5aa3bf44d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:24.568974 n-d-854030-1 devstack@n-api.service[123015]: DEBUG neutronclient.v2_0.client [None req-c17475d5-fe94-4be7-a785-54fcb538d787 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cdaee413-1133-49ea-b202-16a79720a849 does not exist", "detail": ""}} {{(pid=123015) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:18:24.569857 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.security_group_api [None req-c17475d5-fe94-4be7-a785-54fcb538d787 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Neutron security group cdaee413-1133-49ea-b202-16a79720a849 not found {{(pid=123015) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 22 17:18:24.582827 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-c17475d5-fe94-4be7-a785-54fcb538d787 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] HTTP exception thrown: Security group cdaee413-1133-49ea-b202-16a79720a849 does not exist Aug 22 17:18:24.582827 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-bf4e96e9-66ed-4709-a0e5-5c432e0b4af4'] Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c17475d5-fe94-4be7-a785-54fcb538d787 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Request method failure captured: Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: request: PUT /compute/v2.1/os-security-groups/cdaee413-1133-49ea-b202-16a79720a849 HTTP/1.1 Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 101 Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7pciEfGmmnUYdXQxwW7XmXSGdcf6rvO0NV2oHS7SeuP9Rhtr-D47wRzgKJOX0O5wnlK_nLOn2TwYtgB8ZP0c3diinb_chTPohVDTuiF24-R7oR-zELeTYw4JsEd_ZilW5bN4-DEKXTIHqB5RiW9cZwaL_qH630SAY0rKcqRJH2UUek Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 85189e3df53e4be4b8280aee56c0c30d Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1083687109 Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/85189e3df53e4be4b8280aee56c0c30d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_85189e3df53e4be4b8280aee56c0c30d", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/85189e3df53e4be4b8280aee56c0c30d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/85189e3df53e4be4b8280aee56c0c30d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1083687109 Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 85189e3df53e4be4b8280aee56c0c30d Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1083687109 Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-SecurityGroupsNegativeTestJSON-1083687109-project Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 9cc37fe71700415bb2d26530f65d19fe Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1083687109-project Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: {"security_group": {"name": "tempest-sg-716610966", "description": "tempest-description-1164418124"}} Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: exception: Security group cdaee413-1133-49ea-b202-16a79720a849 does not exist Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-bf4e96e9-66ed-4709-a0e5-5c432e0b4af4'] Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'cdaee413-1133-49ea-b202-16a79720a849', 'body': {'security_group': {'name': 'tempest-sg-716610966', 'description': 'tempest-description-1164418124'}}} Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 22 17:18:24.585249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cdaee413-1133-49ea-b202-16a79720a849 does not exist Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf4e96e9-66ed-4709-a0e5-5c432e0b4af4'] Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cdaee413-1133-49ea-b202-16a79720a849 does not exist Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf4e96e9-66ed-4709-a0e5-5c432e0b4af4'] Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cdaee413-1133-49ea-b202-16a79720a849 does not exist Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf4e96e9-66ed-4709-a0e5-5c432e0b4af4'] Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cdaee413-1133-49ea-b202-16a79720a849 does not exist Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf4e96e9-66ed-4709-a0e5-5c432e0b4af4'] Aug 22 17:18:24.591038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:24.615728 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c17475d5-fe94-4be7-a785-54fcb538d787 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] Returning 404 to user: Security group cdaee413-1133-49ea-b202-16a79720a849 does not exist Aug 22 17:18:24.615728 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-bf4e96e9-66ed-4709-a0e5-5c432e0b4af4'] {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:24.624281 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c17475d5-fe94-4be7-a785-54fcb538d787 tempest-SecurityGroupsNegativeTestJSON-1083687109 tempest-SecurityGroupsNegativeTestJSON-1083687109-project] 10.222.0.96 "PUT /compute/v2.1/os-security-groups/cdaee413-1133-49ea-b202-16a79720a849" status: 404 len: 194 microversion: 2.1 time: 0.695679 Aug 22 17:18:24.624281 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 728/1440] 10.222.0.96 () {60 vars in 1290 bytes} [Mon Aug 22 17:18:23 2022] PUT /compute/v2.1/os-security-groups/cdaee413-1133-49ea-b202-16a79720a849 => generated 194 bytes in 697 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:18:24.804360 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a71cad17-b968-4991-bad2-c0bc711f5492 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:24.804928 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a71cad17-b968-4991-bad2-c0bc711f5492 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: fdf44444-5aec-46a8-a23a-d9d6621684a6] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:24.823224 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a71cad17-b968-4991-bad2-c0bc711f5492 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:24.823764 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a71cad17-b968-4991-bad2-c0bc711f5492 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:24.824079 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a71cad17-b968-4991-bad2-c0bc711f5492 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:24.824792 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a71cad17-b968-4991-bad2-c0bc711f5492 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:24.825283 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a71cad17-b968-4991-bad2-c0bc711f5492 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:24.825712 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a71cad17-b968-4991-bad2-c0bc711f5492 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:24.946936 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-a71cad17-b968-4991-bad2-c0bc711f5492 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] HTTP exception thrown: Instance fdf44444-5aec-46a8-a23a-d9d6621684a6 could not be found. Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a71cad17-b968-4991-bad2-c0bc711f5492 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Request method failure captured: Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6 HTTP/1.1 Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7lgSm4FKTHXtIz1Gx3tknJOMgFMA7b9cAHDnITnAh8xWgKu_QooBsvcVa7rpSsMIJ6ZKXC66_UbsLY8HsWtLPA5uE9Pus_XRXBiWc4yypjcu3nCl--V0IVy0QYTFoToZbtM4oNXEEZt6kW8A07lFUNftp3OyGh5k6tT3dZfr8k0e20 Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: d789047469894e1fbe5af3a109a95b4c Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_d789047469894e1fbe5af3a109a95b4c", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: d789047469894e1fbe5af3a109a95b4c Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersOnMultiNodesTest-1888665690-project Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 43188026fda44118ad642b7065108966 Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersOnMultiNodesTest-1888665690-project Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance fdf44444-5aec-46a8-a23a-d9d6621684a6 could not be found. Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'fdf44444-5aec-46a8-a23a-d9d6621684a6'} Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdf44444-5aec-46a8-a23a-d9d6621684a6 could not be found. Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdf44444-5aec-46a8-a23a-d9d6621684a6 could not be found. Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:24.948699 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:24.957744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:24.957744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:24.957744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:24.957744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:24.957744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:24.957744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdf44444-5aec-46a8-a23a-d9d6621684a6 could not be found. Aug 22 17:18:24.957744 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:24.957744 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a71cad17-b968-4991-bad2-c0bc711f5492 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Returning 404 to user: Instance fdf44444-5aec-46a8-a23a-d9d6621684a6 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:24.960754 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a71cad17-b968-4991-bad2-c0bc711f5492 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6" status: 404 len: 111 microversion: 2.1 time: 0.160407 Aug 22 17:18:24.964721 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 729/1441] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:24 2022] GET /compute/v2.1/servers/fdf44444-5aec-46a8-a23a-d9d6621684a6 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:18:24.973009 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ef0f262c-d0f8-45d1-b6d7-a466de437065 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:24.981631 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ef0f262c-d0f8-45d1-b6d7-a466de437065 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:24.997791 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ef0f262c-d0f8-45d1-b6d7-a466de437065 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:24.997791 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ef0f262c-d0f8-45d1-b6d7-a466de437065 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:25.001636 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ef0f262c-d0f8-45d1-b6d7-a466de437065 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:25.001914 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ef0f262c-d0f8-45d1-b6d7-a466de437065 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:25.006826 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ef0f262c-d0f8-45d1-b6d7-a466de437065 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:25.007631 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ef0f262c-d0f8-45d1-b6d7-a466de437065 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:25.104065 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-dcb9c78c-2940-4de0-b9a6-98f5aa3bf44d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:25.121895 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ef0f262c-d0f8-45d1-b6d7-a466de437065 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:25.125954 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ef0f262c-d0f8-45d1-b6d7-a466de437065 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:25.127903 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ef0f262c-d0f8-45d1-b6d7-a466de437065 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:25.131724 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-ef0f262c-d0f8-45d1-b6d7-a466de437065 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lazy-loading 'fault' on Instance uuid dfd453f5-ed66-49c4-8877-f48c09aff5a9 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:18:25.138784 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-dcb9c78c-2940-4de0-b9a6-98f5aa3bf44d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1471 microversion: 2.1 time: 0.810519 Aug 22 17:18:25.139867 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 713/1442] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:24 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1471 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:25.366936 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ef0f262c-d0f8-45d1-b6d7-a466de437065 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:25.376548 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ef0f262c-d0f8-45d1-b6d7-a466de437065 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 200 len: 1308 microversion: 2.1 time: 0.410618 Aug 22 17:18:25.385940 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-b6bca2bf-0b10-4732-bb04-f5c78fc26d7d req-8fba7c36-72f7-4ad0-8cfa-3857ef70a8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd453f5-ed66-49c4-8877-f48c09aff5a9", "name": "network-vif-deleted", "tag": "005ecac8-82fc-4593-a587-67d69aab6761"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:25.386152 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 730/1443] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:24 2022] GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 1308 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:25.456760 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-b6bca2bf-0b10-4732-bb04-f5c78fc26d7d req-8fba7c36-72f7-4ad0-8cfa-3857ef70a8f2 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:25.457484 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-b6bca2bf-0b10-4732-bb04-f5c78fc26d7d req-8fba7c36-72f7-4ad0-8cfa-3857ef70a8f2 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:25.458563 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-b6bca2bf-0b10-4732-bb04-f5c78fc26d7d req-8fba7c36-72f7-4ad0-8cfa-3857ef70a8f2 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:25.504797 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-b6bca2bf-0b10-4732-bb04-f5c78fc26d7d req-8fba7c36-72f7-4ad0-8cfa-3857ef70a8f2 service nova] Creating event network-vif-deleted:005ecac8-82fc-4593-a587-67d69aab6761 for instance dfd453f5-ed66-49c4-8877-f48c09aff5a9 on n-h2-854030-1 Aug 22 17:18:25.516966 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-b6bca2bf-0b10-4732-bb04-f5c78fc26d7d req-8fba7c36-72f7-4ad0-8cfa-3857ef70a8f2 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142680 Aug 22 17:18:25.519864 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 714/1444] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:26.081894 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c48e8c33-ed71-4d9b-ac5f-a093ab04a876 tempest-AZV2TestJSON-797776380 tempest-AZV2TestJSON-797776380-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:26.084063 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c48e8c33-ed71-4d9b-ac5f-a093ab04a876 tempest-AZV2TestJSON-797776380 tempest-AZV2TestJSON-797776380-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:26.084688 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c48e8c33-ed71-4d9b-ac5f-a093ab04a876 tempest-AZV2TestJSON-797776380 tempest-AZV2TestJSON-797776380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:26.085280 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c48e8c33-ed71-4d9b-ac5f-a093ab04a876 tempest-AZV2TestJSON-797776380 tempest-AZV2TestJSON-797776380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:26.086125 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c48e8c33-ed71-4d9b-ac5f-a093ab04a876 tempest-AZV2TestJSON-797776380 tempest-AZV2TestJSON-797776380-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:26.086878 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c48e8c33-ed71-4d9b-ac5f-a093ab04a876 tempest-AZV2TestJSON-797776380 tempest-AZV2TestJSON-797776380-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:26.091281 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c48e8c33-ed71-4d9b-ac5f-a093ab04a876 tempest-AZV2TestJSON-797776380 tempest-AZV2TestJSON-797776380-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:26.156985 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c48e8c33-ed71-4d9b-ac5f-a093ab04a876 tempest-AZV2TestJSON-797776380 tempest-AZV2TestJSON-797776380-project] 10.222.0.96 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.389158 Aug 22 17:18:26.166131 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 731/1445] 10.222.0.96 () {58 vars in 1164 bytes} [Mon Aug 22 17:18:25 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:18:26.169858 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f6c17577-96ce-4e8b-bef8-186e69758a56 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:26.170827 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-f6c17577-96ce-4e8b-bef8-186e69758a56 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:26.215916 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6c17577-96ce-4e8b-bef8-186e69758a56 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:26.223392 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6c17577-96ce-4e8b-bef8-186e69758a56 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:26.229616 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6c17577-96ce-4e8b-bef8-186e69758a56 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:26.233398 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6c17577-96ce-4e8b-bef8-186e69758a56 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:26.236249 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6c17577-96ce-4e8b-bef8-186e69758a56 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:26.238122 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6c17577-96ce-4e8b-bef8-186e69758a56 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:26.420723 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-dcd81afe-6f50-4fc9-99e5-d9768b62f77a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:26.421471 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-dcd81afe-6f50-4fc9-99e5-d9768b62f77a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: dfd453f5-ed66-49c4-8877-f48c09aff5a9] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:26.432573 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dcd81afe-6f50-4fc9-99e5-d9768b62f77a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:26.433099 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dcd81afe-6f50-4fc9-99e5-d9768b62f77a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:26.435812 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dcd81afe-6f50-4fc9-99e5-d9768b62f77a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:26.436630 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dcd81afe-6f50-4fc9-99e5-d9768b62f77a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:26.437152 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dcd81afe-6f50-4fc9-99e5-d9768b62f77a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:26.456713 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dcd81afe-6f50-4fc9-99e5-d9768b62f77a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:26.504044 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-dcd81afe-6f50-4fc9-99e5-d9768b62f77a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] HTTP exception thrown: Instance dfd453f5-ed66-49c4-8877-f48c09aff5a9 could not be found. Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-dcd81afe-6f50-4fc9-99e5-d9768b62f77a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Request method failure captured: Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 HTTP/1.1 Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7lgSm4FKTHXtIz1Gx3tknJOMgFMA7b9cAHDnITnAh8xWgKu_QooBsvcVa7rpSsMIJ6ZKXC66_UbsLY8HsWtLPA5uE9Pus_XRXBiWc4yypjcu3nCl--V0IVy0QYTFoToZbtM4oNXEEZt6kW8A07lFUNftp3OyGh5k6tT3dZfr8k0e20 Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: d789047469894e1fbe5af3a109a95b4c Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_d789047469894e1fbe5af3a109a95b4c", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: d789047469894e1fbe5af3a109a95b4c Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersOnMultiNodesTest-1888665690-project Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 43188026fda44118ad642b7065108966 Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersOnMultiNodesTest-1888665690-project Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance dfd453f5-ed66-49c4-8877-f48c09aff5a9 could not be found. Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'dfd453f5-ed66-49c4-8877-f48c09aff5a9'} Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd453f5-ed66-49c4-8877-f48c09aff5a9 could not be found. Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd453f5-ed66-49c4-8877-f48c09aff5a9 could not be found. Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:26.508832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:26.519921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:26.519921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:26.519921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:26.519921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:26.519921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:26.519921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd453f5-ed66-49c4-8877-f48c09aff5a9 could not be found. Aug 22 17:18:26.519921 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:26.522910 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-dcd81afe-6f50-4fc9-99e5-d9768b62f77a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Returning 404 to user: Instance dfd453f5-ed66-49c4-8877-f48c09aff5a9 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:26.524928 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-dcd81afe-6f50-4fc9-99e5-d9768b62f77a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9" status: 404 len: 111 microversion: 2.1 time: 0.110017 Aug 22 17:18:26.529412 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 732/1446] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:26 2022] GET /compute/v2.1/servers/dfd453f5-ed66-49c4-8877-f48c09aff5a9 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:18:26.537632 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5f950548-0aad-4d84-bc12-513660b7d8a9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:26.690871 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5f950548-0aad-4d84-bc12-513660b7d8a9 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "DELETE /compute/v2.1/os-server-groups/22e6357f-c720-4967-967a-94f0a2aafff8" status: 204 len: 0 microversion: 2.1 time: 0.158633 Aug 22 17:18:26.691464 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 733/1447] 10.222.0.96 () {58 vars in 1266 bytes} [Mon Aug 22 17:18:26 2022] DELETE /compute/v2.1/os-server-groups/22e6357f-c720-4967-967a-94f0a2aafff8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:18:26.700208 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0b54c069-c3d2-4e56-ab7d-980c3cf4387b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:26.700976 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0b54c069-c3d2-4e56-ab7d-980c3cf4387b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 1637eb7d-9aaf-4222-8c72-451f8599172f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:26.724768 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b54c069-c3d2-4e56-ab7d-980c3cf4387b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:26.739106 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b54c069-c3d2-4e56-ab7d-980c3cf4387b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:26.739106 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b54c069-c3d2-4e56-ab7d-980c3cf4387b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:26.739780 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b54c069-c3d2-4e56-ab7d-980c3cf4387b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:26.740009 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b54c069-c3d2-4e56-ab7d-980c3cf4387b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:26.740448 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b54c069-c3d2-4e56-ab7d-980c3cf4387b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:26.792994 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0b54c069-c3d2-4e56-ab7d-980c3cf4387b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 1637eb7d-9aaf-4222-8c72-451f8599172f] Going to try to terminate instance {{(pid=123015) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:18:27.019570 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-f6c17577-96ce-4e8b-bef8-186e69758a56 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:27.035205 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f6c17577-96ce-4e8b-bef8-186e69758a56 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1471 microversion: 2.1 time: 0.875250 Aug 22 17:18:27.052966 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 715/1448] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:26 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1471 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:27.199829 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0b54c069-c3d2-4e56-ab7d-980c3cf4387b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "DELETE /compute/v2.1/servers/1637eb7d-9aaf-4222-8c72-451f8599172f" status: 204 len: 0 microversion: 2.1 time: 0.502364 Aug 22 17:18:27.201031 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 734/1449] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:18:26 2022] DELETE /compute/v2.1/servers/1637eb7d-9aaf-4222-8c72-451f8599172f => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:18:27.210445 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-73336973-8b93-4b3d-a265-3764b81cfcab tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:27.210933 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-73336973-8b93-4b3d-a265-3764b81cfcab tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:27.222501 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-73336973-8b93-4b3d-a265-3764b81cfcab tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:27.223031 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-73336973-8b93-4b3d-a265-3764b81cfcab tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:27.223453 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-73336973-8b93-4b3d-a265-3764b81cfcab tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:27.225577 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-73336973-8b93-4b3d-a265-3764b81cfcab tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:27.230359 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-73336973-8b93-4b3d-a265-3764b81cfcab tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:27.231490 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-73336973-8b93-4b3d-a265-3764b81cfcab tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:27.293711 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-73336973-8b93-4b3d-a265-3764b81cfcab tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Going to try to terminate instance {{(pid=123016) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:18:27.775484 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-73336973-8b93-4b3d-a265-3764b81cfcab tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "DELETE /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 204 len: 0 microversion: 2.1 time: 0.568331 Aug 22 17:18:27.779119 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 716/1450] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:18:27 2022] DELETE /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:18:27.788859 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4d95e753-5b5a-4ef1-b498-4ec42346777b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:27.790023 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-4d95e753-5b5a-4ef1-b498-4ec42346777b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 1637eb7d-9aaf-4222-8c72-451f8599172f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:27.839231 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4d95e753-5b5a-4ef1-b498-4ec42346777b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:27.842752 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4d95e753-5b5a-4ef1-b498-4ec42346777b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:27.843549 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4d95e753-5b5a-4ef1-b498-4ec42346777b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:27.847242 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4d95e753-5b5a-4ef1-b498-4ec42346777b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:27.848042 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4d95e753-5b5a-4ef1-b498-4ec42346777b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:27.851679 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4d95e753-5b5a-4ef1-b498-4ec42346777b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:28.081775 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7534f06d-e946-4436-a44e-facc38eb4216 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:28.092364 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-7534f06d-e946-4436-a44e-facc38eb4216 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:28.167789 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7534f06d-e946-4436-a44e-facc38eb4216 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:28.168506 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7534f06d-e946-4436-a44e-facc38eb4216 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:28.169455 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7534f06d-e946-4436-a44e-facc38eb4216 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:28.170673 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7534f06d-e946-4436-a44e-facc38eb4216 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:28.171239 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7534f06d-e946-4436-a44e-facc38eb4216 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:28.171791 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7534f06d-e946-4436-a44e-facc38eb4216 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:28.667387 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-4d95e753-5b5a-4ef1-b498-4ec42346777b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:28.693709 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-4d95e753-5b5a-4ef1-b498-4ec42346777b tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/1637eb7d-9aaf-4222-8c72-451f8599172f" status: 200 len: 1474 microversion: 2.1 time: 0.912311 Aug 22 17:18:28.717438 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 735/1451] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:27 2022] GET /compute/v2.1/servers/1637eb7d-9aaf-4222-8c72-451f8599172f => generated 1474 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:28.946934 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-7534f06d-e946-4436-a44e-facc38eb4216 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:28.960170 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:28.966519 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7534f06d-e946-4436-a44e-facc38eb4216 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1471 microversion: 2.1 time: 0.907795 Aug 22 17:18:28.970178 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 717/1452] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:28 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1471 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:29.761403 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-acf50d2e-bd53-474e-ae11-25feac515a1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:29.774810 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-acf50d2e-bd53-474e-ae11-25feac515a1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 1637eb7d-9aaf-4222-8c72-451f8599172f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:29.820524 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-acf50d2e-bd53-474e-ae11-25feac515a1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:29.822363 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-acf50d2e-bd53-474e-ae11-25feac515a1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:29.826047 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-acf50d2e-bd53-474e-ae11-25feac515a1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:29.830985 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-acf50d2e-bd53-474e-ae11-25feac515a1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:29.836870 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-acf50d2e-bd53-474e-ae11-25feac515a1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:29.847018 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-acf50d2e-bd53-474e-ae11-25feac515a1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:30.004301 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-eab531db-3f5a-4537-99c2-64c72541085d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:30.017001 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-eab531db-3f5a-4537-99c2-64c72541085d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:30.045974 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eab531db-3f5a-4537-99c2-64c72541085d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:30.048288 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eab531db-3f5a-4537-99c2-64c72541085d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:30.050939 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eab531db-3f5a-4537-99c2-64c72541085d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:30.052172 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eab531db-3f5a-4537-99c2-64c72541085d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:30.053609 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eab531db-3f5a-4537-99c2-64c72541085d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:30.055246 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-eab531db-3f5a-4537-99c2-64c72541085d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:30.706636 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-acf50d2e-bd53-474e-ae11-25feac515a1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:30.721190 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-acf50d2e-bd53-474e-ae11-25feac515a1a tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/1637eb7d-9aaf-4222-8c72-451f8599172f" status: 200 len: 1474 microversion: 2.1 time: 0.975015 Aug 22 17:18:30.726403 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 736/1453] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:29 2022] GET /compute/v2.1/servers/1637eb7d-9aaf-4222-8c72-451f8599172f => generated 1474 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:18:31.438248 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-eab531db-3f5a-4537-99c2-64c72541085d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:31.449792 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-eab531db-3f5a-4537-99c2-64c72541085d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1471 microversion: 2.1 time: 1.455907 Aug 22 17:18:31.456710 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 718/1454] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:29 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1471 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:31.783416 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f5fa21e4-a1b7-46e4-846f-5a26986bfb6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:31.784375 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f5fa21e4-a1b7-46e4-846f-5a26986bfb6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 1637eb7d-9aaf-4222-8c72-451f8599172f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:31.809039 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f5fa21e4-a1b7-46e4-846f-5a26986bfb6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:31.809039 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f5fa21e4-a1b7-46e4-846f-5a26986bfb6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:31.809039 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f5fa21e4-a1b7-46e4-846f-5a26986bfb6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:31.811403 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f5fa21e4-a1b7-46e4-846f-5a26986bfb6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:31.812914 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f5fa21e4-a1b7-46e4-846f-5a26986bfb6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:31.828120 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f5fa21e4-a1b7-46e4-846f-5a26986bfb6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:32.481638 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c5d891a4-ccaf-4790-9cb8-0641751f05b8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:32.482538 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c5d891a4-ccaf-4790-9cb8-0641751f05b8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:32.497008 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c5d891a4-ccaf-4790-9cb8-0641751f05b8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:32.497549 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c5d891a4-ccaf-4790-9cb8-0641751f05b8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:32.498016 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c5d891a4-ccaf-4790-9cb8-0641751f05b8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:32.498764 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c5d891a4-ccaf-4790-9cb8-0641751f05b8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:32.505541 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c5d891a4-ccaf-4790-9cb8-0641751f05b8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:32.510538 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c5d891a4-ccaf-4790-9cb8-0641751f05b8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:32.855383 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f5fa21e4-a1b7-46e4-846f-5a26986bfb6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:32.873617 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f5fa21e4-a1b7-46e4-846f-5a26986bfb6d tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/1637eb7d-9aaf-4222-8c72-451f8599172f" status: 200 len: 1474 microversion: 2.1 time: 1.100249 Aug 22 17:18:32.874604 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 737/1455] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:31 2022] GET /compute/v2.1/servers/1637eb7d-9aaf-4222-8c72-451f8599172f => generated 1474 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:33.483809 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c5d891a4-ccaf-4790-9cb8-0641751f05b8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:33.502980 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c5d891a4-ccaf-4790-9cb8-0641751f05b8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1489 microversion: 2.1 time: 1.021856 Aug 22 17:18:33.503720 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 719/1456] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:32 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1489 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:33.736966 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-b29017d9-40f1-41e9-a9f7-d0bf53328b99 req-bbad9f88-8729-4821-88c4-c539415b12d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f63d0c5a-060f-4524-93eb-78c4950d8848", "name": "network-vif-deleted", "tag": "b6ddfbbd-fd37-44fd-a8a3-f657b0f59e28"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:33.761520 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-b29017d9-40f1-41e9-a9f7-d0bf53328b99 req-bbad9f88-8729-4821-88c4-c539415b12d1 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:33.762209 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-b29017d9-40f1-41e9-a9f7-d0bf53328b99 req-bbad9f88-8729-4821-88c4-c539415b12d1 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:33.765776 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-b29017d9-40f1-41e9-a9f7-d0bf53328b99 req-bbad9f88-8729-4821-88c4-c539415b12d1 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:33.801230 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-b29017d9-40f1-41e9-a9f7-d0bf53328b99 req-bbad9f88-8729-4821-88c4-c539415b12d1 service nova] Creating event network-vif-deleted:b6ddfbbd-fd37-44fd-a8a3-f657b0f59e28 for instance f63d0c5a-060f-4524-93eb-78c4950d8848 on n-h1-854030-1 Aug 22 17:18:33.833767 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-b29017d9-40f1-41e9-a9f7-d0bf53328b99 req-bbad9f88-8729-4821-88c4-c539415b12d1 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099411 Aug 22 17:18:33.836147 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 738/1457] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:33.908145 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-83665bd9-f196-4c9f-8eaa-d4dc326d00e8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:33.908867 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-83665bd9-f196-4c9f-8eaa-d4dc326d00e8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 1637eb7d-9aaf-4222-8c72-451f8599172f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:33.934696 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83665bd9-f196-4c9f-8eaa-d4dc326d00e8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:33.935905 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83665bd9-f196-4c9f-8eaa-d4dc326d00e8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:33.936535 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83665bd9-f196-4c9f-8eaa-d4dc326d00e8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:33.938111 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83665bd9-f196-4c9f-8eaa-d4dc326d00e8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:33.938771 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83665bd9-f196-4c9f-8eaa-d4dc326d00e8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:33.940846 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83665bd9-f196-4c9f-8eaa-d4dc326d00e8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:34.550748 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8dc33bb5-33c8-479b-b7b3-b06d63407d5b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:34.553709 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8dc33bb5-33c8-479b-b7b3-b06d63407d5b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:34.580914 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8dc33bb5-33c8-479b-b7b3-b06d63407d5b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:34.588253 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8dc33bb5-33c8-479b-b7b3-b06d63407d5b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:34.593023 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8dc33bb5-33c8-479b-b7b3-b06d63407d5b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:34.595823 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8dc33bb5-33c8-479b-b7b3-b06d63407d5b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:34.597932 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8dc33bb5-33c8-479b-b7b3-b06d63407d5b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:34.599348 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8dc33bb5-33c8-479b-b7b3-b06d63407d5b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:35.163630 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8dc33bb5-33c8-479b-b7b3-b06d63407d5b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:35.185253 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8dc33bb5-33c8-479b-b7b3-b06d63407d5b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1477 microversion: 2.1 time: 0.634893 Aug 22 17:18:35.185253 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 739/1458] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:34 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1477 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:35.597693 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-83665bd9-f196-4c9f-8eaa-d4dc326d00e8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:35.616386 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-83665bd9-f196-4c9f-8eaa-d4dc326d00e8 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/1637eb7d-9aaf-4222-8c72-451f8599172f" status: 200 len: 1474 microversion: 2.1 time: 1.717901 Aug 22 17:18:35.625521 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-c0f95e46-86f4-494b-8003-fefdb13e82d0 req-30269419-1474-43a1-89dc-fd2cc28bf803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1637eb7d-9aaf-4222-8c72-451f8599172f", "name": "network-vif-deleted", "tag": "4c523d3d-ae85-4cfa-be7b-a786a656afa2"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:35.626374 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 720/1459] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:33 2022] GET /compute/v2.1/servers/1637eb7d-9aaf-4222-8c72-451f8599172f => generated 1474 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:18:35.663572 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-c0f95e46-86f4-494b-8003-fefdb13e82d0 req-30269419-1474-43a1-89dc-fd2cc28bf803 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:35.666092 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-c0f95e46-86f4-494b-8003-fefdb13e82d0 req-30269419-1474-43a1-89dc-fd2cc28bf803 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:35.668345 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-c0f95e46-86f4-494b-8003-fefdb13e82d0 req-30269419-1474-43a1-89dc-fd2cc28bf803 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:35.736088 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-c0f95e46-86f4-494b-8003-fefdb13e82d0 req-30269419-1474-43a1-89dc-fd2cc28bf803 service nova] Creating event network-vif-deleted:4c523d3d-ae85-4cfa-be7b-a786a656afa2 for instance 1637eb7d-9aaf-4222-8c72-451f8599172f on n-h1-854030-1 Aug 22 17:18:35.755556 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-c0f95e46-86f4-494b-8003-fefdb13e82d0 req-30269419-1474-43a1-89dc-fd2cc28bf803 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137732 Aug 22 17:18:35.760861 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 740/1460] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:36.150501 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8e8420c4-a19e-47f5-83e0-fc4d0056cafa tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Action: 'create', calling method: .version_select at 0x7f80097754c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1157183288", "description": "tempest-description-384898821"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:36.196985 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:36.202814 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7e86e26b-e697-45e0-a235-14565c25acb2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:36.204872 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-7e86e26b-e697-45e0-a235-14565c25acb2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:36.217725 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7e86e26b-e697-45e0-a235-14565c25acb2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:36.218231 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7e86e26b-e697-45e0-a235-14565c25acb2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:36.218775 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7e86e26b-e697-45e0-a235-14565c25acb2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:36.228085 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7e86e26b-e697-45e0-a235-14565c25acb2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:36.228594 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7e86e26b-e697-45e0-a235-14565c25acb2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:36.229952 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7e86e26b-e697-45e0-a235-14565c25acb2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:37.186180 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8e8420c4-a19e-47f5-83e0-fc4d0056cafa tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.350606 Aug 22 17:18:37.187248 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 721/1461] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:18:35 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:37.194864 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-cb72e703-71f8-40dd-9744-b1f0ae279bfe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:37.196148 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-cb72e703-71f8-40dd-9744-b1f0ae279bfe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: 1637eb7d-9aaf-4222-8c72-451f8599172f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:37.208508 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb72e703-71f8-40dd-9744-b1f0ae279bfe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:37.212453 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb72e703-71f8-40dd-9744-b1f0ae279bfe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:37.213305 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb72e703-71f8-40dd-9744-b1f0ae279bfe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:37.214660 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb72e703-71f8-40dd-9744-b1f0ae279bfe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:37.215305 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb72e703-71f8-40dd-9744-b1f0ae279bfe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:37.216675 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cb72e703-71f8-40dd-9744-b1f0ae279bfe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:37.258188 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-cb72e703-71f8-40dd-9744-b1f0ae279bfe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] HTTP exception thrown: Instance 1637eb7d-9aaf-4222-8c72-451f8599172f could not be found. Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-cb72e703-71f8-40dd-9744-b1f0ae279bfe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Request method failure captured: Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/1637eb7d-9aaf-4222-8c72-451f8599172f HTTP/1.1 Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7lgSm4FKTHXtIz1Gx3tknJOMgFMA7b9cAHDnITnAh8xWgKu_QooBsvcVa7rpSsMIJ6ZKXC66_UbsLY8HsWtLPA5uE9Pus_XRXBiWc4yypjcu3nCl--V0IVy0QYTFoToZbtM4oNXEEZt6kW8A07lFUNftp3OyGh5k6tT3dZfr8k0e20 Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: d789047469894e1fbe5af3a109a95b4c Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_d789047469894e1fbe5af3a109a95b4c", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: d789047469894e1fbe5af3a109a95b4c Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServersOnMultiNodesTest-1888665690-project Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 43188026fda44118ad642b7065108966 Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServersOnMultiNodesTest-1888665690-project Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance 1637eb7d-9aaf-4222-8c72-451f8599172f could not be found. Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '1637eb7d-9aaf-4222-8c72-451f8599172f'} Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1637eb7d-9aaf-4222-8c72-451f8599172f could not be found. Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1637eb7d-9aaf-4222-8c72-451f8599172f could not be found. Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:37.265761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:37.275815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:37.275815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:37.275815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:37.275815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:37.275815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:37.275815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1637eb7d-9aaf-4222-8c72-451f8599172f could not be found. Aug 22 17:18:37.275815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:37.275815 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-cb72e703-71f8-40dd-9744-b1f0ae279bfe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Returning 404 to user: Instance 1637eb7d-9aaf-4222-8c72-451f8599172f could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:37.275815 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-cb72e703-71f8-40dd-9744-b1f0ae279bfe tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/1637eb7d-9aaf-4222-8c72-451f8599172f" status: 404 len: 111 microversion: 2.1 time: 0.079070 Aug 22 17:18:37.275815 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 722/1462] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:37 2022] GET /compute/v2.1/servers/1637eb7d-9aaf-4222-8c72-451f8599172f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:18:37.287984 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ce18da0f-1022-422f-9b33-16ec95a5d932 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Action: 'create', calling method: .version_select at 0x7f80096f4d30>, body: {"security_group_rule": {"parent_group_id": "e0d4e1c8-1268-400f-b8b5-33506b47f25f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:38.007836 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-7e86e26b-e697-45e0-a235-14565c25acb2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:38.026812 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7e86e26b-e697-45e0-a235-14565c25acb2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1477 microversion: 2.1 time: 1.830135 Aug 22 17:18:38.027863 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 741/1463] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:36 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1477 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:18:38.051487 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ffe65213-7767-42a8-9800-1f04fea0e603 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:38.052732 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ffe65213-7767-42a8-9800-1f04fea0e603 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: f63d0c5a-060f-4524-93eb-78c4950d8848] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:38.080173 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ffe65213-7767-42a8-9800-1f04fea0e603 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:38.080856 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ffe65213-7767-42a8-9800-1f04fea0e603 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:38.081335 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ffe65213-7767-42a8-9800-1f04fea0e603 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:38.082584 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ffe65213-7767-42a8-9800-1f04fea0e603 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:38.083543 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ffe65213-7767-42a8-9800-1f04fea0e603 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:38.084367 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ffe65213-7767-42a8-9800-1f04fea0e603 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:38.103882 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-ffe65213-7767-42a8-9800-1f04fea0e603 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] HTTP exception thrown: Instance f63d0c5a-060f-4524-93eb-78c4950d8848 could not be found. Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ffe65213-7767-42a8-9800-1f04fea0e603 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Request method failure captured: Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 HTTP/1.1 Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7lgSm4FKTHXtIz1Gx3tknJOMgFMA7b9cAHDnITnAh8xWgKu_QooBsvcVa7rpSsMIJ6ZKXC66_UbsLY8HsWtLPA5uE9Pus_XRXBiWc4yypjcu3nCl--V0IVy0QYTFoToZbtM4oNXEEZt6kW8A07lFUNftp3OyGh5k6tT3dZfr8k0e20 Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: d789047469894e1fbe5af3a109a95b4c Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_d789047469894e1fbe5af3a109a95b4c", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: d789047469894e1fbe5af3a109a95b4c Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersOnMultiNodesTest-1888665690-project Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 43188026fda44118ad642b7065108966 Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersOnMultiNodesTest-1888665690-project Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance f63d0c5a-060f-4524-93eb-78c4950d8848 could not be found. Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'f63d0c5a-060f-4524-93eb-78c4950d8848'} Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f63d0c5a-060f-4524-93eb-78c4950d8848 could not be found. Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f63d0c5a-060f-4524-93eb-78c4950d8848 could not be found. Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:38.106118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:38.118515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:38.118515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:38.118515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:38.118515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:38.118515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:38.118515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f63d0c5a-060f-4524-93eb-78c4950d8848 could not be found. Aug 22 17:18:38.118515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:38.118515 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ffe65213-7767-42a8-9800-1f04fea0e603 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Returning 404 to user: Instance f63d0c5a-060f-4524-93eb-78c4950d8848 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:38.118515 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ffe65213-7767-42a8-9800-1f04fea0e603 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848" status: 404 len: 111 microversion: 2.1 time: 0.085989 Aug 22 17:18:38.118515 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 742/1464] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:38 2022] GET /compute/v2.1/servers/f63d0c5a-060f-4524-93eb-78c4950d8848 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:18:38.129716 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e6c66edd-43ec-4511-83ec-224cf09920c6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:38.239669 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e6c66edd-43ec-4511-83ec-224cf09920c6 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "DELETE /compute/v2.1/os-server-groups/e933271f-229e-4e83-b54f-0d94d04187ec" status: 204 len: 0 microversion: 2.1 time: 0.116070 Aug 22 17:18:38.244129 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 743/1465] 10.222.0.96 () {58 vars in 1266 bytes} [Mon Aug 22 17:18:38 2022] DELETE /compute/v2.1/os-server-groups/e933271f-229e-4e83-b54f-0d94d04187ec => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:18:38.253946 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-dbb692f6-9eea-4782-bbe1-aa851e577881 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:38.255258 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-dbb692f6-9eea-4782-bbe1-aa851e577881 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:38.291634 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dbb692f6-9eea-4782-bbe1-aa851e577881 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:38.292581 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dbb692f6-9eea-4782-bbe1-aa851e577881 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:38.293563 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dbb692f6-9eea-4782-bbe1-aa851e577881 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:38.294268 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dbb692f6-9eea-4782-bbe1-aa851e577881 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:38.298958 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dbb692f6-9eea-4782-bbe1-aa851e577881 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:38.300423 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dbb692f6-9eea-4782-bbe1-aa851e577881 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:38.340596 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-dbb692f6-9eea-4782-bbe1-aa851e577881 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Going to try to terminate instance {{(pid=123015) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:18:38.639386 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ce18da0f-1022-422f-9b33-16ec95a5d932 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.363063 Aug 22 17:18:38.639957 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 723/1466] 10.222.0.96 () {60 vars in 1195 bytes} [Mon Aug 22 17:18:37 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:38.678438 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f4c9f422-d876-45b3-8ca1-3e7d6f962c82 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Action: 'create', calling method: .version_select at 0x7f800a075160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1759034424", "description": "tempest-description-1876717667"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:38.891260 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-dbb692f6-9eea-4782-bbe1-aa851e577881 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "DELETE /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 204 len: 0 microversion: 2.1 time: 0.637220 Aug 22 17:18:38.894362 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 744/1467] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:18:38 2022] DELETE /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 0 bytes in 645 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:18:38.913573 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4b1ab985-2ce0-4aa5-99e0-c7daec37962e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:38.916530 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-4b1ab985-2ce0-4aa5-99e0-c7daec37962e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:38.936937 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b1ab985-2ce0-4aa5-99e0-c7daec37962e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:38.939560 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b1ab985-2ce0-4aa5-99e0-c7daec37962e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:38.942334 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b1ab985-2ce0-4aa5-99e0-c7daec37962e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:38.942334 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b1ab985-2ce0-4aa5-99e0-c7daec37962e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:38.945438 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b1ab985-2ce0-4aa5-99e0-c7daec37962e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:38.948690 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4b1ab985-2ce0-4aa5-99e0-c7daec37962e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:39.534867 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-4b1ab985-2ce0-4aa5-99e0-c7daec37962e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:39.565551 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-4b1ab985-2ce0-4aa5-99e0-c7daec37962e tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1472 microversion: 2.1 time: 0.647249 Aug 22 17:18:39.565551 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 745/1468] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:38 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1472 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:39.565551 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-95a9dd07-c7b2-48d2-b96c-a4e992832eec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:39.566043 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-95a9dd07-c7b2-48d2-b96c-a4e992832eec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:39.582816 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-95a9dd07-c7b2-48d2-b96c-a4e992832eec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:39.583465 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-95a9dd07-c7b2-48d2-b96c-a4e992832eec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:39.584412 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-95a9dd07-c7b2-48d2-b96c-a4e992832eec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:39.585199 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-95a9dd07-c7b2-48d2-b96c-a4e992832eec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:39.586972 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-95a9dd07-c7b2-48d2-b96c-a4e992832eec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:39.587452 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-95a9dd07-c7b2-48d2-b96c-a4e992832eec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:39.635858 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:40.003319 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-95a9dd07-c7b2-48d2-b96c-a4e992832eec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:40.032709 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-95a9dd07-c7b2-48d2-b96c-a4e992832eec tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1477 microversion: 2.1 time: 0.479895 Aug 22 17:18:40.033368 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 746/1469] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:39 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1477 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:40.054181 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-55e06edc-29d2-4785-b3f3-5937b8bef800 req-a5348fdc-5bc4-488e-8e8b-3e0ffe6d2c65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4961b018-19fe-4ddf-8b18-1f392dc1a893", "name": "network-vif-plugged", "status": "completed", "tag": "83c67bcc-3180-44e8-84d7-e8a3bfa77f5e"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:40.066966 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-55e06edc-29d2-4785-b3f3-5937b8bef800 req-a5348fdc-5bc4-488e-8e8b-3e0ffe6d2c65 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:40.067614 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-55e06edc-29d2-4785-b3f3-5937b8bef800 req-a5348fdc-5bc4-488e-8e8b-3e0ffe6d2c65 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:40.068111 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-55e06edc-29d2-4785-b3f3-5937b8bef800 req-a5348fdc-5bc4-488e-8e8b-3e0ffe6d2c65 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:40.096552 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-55e06edc-29d2-4785-b3f3-5937b8bef800 req-a5348fdc-5bc4-488e-8e8b-3e0ffe6d2c65 service nova] Creating event network-vif-plugged:83c67bcc-3180-44e8-84d7-e8a3bfa77f5e for instance 4961b018-19fe-4ddf-8b18-1f392dc1a893 on n-h2-854030-1 Aug 22 17:18:40.103913 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-55e06edc-29d2-4785-b3f3-5937b8bef800 req-a5348fdc-5bc4-488e-8e8b-3e0ffe6d2c65 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054143 Aug 22 17:18:40.105267 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 747/1470] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:18:40.160614 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f4c9f422-d876-45b3-8ca1-3e7d6f962c82 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.501361 Aug 22 17:18:40.161760 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 724/1471] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:18:38 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:40.178963 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f9692afd-2f00-4a5b-ac57-a64b5d35b35f tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Action: 'create', calling method: .version_select at 0x7f8009692ca0>, body: {"security_group_rule": {"parent_group_id": "d5ef9875-c91e-4fc4-9ab8-acfe5af0e34f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:40.601675 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b9c43bb1-7632-41d4-8b4a-fcb3ef97118c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:40.602229 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b9c43bb1-7632-41d4-8b4a-fcb3ef97118c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:40.624346 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b9c43bb1-7632-41d4-8b4a-fcb3ef97118c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:40.624921 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b9c43bb1-7632-41d4-8b4a-fcb3ef97118c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:40.625889 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b9c43bb1-7632-41d4-8b4a-fcb3ef97118c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:40.626794 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b9c43bb1-7632-41d4-8b4a-fcb3ef97118c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:40.627294 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b9c43bb1-7632-41d4-8b4a-fcb3ef97118c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:40.627735 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b9c43bb1-7632-41d4-8b4a-fcb3ef97118c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:41.517474 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b9c43bb1-7632-41d4-8b4a-fcb3ef97118c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:41.558177 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b9c43bb1-7632-41d4-8b4a-fcb3ef97118c tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1472 microversion: 2.1 time: 0.970463 Aug 22 17:18:41.562208 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 725/1472] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:40 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1472 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:18:41.574279 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-21586ae7-7d10-42f2-b15f-f4ddb2a65d7a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:41.579006 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-21586ae7-7d10-42f2-b15f-f4ddb2a65d7a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:41.597416 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21586ae7-7d10-42f2-b15f-f4ddb2a65d7a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:41.598590 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21586ae7-7d10-42f2-b15f-f4ddb2a65d7a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:41.599262 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21586ae7-7d10-42f2-b15f-f4ddb2a65d7a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:41.602009 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21586ae7-7d10-42f2-b15f-f4ddb2a65d7a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:41.602691 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21586ae7-7d10-42f2-b15f-f4ddb2a65d7a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:41.606491 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21586ae7-7d10-42f2-b15f-f4ddb2a65d7a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:42.138271 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f9692afd-2f00-4a5b-ac57-a64b5d35b35f tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.964049 Aug 22 17:18:42.146819 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 748/1473] 10.222.0.96 () {60 vars in 1195 bytes} [Mon Aug 22 17:18:40 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:42.528389 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-21586ae7-7d10-42f2-b15f-f4ddb2a65d7a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:42.560093 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-21586ae7-7d10-42f2-b15f-f4ddb2a65d7a tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1477 microversion: 2.1 time: 0.995965 Aug 22 17:18:42.560702 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 726/1474] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:41 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1477 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:42.573386 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-c4e12f60-dc2a-421a-bada-fea4235be6d2 req-49568742-aa7a-4b51-88c3-441824a1d1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1802ae-582c-4cc0-bda9-86b08d26493f", "name": "network-vif-deleted", "tag": "9e2be979-59ce-4656-bfaf-7ce4cb2bb517"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:42.600022 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-c4e12f60-dc2a-421a-bada-fea4235be6d2 req-49568742-aa7a-4b51-88c3-441824a1d1b6 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:42.600510 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-c4e12f60-dc2a-421a-bada-fea4235be6d2 req-49568742-aa7a-4b51-88c3-441824a1d1b6 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:42.601112 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-c4e12f60-dc2a-421a-bada-fea4235be6d2 req-49568742-aa7a-4b51-88c3-441824a1d1b6 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:42.612823 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ab0523b7-3836-401a-865b-61a146c3bdb4 tempest-QuotasTestJSON-384149884 tempest-QuotasTestJSON-384149884-project] Calling method '.version_select at 0x7f80095f1ca0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:42.618890 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-c4e12f60-dc2a-421a-bada-fea4235be6d2 req-49568742-aa7a-4b51-88c3-441824a1d1b6 service nova] Creating event network-vif-deleted:9e2be979-59ce-4656-bfaf-7ce4cb2bb517 for instance de1802ae-582c-4cc0-bda9-86b08d26493f on n-h2-854030-1 Aug 22 17:18:42.658208 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-c4e12f60-dc2a-421a-bada-fea4235be6d2 req-49568742-aa7a-4b51-88c3-441824a1d1b6 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067278 Aug 22 17:18:42.660860 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 727/1475] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:42.677243 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4f44f089-afcc-46eb-9e2f-e7e905fae8f0 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Action: 'create', calling method: .version_select at 0x7f8009524670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1124537878", "description": "tempest-description-1978151144"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:42.741406 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ab0523b7-3836-401a-865b-61a146c3bdb4 tempest-QuotasTestJSON-384149884 tempest-QuotasTestJSON-384149884-project] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/6a922aab83ad4457b3e1ce8b29cabdd3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.595282 Aug 22 17:18:42.745446 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 749/1476] 10.222.0.96 () {58 vars in 1269 bytes} [Mon Aug 22 17:18:42 2022] GET /compute/v2.1/os-quota-sets/6a922aab83ad4457b3e1ce8b29cabdd3/defaults => generated 371 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:42.764062 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-c069d32f-4757-4122-ba16-5a0f48b257c3 req-3dd8020a-a40d-4f9b-b222-a6230667cdeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1802ae-582c-4cc0-bda9-86b08d26493f", "name": "network-vif-unplugged", "status": "completed", "tag": "9e2be979-59ce-4656-bfaf-7ce4cb2bb517"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:42.783084 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-c069d32f-4757-4122-ba16-5a0f48b257c3 req-3dd8020a-a40d-4f9b-b222-a6230667cdeb service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:42.784287 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-c069d32f-4757-4122-ba16-5a0f48b257c3 req-3dd8020a-a40d-4f9b-b222-a6230667cdeb service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:42.785409 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-c069d32f-4757-4122-ba16-5a0f48b257c3 req-3dd8020a-a40d-4f9b-b222-a6230667cdeb service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:42.826838 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-c069d32f-4757-4122-ba16-5a0f48b257c3 req-3dd8020a-a40d-4f9b-b222-a6230667cdeb service nova] Creating event network-vif-unplugged:9e2be979-59ce-4656-bfaf-7ce4cb2bb517 for instance de1802ae-582c-4cc0-bda9-86b08d26493f on n-h2-854030-1 Aug 22 17:18:42.845022 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-c069d32f-4757-4122-ba16-5a0f48b257c3 req-3dd8020a-a40d-4f9b-b222-a6230667cdeb service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093671 Aug 22 17:18:42.848517 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 750/1477] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:43.069581 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3888b7e9-89fd-45bf-a062-1a58a172497c tempest-ServerAddressesNegativeTestJSON-1250109945 tempest-ServerAddressesNegativeTestJSON-1250109945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1435823587", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "19706465-e801-4621-a639-6faeca9f181d"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:43.219753 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-3888b7e9-89fd-45bf-a062-1a58a172497c tempest-ServerAddressesNegativeTestJSON-1250109945 tempest-ServerAddressesNegativeTestJSON-1250109945-project] validate_networks() for [('19706465-e801-4621-a639-6faeca9f181d', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:18:43.766796 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4f44f089-afcc-46eb-9e2f-e7e905fae8f0 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.103366 Aug 22 17:18:43.768937 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 728/1478] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:18:42 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:43.779245 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-912cf14c-c562-44fc-a3b1-404631313414 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:43.784916 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-912cf14c-c562-44fc-a3b1-404631313414 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:43.808919 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-912cf14c-c562-44fc-a3b1-404631313414 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:43.811929 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-912cf14c-c562-44fc-a3b1-404631313414 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:43.814430 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-912cf14c-c562-44fc-a3b1-404631313414 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:43.815700 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-912cf14c-c562-44fc-a3b1-404631313414 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:43.832209 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-912cf14c-c562-44fc-a3b1-404631313414 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:43.832773 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-912cf14c-c562-44fc-a3b1-404631313414 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-3888b7e9-89fd-45bf-a062-1a58a172497c tempest-ServerAddressesNegativeTestJSON-1250109945 tempest-ServerAddressesNegativeTestJSON-1250109945-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-35ca9a7e-9e01-4e4f-9c69-b0a8400516bc) Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:18:43.942293 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:18:43.946600 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:18:43.946600 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:18:43.946600 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:18:43.946600 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:18:43.946600 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:18:43.946600 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:18:43.946600 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:18:43.946600 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:18:43.946600 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:18:43.946600 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:18:43.946600 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:18:43.946600 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:18:43.946600 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:18:43.946600 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:18:43.946600 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:18:43.946600 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-35ca9a7e-9e01-4e4f-9c69-b0a8400516bc) Aug 22 17:18:43.946600 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:43.949689 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-3888b7e9-89fd-45bf-a062-1a58a172497c tempest-ServerAddressesNegativeTestJSON-1250109945 tempest-ServerAddressesNegativeTestJSON-1250109945-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:18:43.949689 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3888b7e9-89fd-45bf-a062-1a58a172497c tempest-ServerAddressesNegativeTestJSON-1250109945 tempest-ServerAddressesNegativeTestJSON-1250109945-project] Request method failure captured: Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 217 Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7pylTWSqXBdPXcWskhr5UJ6xet4W_cOPbFvFR3nzQahpYzB80XHYzbZa9D9V6jnqQN16GTE1wPUihAeg-S-tSlY76qDmFnjzlsCL38yrLChLUUaYu7C4y_dos0uJz87xGBoVuIsazcJlbPS5jR95Ur9_nTgMsT7kapQpZlLuF9qL98 Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: aa90bc0d7ddb424a9085fa5fa529b9f0 Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1250109945 Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/aa90bc0d7ddb424a9085fa5fa529b9f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_aa90bc0d7ddb424a9085fa5fa529b9f0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/aa90bc0d7ddb424a9085fa5fa529b9f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/aa90bc0d7ddb424a9085fa5fa529b9f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1250109945 Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: aa90bc0d7ddb424a9085fa5fa529b9f0 Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1250109945 Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServerAddressesNegativeTestJSON-1250109945-project Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 426ecd112af84a5cbf7e969082010d03 Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1250109945-project Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1435823587", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "19706465-e801-4621-a639-6faeca9f181d"}]}} Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ServerAddressesNegativeTestJSON-server-1435823587', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '19706465-e801-4621-a639-6faeca9f181d'}]}}} Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:18:43.952375 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-35ca9a7e-9e01-4e4f-9c69-b0a8400516bc) Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:18:43.957216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:18:43.964392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:18:43.964392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:43.964392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:43.964392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:43.964392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:43.964392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:43.964392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:43.964392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:43.964392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:43.964392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:43.964392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:18:43.964392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:43.964392 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:43.964392 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3888b7e9-89fd-45bf-a062-1a58a172497c tempest-ServerAddressesNegativeTestJSON-1250109945 tempest-ServerAddressesNegativeTestJSON-1250109945-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:18:43.964392 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:43.969796 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3888b7e9-89fd-45bf-a062-1a58a172497c tempest-ServerAddressesNegativeTestJSON-1250109945 tempest-ServerAddressesNegativeTestJSON-1250109945-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.117008 Aug 22 17:18:43.974553 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-912cf14c-c562-44fc-a3b1-404631313414 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:43.976868 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-912cf14c-c562-44fc-a3b1-404631313414 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:43.979488 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-912cf14c-c562-44fc-a3b1-404631313414 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:43.980209 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-912cf14c-c562-44fc-a3b1-404631313414 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lazy-loading 'fault' on Instance uuid de1802ae-582c-4cc0-bda9-86b08d26493f {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:18:43.986761 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 751/1479] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:18:42 2022] POST /compute/v2.1/servers => generated 214 bytes in 1136 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:18:44.006854 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-16164dd7-653d-4767-ad76-e584de53de99 tempest-QuotasTestJSON-384149884 tempest-QuotasTestJSON-384149884-project] Calling method '.version_select at 0x7f80095fc700>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:44.192316 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-912cf14c-c562-44fc-a3b1-404631313414 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43188026fda44118ad642b7065108966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd789047469894e1fbe5af3a109a95b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:44.209010 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-912cf14c-c562-44fc-a3b1-404631313414 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 200 len: 1307 microversion: 2.1 time: 0.437494 Aug 22 17:18:44.212147 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 729/1480] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:43 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 1307 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:44.230755 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2b048b9b-5d3c-4a87-96a1-0ad3549deef2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:44.233941 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-2b048b9b-5d3c-4a87-96a1-0ad3549deef2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:44.268383 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2b048b9b-5d3c-4a87-96a1-0ad3549deef2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:44.271601 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2b048b9b-5d3c-4a87-96a1-0ad3549deef2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:44.276130 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2b048b9b-5d3c-4a87-96a1-0ad3549deef2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:44.276917 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2b048b9b-5d3c-4a87-96a1-0ad3549deef2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:44.280666 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2b048b9b-5d3c-4a87-96a1-0ad3549deef2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:44.281592 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2b048b9b-5d3c-4a87-96a1-0ad3549deef2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:44.679798 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-2b048b9b-5d3c-4a87-96a1-0ad3549deef2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:44.692778 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2b048b9b-5d3c-4a87-96a1-0ad3549deef2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1463 microversion: 2.1 time: 0.478185 Aug 22 17:18:44.708193 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 730/1481] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:44 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1463 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:44.718294 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-875d7716-d40c-4ad1-a222-68d7ea802a8d tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Action: 'create', calling method: .version_select at 0x7f8009493430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-961328222", "description": "tempest-description-1537345067"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:44.751708 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-16164dd7-653d-4767-ad76-e584de53de99 tempest-QuotasTestJSON-384149884 tempest-QuotasTestJSON-384149884-project] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/6a922aab83ad4457b3e1ce8b29cabdd3" status: 200 len: 371 microversion: 2.1 time: 0.763026 Aug 22 17:18:44.757138 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 752/1482] 10.222.0.96 () {58 vars in 1242 bytes} [Mon Aug 22 17:18:43 2022] GET /compute/v2.1/os-quota-sets/6a922aab83ad4457b3e1ce8b29cabdd3 => generated 371 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:44.770609 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-242578ff-8946-487f-aa0d-195d85008c6e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:44.771826 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-242578ff-8946-487f-aa0d-195d85008c6e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:44.803727 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-242578ff-8946-487f-aa0d-195d85008c6e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:44.805817 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-242578ff-8946-487f-aa0d-195d85008c6e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:44.808794 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-242578ff-8946-487f-aa0d-195d85008c6e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:44.811495 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-242578ff-8946-487f-aa0d-195d85008c6e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:44.813896 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-242578ff-8946-487f-aa0d-195d85008c6e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:44.814983 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-242578ff-8946-487f-aa0d-195d85008c6e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:45.329211 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-242578ff-8946-487f-aa0d-195d85008c6e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:45.349500 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-242578ff-8946-487f-aa0d-195d85008c6e tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1463 microversion: 2.1 time: 0.590340 Aug 22 17:18:45.350261 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 753/1483] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:44 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1463 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:45.384523 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-66eb046b-1527-4319-86a3-8b87eef0741c tempest-QuotasTestJSON-384149884 tempest-QuotasTestJSON-384149884-project] Calling method '.version_select at 0x7f80094a4b80>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:45.550991 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-875d7716-d40c-4ad1-a222-68d7ea802a8d tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.841554 Aug 22 17:18:45.557932 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 731/1484] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:18:44 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:45.560395 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2d60c7fb-753c-4cd4-8f76-6c52941d0a59 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:45.561466 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-2d60c7fb-753c-4cd4-8f76-6c52941d0a59 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] [instance: de1802ae-582c-4cc0-bda9-86b08d26493f] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:45.582789 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:45.590930 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2d60c7fb-753c-4cd4-8f76-6c52941d0a59 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:45.593422 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2d60c7fb-753c-4cd4-8f76-6c52941d0a59 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:45.595340 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2d60c7fb-753c-4cd4-8f76-6c52941d0a59 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:45.600854 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2d60c7fb-753c-4cd4-8f76-6c52941d0a59 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:45.601875 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2d60c7fb-753c-4cd4-8f76-6c52941d0a59 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:45.602587 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2d60c7fb-753c-4cd4-8f76-6c52941d0a59 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:45.646269 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-2d60c7fb-753c-4cd4-8f76-6c52941d0a59 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] HTTP exception thrown: Instance de1802ae-582c-4cc0-bda9-86b08d26493f could not be found. Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2d60c7fb-753c-4cd4-8f76-6c52941d0a59 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Request method failure captured: Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f HTTP/1.1 Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7lgSm4FKTHXtIz1Gx3tknJOMgFMA7b9cAHDnITnAh8xWgKu_QooBsvcVa7rpSsMIJ6ZKXC66_UbsLY8HsWtLPA5uE9Pus_XRXBiWc4yypjcu3nCl--V0IVy0QYTFoToZbtM4oNXEEZt6kW8A07lFUNftp3OyGh5k6tT3dZfr8k0e20 Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: d789047469894e1fbe5af3a109a95b4c Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_d789047469894e1fbe5af3a109a95b4c", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/d789047469894e1fbe5af3a109a95b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: d789047469894e1fbe5af3a109a95b4c Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1888665690 Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServersOnMultiNodesTest-1888665690-project Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 43188026fda44118ad642b7065108966 Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServersOnMultiNodesTest-1888665690-project Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance de1802ae-582c-4cc0-bda9-86b08d26493f could not be found. Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'de1802ae-582c-4cc0-bda9-86b08d26493f'} Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de1802ae-582c-4cc0-bda9-86b08d26493f could not be found. Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de1802ae-582c-4cc0-bda9-86b08d26493f could not be found. Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:45.648727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:45.653439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:45.653439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:45.653439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:45.653439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:45.653439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:45.653439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de1802ae-582c-4cc0-bda9-86b08d26493f could not be found. Aug 22 17:18:45.653439 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:18:45.661362 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2d60c7fb-753c-4cd4-8f76-6c52941d0a59 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] Returning 404 to user: Instance de1802ae-582c-4cc0-bda9-86b08d26493f could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:45.662477 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2d60c7fb-753c-4cd4-8f76-6c52941d0a59 tempest-ServersOnMultiNodesTest-1888665690 tempest-ServersOnMultiNodesTest-1888665690-project] 10.222.0.96 "GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f" status: 404 len: 111 microversion: 2.1 time: 0.106745 Aug 22 17:18:45.669500 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 732/1485] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:45 2022] GET /compute/v2.1/servers/de1802ae-582c-4cc0-bda9-86b08d26493f => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:18:45.692220 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:45.709105 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:45.724947 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:45.725847 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:45.726247 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:45.726996 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:45.727464 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:45.727891 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:46.191269 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-66eb046b-1527-4319-86a3-8b87eef0741c tempest-QuotasTestJSON-384149884 tempest-QuotasTestJSON-384149884-project] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/6a922aab83ad4457b3e1ce8b29cabdd3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.837706 Aug 22 17:18:46.195033 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 754/1486] 10.222.0.96 () {58 vars in 1269 bytes} [Mon Aug 22 17:18:45 2022] GET /compute/v2.1/os-quota-sets/6a922aab83ad4457b3e1ce8b29cabdd3/defaults => generated 371 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:46.239867 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:18:46.240302 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:18:46.240785 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:18:46.241227 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:18:46.241649 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:18:46.242504 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6b2e19fb-ef02-44ae-98c2-b8e838c9e8f2 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Action: 'create', calling method: .version_select at 0x7f8009b31790>, body: {"security_group_rule": {"parent_group_id": "d186c929-1787-46a0-972d-e427c5a61362", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "420f64c9-0abb-481b-9cfc-58ad8d37ffc6"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:46.546208 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:46.597491 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:46.601379 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:46.602538 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:46.603394 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:46.609522 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:46.610151 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:46.780499 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5bb14e10-75d1-4cfe-9da6-3ed021acfc04 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "POST /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893/action" status: 202 len: 1067 microversion: 2.1 time: 1.109396 Aug 22 17:18:46.782286 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 733/1487] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:18:45 2022] POST /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893/action => generated 1067 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 22 17:18:46.799784 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8d45ed48-aa78-4b5a-b403-ea363b1d5290 tempest-QuotasTestJSON-384149884 tempest-QuotasTestJSON-384149884-project] Calling method '.version_select at 0x7f80094edf70>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:47.464334 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8d45ed48-aa78-4b5a-b403-ea363b1d5290 tempest-QuotasTestJSON-384149884 tempest-QuotasTestJSON-384149884-project] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/6a922aab83ad4457b3e1ce8b29cabdd3" status: 200 len: 371 microversion: 2.1 time: 0.673233 Aug 22 17:18:47.466131 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 734/1488] 10.222.0.96 () {58 vars in 1242 bytes} [Mon Aug 22 17:18:46 2022] GET /compute/v2.1/os-quota-sets/6a922aab83ad4457b3e1ce8b29cabdd3 => generated 371 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:47.488858 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-71a75fd2-6753-4c2b-9f9b-63f11c8aaa7b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:47.496607 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-71a75fd2-6753-4c2b-9f9b-63f11c8aaa7b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:47.523083 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-71a75fd2-6753-4c2b-9f9b-63f11c8aaa7b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:47.531608 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-71a75fd2-6753-4c2b-9f9b-63f11c8aaa7b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:47.534378 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-71a75fd2-6753-4c2b-9f9b-63f11c8aaa7b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:47.535585 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-71a75fd2-6753-4c2b-9f9b-63f11c8aaa7b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:47.536415 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-71a75fd2-6753-4c2b-9f9b-63f11c8aaa7b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:47.537206 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-71a75fd2-6753-4c2b-9f9b-63f11c8aaa7b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:48.344621 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-71a75fd2-6753-4c2b-9f9b-63f11c8aaa7b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:48.356722 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-71a75fd2-6753-4c2b-9f9b-63f11c8aaa7b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1472 microversion: 2.1 time: 0.885904 Aug 22 17:18:48.360305 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 735/1489] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:47 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1472 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:48.379483 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ba07bb71-6926-4177-a20e-f98206852e62 tempest-QuotasTestJSON-384149884 tempest-QuotasTestJSON-384149884-project] Calling method '.version_select at 0x7f80094e3c10>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:48.536392 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ba07bb71-6926-4177-a20e-f98206852e62 tempest-QuotasTestJSON-384149884 tempest-QuotasTestJSON-384149884-project] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/6a922aab83ad4457b3e1ce8b29cabdd3?user_id=744b228c1de74e019dd26a5e2f31c116" status: 200 len: 371 microversion: 2.1 time: 0.171831 Aug 22 17:18:48.537563 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 736/1490] 10.222.0.96 () {58 vars in 1323 bytes} [Mon Aug 22 17:18:48 2022] GET /compute/v2.1/os-quota-sets/6a922aab83ad4457b3e1ce8b29cabdd3?user_id=744b228c1de74e019dd26a5e2f31c116 => generated 371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:48.682944 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e9194f95-4e81-43ba-8b06-2ee6857d828f tempest-ServerGroup264TestJSON-784722559 tempest-ServerGroup264TestJSON-784722559-project] Action: 'create', calling method: .version_select at 0x7f80094400d0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:48.768651 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-e9194f95-4e81-43ba-8b06-2ee6857d828f tempest-ServerGroup264TestJSON-784722559 tempest-ServerGroup264TestJSON-784722559-project] Getting quotas for project bf8a1b65cec84acbbce11edbd6c49d57. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:18:48.812729 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-e9194f95-4e81-43ba-8b06-2ee6857d828f tempest-ServerGroup264TestJSON-784722559 tempest-ServerGroup264TestJSON-784722559-project] Getting quotas for user e336b0ac770340f6a6135f85cc1805a6 and project bf8a1b65cec84acbbce11edbd6c49d57. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:18:49.124921 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-e9194f95-4e81-43ba-8b06-2ee6857d828f tempest-ServerGroup264TestJSON-784722559 tempest-ServerGroup264TestJSON-784722559-project] Getting quotas for project bf8a1b65cec84acbbce11edbd6c49d57. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:18:49.148265 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-e9194f95-4e81-43ba-8b06-2ee6857d828f tempest-ServerGroup264TestJSON-784722559 tempest-ServerGroup264TestJSON-784722559-project] Getting quotas for user e336b0ac770340f6a6135f85cc1805a6 and project bf8a1b65cec84acbbce11edbd6c49d57. Resources: {'server_groups'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:18:49.200201 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e9194f95-4e81-43ba-8b06-2ee6857d828f tempest-ServerGroup264TestJSON-784722559 tempest-ServerGroup264TestJSON-784722559-project] 10.222.0.96 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.656880 Aug 22 17:18:49.208817 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 737/1491] 10.222.0.96 () {62 vars in 1214 bytes} [Mon Aug 22 17:18:48 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:18:49.215499 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-08fcfd8a-0b97-4aab-9018-195b337e47fa tempest-ServerGroup264TestJSON-784722559 tempest-ServerGroup264TestJSON-784722559-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:49.231839 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-08fcfd8a-0b97-4aab-9018-195b337e47fa tempest-ServerGroup264TestJSON-784722559 tempest-ServerGroup264TestJSON-784722559-project] 10.222.0.96 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.021219 Aug 22 17:18:49.241398 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 738/1492] 10.222.0.96 () {60 vars in 1193 bytes} [Mon Aug 22 17:18:49 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:18:49.251975 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b78d4174-ec3b-47a6-b270-61a0648b23b7 tempest-ServerGroup264TestJSON-784722559 tempest-ServerGroup264TestJSON-784722559-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:49.269722 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b78d4174-ec3b-47a6-b270-61a0648b23b7 tempest-ServerGroup264TestJSON-784722559 tempest-ServerGroup264TestJSON-784722559-project] 10.222.0.96 "GET /compute/v2.1/os-server-groups/a4170b23-739a-4055-97b9-43a98c235856" status: 200 len: 235 microversion: 2.64 time: 0.025093 Aug 22 17:18:49.283241 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 739/1493] 10.222.0.96 () {60 vars in 1304 bytes} [Mon Aug 22 17:18:49 2022] GET /compute/v2.1/os-server-groups/a4170b23-739a-4055-97b9-43a98c235856 => generated 235 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:18:49.296276 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e7e59e99-0a45-4fac-b074-97a2b816754d tempest-ServerGroup264TestJSON-784722559 tempest-ServerGroup264TestJSON-784722559-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:49.786560 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e7e59e99-0a45-4fac-b074-97a2b816754d tempest-ServerGroup264TestJSON-784722559 tempest-ServerGroup264TestJSON-784722559-project] 10.222.0.96 "DELETE /compute/v2.1/os-server-groups/a4170b23-739a-4055-97b9-43a98c235856" status: 204 len: 0 microversion: 2.64 time: 0.498857 Aug 22 17:18:49.786560 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 740/1494] 10.222.0.96 () {60 vars in 1307 bytes} [Mon Aug 22 17:18:49 2022] DELETE /compute/v2.1/os-server-groups/a4170b23-739a-4055-97b9-43a98c235856 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 17:18:49.802598 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-17803593-a72a-461b-a941-e3b13b22dea8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:49.803237 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-17803593-a72a-461b-a941-e3b13b22dea8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:49.832688 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17803593-a72a-461b-a941-e3b13b22dea8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:49.837237 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17803593-a72a-461b-a941-e3b13b22dea8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:49.838139 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6b2e19fb-ef02-44ae-98c2-b8e838c9e8f2 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 3.632936 Aug 22 17:18:49.840837 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 755/1495] 10.222.0.96 () {60 vars in 1195 bytes} [Mon Aug 22 17:18:46 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 3644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:49.851402 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17803593-a72a-461b-a941-e3b13b22dea8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:49.857695 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-36b86133-291a-4180-a275-627015a220bc tempest-ServerGroup264TestJSON-784722559 tempest-ServerGroup264TestJSON-784722559-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:49.858388 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17803593-a72a-461b-a941-e3b13b22dea8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:49.859844 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17803593-a72a-461b-a941-e3b13b22dea8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:49.859844 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-17803593-a72a-461b-a941-e3b13b22dea8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:49.890844 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=6,nova_api:UPDATE=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:49.896136 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-36b86133-291a-4180-a275-627015a220bc tempest-ServerGroup264TestJSON-784722559 tempest-ServerGroup264TestJSON-784722559-project] HTTP exception thrown: Instance group a4170b23-739a-4055-97b9-43a98c235856 could not be found. Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-36b86133-291a-4180-a275-627015a220bc tempest-ServerGroup264TestJSON-784722559 tempest-ServerGroup264TestJSON-784722559-project] Request method failure captured: Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/os-server-groups/a4170b23-739a-4055-97b9-43a98c235856 HTTP/1.1 Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7p3Nx1id5cp1ABHSiFcz-P3NH6cQEMlYvFpy2nWJRdnNpWpBTf1yDBds0LbHWdOVkgxPbKaXhgEqwlvJ5pG0U8EGl4GH_UT3_OIeoVY0lHSKr6IOju_GYNWi1ZteK_z2roFtFIGB_996bOnuSStscQciboLKvHZc1J9IkWvFgg0ejY Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-Openstack-Nova-Api-Version: 2.64 Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: bf8a1b65cec84acbbce11edbd6c49d57 Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServerGroup264TestJSON-784722559 Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/bf8a1b65cec84acbbce11edbd6c49d57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_bf8a1b65cec84acbbce11edbd6c49d57", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/bf8a1b65cec84acbbce11edbd6c49d57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/bf8a1b65cec84acbbce11edbd6c49d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServerGroup264TestJSON-784722559 Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: bf8a1b65cec84acbbce11edbd6c49d57 Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServerGroup264TestJSON-784722559 Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServerGroup264TestJSON-784722559-project Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: e336b0ac770340f6a6135f85cc1805a6 Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServerGroup264TestJSON-784722559-project Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance group a4170b23-739a-4055-97b9-43a98c235856 could not be found. Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'a4170b23-739a-4055-97b9-43a98c235856'} Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a4170b23-739a-4055-97b9-43a98c235856 could not be found. Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a4170b23-739a-4055-97b9-43a98c235856 could not be found. Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:49.901404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:18:49.918662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:18:49.918662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:18:49.918662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:18:49.918662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:18:49.918662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a4170b23-739a-4055-97b9-43a98c235856 could not be found. Aug 22 17:18:49.918662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:18:49.918662 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-36b86133-291a-4180-a275-627015a220bc tempest-ServerGroup264TestJSON-784722559 tempest-ServerGroup264TestJSON-784722559-project] Returning 404 to user: Instance group a4170b23-739a-4055-97b9-43a98c235856 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:18:49.918662 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-36b86133-291a-4180-a275-627015a220bc tempest-ServerGroup264TestJSON-784722559 tempest-ServerGroup264TestJSON-784722559-project] 10.222.0.96 "DELETE /compute/v2.1/os-server-groups/a4170b23-739a-4055-97b9-43a98c235856" status: 404 len: 117 microversion: 2.64 time: 0.062076 Aug 22 17:18:49.918662 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 756/1496] 10.222.0.96 () {60 vars in 1307 bytes} [Mon Aug 22 17:18:49 2022] DELETE /compute/v2.1/os-server-groups/a4170b23-739a-4055-97b9-43a98c235856 => generated 117 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:18:49.920193 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6f58e536-4724-4c29-8ffd-65db74c85960 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Action: 'create', calling method: .version_select at 0x7f8009372160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-244579014", "description": "tempest-description-1724150022"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:50.952315 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6f58e536-4724-4c29-8ffd-65db74c85960 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.038512 Aug 22 17:18:50.954641 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 757/1497] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:18:49 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:50.967862 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b648acdf-9458-4a82-9e52-5a33ebd9d068 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Action: 'create', calling method: .version_select at 0x7f8009372a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-498830141", "description": "tempest-description-1482102473"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:51.135324 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-17803593-a72a-461b-a941-e3b13b22dea8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:51.167114 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-17803593-a72a-461b-a941-e3b13b22dea8 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1472 microversion: 2.1 time: 1.380289 Aug 22 17:18:51.169607 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 741/1498] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:49 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1472 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:52.199429 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ead01a80-8f95-4929-a8ba-5d0dc961ae52 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:52.201883 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-ead01a80-8f95-4929-a8ba-5d0dc961ae52 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:52.216461 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ead01a80-8f95-4929-a8ba-5d0dc961ae52 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:52.217326 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ead01a80-8f95-4929-a8ba-5d0dc961ae52 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:52.218135 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ead01a80-8f95-4929-a8ba-5d0dc961ae52 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:52.219397 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ead01a80-8f95-4929-a8ba-5d0dc961ae52 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:52.220226 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ead01a80-8f95-4929-a8ba-5d0dc961ae52 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:52.221050 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ead01a80-8f95-4929-a8ba-5d0dc961ae52 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:52.760991 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b648acdf-9458-4a82-9e52-5a33ebd9d068 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.797199 Aug 22 17:18:52.769622 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 758/1499] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:18:50 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:52.776273 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-27a8c50d-1a98-4bd8-ac49-0180f6e47042 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Action: 'create', calling method: .version_select at 0x7f80094ef3a0>, body: {"security_group_rule": {"parent_group_id": "7831446a-bb84-45f1-9a67-11f27caec6a3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "32ee093e-3278-4eed-bf07-c1539ee04db2"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:52.929537 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ead01a80-8f95-4929-a8ba-5d0dc961ae52 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:52.947612 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ead01a80-8f95-4929-a8ba-5d0dc961ae52 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1472 microversion: 2.1 time: 0.757615 Aug 22 17:18:52.970126 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 742/1500] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:52 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1472 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:53.985399 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9699c573-7478-4eee-b584-179e876b981f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:53.986414 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-9699c573-7478-4eee-b584-179e876b981f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:54.002192 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9699c573-7478-4eee-b584-179e876b981f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:54.005645 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9699c573-7478-4eee-b584-179e876b981f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:54.006434 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9699c573-7478-4eee-b584-179e876b981f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:54.011305 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9699c573-7478-4eee-b584-179e876b981f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:54.012190 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9699c573-7478-4eee-b584-179e876b981f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:54.012970 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9699c573-7478-4eee-b584-179e876b981f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:54.708667 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:54.846630 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9699c573-7478-4eee-b584-179e876b981f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:54.855363 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9699c573-7478-4eee-b584-179e876b981f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1472 microversion: 2.1 time: 0.877304 Aug 22 17:18:54.858476 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 743/1501] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:53 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1472 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:54.952235 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-27a8c50d-1a98-4bd8-ac49-0180f6e47042 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 2.181332 Aug 22 17:18:54.955024 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 759/1502] 10.222.0.96 () {60 vars in 1195 bytes} [Mon Aug 22 17:18:52 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 2185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:54.966324 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-11d6ae6b-b7c0-4e15-b84f-2335586c2a21 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Calling method '.version_select at 0x7f80094a8d30>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:55.896542 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=12 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:55.902632 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-65b66121-dda5-4f18-abb4-722aaeabaa64 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:55.903381 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-65b66121-dda5-4f18-abb4-722aaeabaa64 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:55.916091 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65b66121-dda5-4f18-abb4-722aaeabaa64 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:55.916680 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65b66121-dda5-4f18-abb4-722aaeabaa64 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:55.917226 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65b66121-dda5-4f18-abb4-722aaeabaa64 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:55.918023 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65b66121-dda5-4f18-abb4-722aaeabaa64 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:55.920004 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65b66121-dda5-4f18-abb4-722aaeabaa64 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:55.920536 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-65b66121-dda5-4f18-abb4-722aaeabaa64 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:57.115447 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-11d6ae6b-b7c0-4e15-b84f-2335586c2a21 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/32ee093e-3278-4eed-bf07-c1539ee04db2" status: 202 len: 0 microversion: 2.1 time: 2.153622 Aug 22 17:18:57.116592 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 744/1503] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:18:54 2022] DELETE /compute/v2.1/os-security-groups/32ee093e-3278-4eed-bf07-c1539ee04db2 => generated 0 bytes in 2156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:18:57.402803 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d73c98ec-d593-454a-8af3-581d6e78fd20 tempest-ServersTestBootFromVolume-1936294080 tempest-ServersTestBootFromVolume-1936294080-project] Action: 'create', calling method: .version_select at 0x7f8009558ca0>, body: {"keypair": {"name": "tempest-keypair-1456045215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPh5Qyk7UwFOy2Knd4Je1mW9n4KMxoQyx0ffm+EoxLlgyCdi6PgOz1WI2DOTk+M3HpqSr2H1PtrXAAvMVR1E+ha/i3VA3JCma6l9bCMuhshlttJg0G9S0Wybtv4X/6Y8A=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:57.446223 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-d73c98ec-d593-454a-8af3-581d6e78fd20 tempest-ServersTestBootFromVolume-1936294080 tempest-ServersTestBootFromVolume-1936294080-project] Getting quotas for project 3fa7f7d4449041479a9f6e389245679b. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:18:57.458835 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-d73c98ec-d593-454a-8af3-581d6e78fd20 tempest-ServersTestBootFromVolume-1936294080 tempest-ServersTestBootFromVolume-1936294080-project] Getting quotas for user b06a1e1550924c6ab38995a97a6890df and project 3fa7f7d4449041479a9f6e389245679b. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:18:57.597991 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d73c98ec-d593-454a-8af3-581d6e78fd20 tempest-ServersTestBootFromVolume-1936294080 tempest-ServersTestBootFromVolume-1936294080-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.480115 Aug 22 17:18:57.601346 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 745/1504] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:18:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:57.610175 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0f0bcb5e-9d3a-4798-8452-e17152534561 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Calling method '.version_select at 0x7f80094499d0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:57.625583 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-65b66121-dda5-4f18-abb4-722aaeabaa64 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:57.643199 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-65b66121-dda5-4f18-abb4-722aaeabaa64 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1472 microversion: 2.1 time: 1.747245 Aug 22 17:18:57.646102 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 760/1505] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:55 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1472 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:57.827092 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d61ce820-6b13-455a-a761-a5b56bd33e2c tempest-ComputeTenantNetworksTest-786099977 tempest-ComputeTenantNetworksTest-786099977-project] Calling method '.version_select at 0x7f8009372820>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:57.996019 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0f0bcb5e-9d3a-4798-8452-e17152534561 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "GET /compute/v2.1/os-security-groups/7831446a-bb84-45f1-9a67-11f27caec6a3" status: 200 len: 247 microversion: 2.1 time: 0.389810 Aug 22 17:18:58.004636 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 746/1506] 10.222.0.96 () {58 vars in 1269 bytes} [Mon Aug 22 17:18:57 2022] GET /compute/v2.1/os-security-groups/7831446a-bb84-45f1-9a67-11f27caec6a3 => generated 247 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:58.030322 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1ded671a-47e1-4091-bc7d-a7ff5eabf98d tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Action: 'create', calling method: .version_select at 0x7f80094ed3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-873798627", "description": "tempest-description-757172328"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:58.902730 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1ded671a-47e1-4091-bc7d-a7ff5eabf98d tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.886453 Aug 22 17:18:58.902730 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 747/1507] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:18:58 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:58.908636 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-10c6676d-c579-4020-8994-8382bad882b4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:58.911564 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-10c6676d-c579-4020-8994-8382bad882b4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:18:58.926495 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-10c6676d-c579-4020-8994-8382bad882b4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:58.931066 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-10c6676d-c579-4020-8994-8382bad882b4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:58.931066 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-10c6676d-c579-4020-8994-8382bad882b4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:58.931817 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-10c6676d-c579-4020-8994-8382bad882b4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:18:58.932463 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-10c6676d-c579-4020-8994-8382bad882b4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:18:58.933650 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-10c6676d-c579-4020-8994-8382bad882b4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:18:59.070457 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d61ce820-6b13-455a-a761-a5b56bd33e2c tempest-ComputeTenantNetworksTest-786099977 tempest-ComputeTenantNetworksTest-786099977-project] 10.222.0.96 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.422752 Aug 22 17:18:59.071727 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 761/1508] 10.222.0.96 () {58 vars in 1158 bytes} [Mon Aug 22 17:18:57 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:59.076930 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-25dd50c0-9e9e-412a-9f1e-c7c969c18553 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Action: 'create', calling method: .version_select at 0x7f80096bdc10>, body: {"security_group_rule": {"parent_group_id": "3c78678a-036b-4d09-a398-de5aaad54846", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:59.415207 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-10c6676d-c579-4020-8994-8382bad882b4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:18:59.432726 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-10c6676d-c579-4020-8994-8382bad882b4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1472 microversion: 2.1 time: 0.529276 Aug 22 17:18:59.437890 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 748/1509] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:18:58 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1472 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:59.441739 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-80cce537-0c81-460c-8969-62cb7cd4accc tempest-ComputeTenantNetworksTest-786099977 tempest-ComputeTenantNetworksTest-786099977-project] Calling method '.version_select at 0x7f80094ed0d0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:59.734884 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-80cce537-0c81-460c-8969-62cb7cd4accc tempest-ComputeTenantNetworksTest-786099977 tempest-ComputeTenantNetworksTest-786099977-project] 10.222.0.96 "GET /compute/v2.1/os-tenant-networks/a3c7d8a2-dbf9-47bf-aba1-e0566522dfa2" status: 200 len: 140 microversion: 2.1 time: 0.298596 Aug 22 17:18:59.736219 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 749/1510] 10.222.0.96 () {58 vars in 1269 bytes} [Mon Aug 22 17:18:59 2022] GET /compute/v2.1/os-tenant-networks/a3c7d8a2-dbf9-47bf-aba1-e0566522dfa2 => generated 140 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:00.469608 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8b0c10b2-6763-4481-83e2-805380f00c8f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:00.470774 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-8b0c10b2-6763-4481-83e2-805380f00c8f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:00.479173 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8b0c10b2-6763-4481-83e2-805380f00c8f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:00.479683 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8b0c10b2-6763-4481-83e2-805380f00c8f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:00.480123 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8b0c10b2-6763-4481-83e2-805380f00c8f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:00.480851 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8b0c10b2-6763-4481-83e2-805380f00c8f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:00.481444 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8b0c10b2-6763-4481-83e2-805380f00c8f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:00.481949 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8b0c10b2-6763-4481-83e2-805380f00c8f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:00.514725 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:00.774139 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-25dd50c0-9e9e-412a-9f1e-c7c969c18553 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.699267 Aug 22 17:19:00.780956 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 762/1511] 10.222.0.96 () {60 vars in 1195 bytes} [Mon Aug 22 17:18:59 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:00.796948 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4a40d5bd-563a-49ea-af02-3a8b2d94fb6a tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Action: 'create', calling method: .version_select at 0x7f800972cd30>, body: {"security_group_rule": {"parent_group_id": "3c78678a-036b-4d09-a398-de5aaad54846", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:00.938725 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-8b0c10b2-6763-4481-83e2-805380f00c8f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:00.949009 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8b0c10b2-6763-4481-83e2-805380f00c8f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1472 microversion: 2.1 time: 0.484883 Aug 22 17:19:00.959383 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 750/1512] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:00 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1472 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:19:01.700848 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-4a40d5bd-563a-49ea-af02-3a8b2d94fb6a tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.910412 Aug 22 17:19:01.701930 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 763/1513] 10.222.0.96 () {60 vars in 1195 bytes} [Mon Aug 22 17:19:00 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:19:01.721877 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4022857f-d2c1-47fc-be5f-6fb60b5a57c1 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Calling method '.version_select at 0x7f80094ed280>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:01.993873 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9f39d394-fd7f-42fd-8180-6365c7556a9f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:01.994691 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9f39d394-fd7f-42fd-8180-6365c7556a9f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:02.027822 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9f39d394-fd7f-42fd-8180-6365c7556a9f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:02.028839 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9f39d394-fd7f-42fd-8180-6365c7556a9f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:02.038094 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9f39d394-fd7f-42fd-8180-6365c7556a9f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:02.039285 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9f39d394-fd7f-42fd-8180-6365c7556a9f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:02.040190 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9f39d394-fd7f-42fd-8180-6365c7556a9f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:02.041408 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9f39d394-fd7f-42fd-8180-6365c7556a9f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:02.195015 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4022857f-d2c1-47fc-be5f-6fb60b5a57c1 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "GET /compute/v2.1/os-security-groups/3c78678a-036b-4d09-a398-de5aaad54846" status: 200 len: 663 microversion: 2.1 time: 0.478162 Aug 22 17:19:02.207223 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 751/1514] 10.222.0.96 () {58 vars in 1269 bytes} [Mon Aug 22 17:19:01 2022] GET /compute/v2.1/os-security-groups/3c78678a-036b-4d09-a398-de5aaad54846 => generated 663 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:02.231638 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7b711f74-864a-44aa-8ecc-3214642107b9 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Calling method '.version_select at 0x7f8009449670>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:02.905146 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9f39d394-fd7f-42fd-8180-6365c7556a9f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:02.917987 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9f39d394-fd7f-42fd-8180-6365c7556a9f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1472 microversion: 2.1 time: 0.929758 Aug 22 17:19:02.921491 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 764/1515] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:01 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1472 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:03.956495 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-35c39c01-7a61-4077-b4fc-63d78c8d0bd4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:03.960000 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-35c39c01-7a61-4077-b4fc-63d78c8d0bd4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:03.978805 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-35c39c01-7a61-4077-b4fc-63d78c8d0bd4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:03.982906 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-35c39c01-7a61-4077-b4fc-63d78c8d0bd4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:03.983573 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-35c39c01-7a61-4077-b4fc-63d78c8d0bd4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:03.986276 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-35c39c01-7a61-4077-b4fc-63d78c8d0bd4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:03.987514 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-35c39c01-7a61-4077-b4fc-63d78c8d0bd4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:03.988138 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-35c39c01-7a61-4077-b4fc-63d78c8d0bd4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:04.193308 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7b711f74-864a-44aa-8ecc-3214642107b9 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-group-rules/247075df-62a1-45fb-9ba8-c0211058d152" status: 202 len: 0 microversion: 2.1 time: 1.982936 Aug 22 17:19:04.193914 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 752/1516] 10.222.0.96 () {58 vars in 1287 bytes} [Mon Aug 22 17:19:02 2022] DELETE /compute/v2.1/os-security-group-rules/247075df-62a1-45fb-9ba8-c0211058d152 => generated 0 bytes in 1985 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:19:04.206256 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-07498d51-b75e-4dc6-9f22-44e5557919e5 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Calling method '.version_select at 0x7f80094afe50>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:04.462689 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-35c39c01-7a61-4077-b4fc-63d78c8d0bd4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:04.476746 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-35c39c01-7a61-4077-b4fc-63d78c8d0bd4 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1472 microversion: 2.1 time: 0.533756 Aug 22 17:19:04.485917 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 765/1517] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:03 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1472 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:05.502312 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-66a2d447-82bb-442d-8eeb-6fe8222abced tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:05.503001 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-66a2d447-82bb-442d-8eeb-6fe8222abced tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:05.511150 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-66a2d447-82bb-442d-8eeb-6fe8222abced tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:05.511657 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-66a2d447-82bb-442d-8eeb-6fe8222abced tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:05.516360 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-66a2d447-82bb-442d-8eeb-6fe8222abced tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:05.517345 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-66a2d447-82bb-442d-8eeb-6fe8222abced tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:05.526122 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-66a2d447-82bb-442d-8eeb-6fe8222abced tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:05.526714 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-66a2d447-82bb-442d-8eeb-6fe8222abced tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:06.172936 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-66a2d447-82bb-442d-8eeb-6fe8222abced tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:06.206997 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-66a2d447-82bb-442d-8eeb-6fe8222abced tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1472 microversion: 2.1 time: 0.709211 Aug 22 17:19:06.208090 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 766/1518] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:05 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1472 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:19:06.417844 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-07498d51-b75e-4dc6-9f22-44e5557919e5 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/3c78678a-036b-4d09-a398-de5aaad54846" status: 202 len: 0 microversion: 2.1 time: 2.217066 Aug 22 17:19:06.419080 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 753/1519] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:04 2022] DELETE /compute/v2.1/os-security-groups/3c78678a-036b-4d09-a398-de5aaad54846 => generated 0 bytes in 2220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:19:06.433052 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9b65b908-80e1-4523-9ba2-605e94c47e18 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Calling method '.version_select at 0x7f80095bfdc0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:06.500373 n-d-854030-1 devstack@n-api.service[123015]: DEBUG neutronclient.v2_0.client [None req-9b65b908-80e1-4523-9ba2-605e94c47e18 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 32ee093e-3278-4eed-bf07-c1539ee04db2 does not exist", "detail": ""}} {{(pid=123015) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:19:06.501277 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.security_group_api [None req-9b65b908-80e1-4523-9ba2-605e94c47e18 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Neutron security group 32ee093e-3278-4eed-bf07-c1539ee04db2 not found {{(pid=123015) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 22 17:19:06.502077 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-9b65b908-80e1-4523-9ba2-605e94c47e18 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] HTTP exception thrown: Security group 32ee093e-3278-4eed-bf07-c1539ee04db2 does not exist Aug 22 17:19:06.502077 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-f8e66128-37ff-4dd9-9302-551935fd2e0b'] Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9b65b908-80e1-4523-9ba2-605e94c47e18 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Request method failure captured: Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/os-security-groups/32ee093e-3278-4eed-bf07-c1539ee04db2 HTTP/1.1 Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7prPb3onDUv2ldlcuzBT7Rdtakng6rWVWFfZgoNoGRFFQqfZu9Q8jBAFMQ5WJTBUUWZIIINgwlu0jz96JND8kW_AZLlN52YQrcd14wuo3dm4WdF8SWBvCOk3ImPkKPWRFM6xiVF56zRxRreztEsaI5WIAE8idpW_kZdjdoqxTt6U-4 Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: d8ebe6787c6a4883a073558e907a2922 Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-702621292 Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d8ebe6787c6a4883a073558e907a2922"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_d8ebe6787c6a4883a073558e907a2922", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d8ebe6787c6a4883a073558e907a2922"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/d8ebe6787c6a4883a073558e907a2922"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-SecurityGroupRulesTestJSON-702621292 Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: d8ebe6787c6a4883a073558e907a2922 Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-702621292 Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-SecurityGroupRulesTestJSON-702621292-project Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: c91845dfa021454ba4bb3da4fdbb07ee Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-SecurityGroupRulesTestJSON-702621292-project Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: exception: Security group 32ee093e-3278-4eed-bf07-c1539ee04db2 does not exist Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-f8e66128-37ff-4dd9-9302-551935fd2e0b'] Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '32ee093e-3278-4eed-bf07-c1539ee04db2'} Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 22 17:19:06.504493 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 32ee093e-3278-4eed-bf07-c1539ee04db2 does not exist Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8e66128-37ff-4dd9-9302-551935fd2e0b'] Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 32ee093e-3278-4eed-bf07-c1539ee04db2 does not exist Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8e66128-37ff-4dd9-9302-551935fd2e0b'] Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 32ee093e-3278-4eed-bf07-c1539ee04db2 does not exist Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8e66128-37ff-4dd9-9302-551935fd2e0b'] Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 32ee093e-3278-4eed-bf07-c1539ee04db2 does not exist Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8e66128-37ff-4dd9-9302-551935fd2e0b'] Aug 22 17:19:06.510887 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:06.520530 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9b65b908-80e1-4523-9ba2-605e94c47e18 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Returning 404 to user: Security group 32ee093e-3278-4eed-bf07-c1539ee04db2 does not exist Aug 22 17:19:06.520530 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-f8e66128-37ff-4dd9-9302-551935fd2e0b'] {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:06.520530 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9b65b908-80e1-4523-9ba2-605e94c47e18 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/32ee093e-3278-4eed-bf07-c1539ee04db2" status: 404 len: 194 microversion: 2.1 time: 0.091477 Aug 22 17:19:06.520530 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 767/1520] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:06 2022] DELETE /compute/v2.1/os-security-groups/32ee093e-3278-4eed-bf07-c1539ee04db2 => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:19:06.524959 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-49086bd8-13fb-46a3-8e2f-154e0e19bf73 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Calling method '.version_select at 0x7f80094af160>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:07.254087 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c6b575e8-bdac-4843-a2c7-c9def5d5ad3c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:07.263928 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-c6b575e8-bdac-4843-a2c7-c9def5d5ad3c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:07.295441 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c6b575e8-bdac-4843-a2c7-c9def5d5ad3c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:07.298065 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c6b575e8-bdac-4843-a2c7-c9def5d5ad3c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:07.298547 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c6b575e8-bdac-4843-a2c7-c9def5d5ad3c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:07.299307 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c6b575e8-bdac-4843-a2c7-c9def5d5ad3c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:07.302492 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c6b575e8-bdac-4843-a2c7-c9def5d5ad3c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:07.303037 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c6b575e8-bdac-4843-a2c7-c9def5d5ad3c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:07.475438 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=18 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:07.787866 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c6b575e8-bdac-4843-a2c7-c9def5d5ad3c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:07.819354 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c6b575e8-bdac-4843-a2c7-c9def5d5ad3c tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1472 microversion: 2.1 time: 0.577886 Aug 22 17:19:07.827212 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-49086bd8-13fb-46a3-8e2f-154e0e19bf73 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/7831446a-bb84-45f1-9a67-11f27caec6a3" status: 202 len: 0 microversion: 2.1 time: 1.306414 Aug 22 17:19:07.832358 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 754/1521] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:06 2022] DELETE /compute/v2.1/os-security-groups/7831446a-bb84-45f1-9a67-11f27caec6a3 => generated 0 bytes in 1312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:19:07.839133 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 768/1522] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:07 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1472 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:07.860267 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-34520b3d-70f1-4ca6-84f5-cfc812892f37 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Calling method '.version_select at 0x7f80095bf5e0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:08.461290 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c262576c-cb96-4976-bca9-5e953aac3d88 tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] Action: 'create', calling method: .version_select at 0x7f8009449700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-697065767", "metadata": {"Type": "work"}}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:09.083816 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-34520b3d-70f1-4ca6-84f5-cfc812892f37 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/420f64c9-0abb-481b-9cfc-58ad8d37ffc6" status: 202 len: 0 microversion: 2.1 time: 1.242794 Aug 22 17:19:09.085116 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 769/1523] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:07 2022] DELETE /compute/v2.1/os-security-groups/420f64c9-0abb-481b-9cfc-58ad8d37ffc6 => generated 0 bytes in 1245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:19:09.090982 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b6435291-8f77-4751-828d-7aad5a7cb4ab tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:09.091869 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b6435291-8f77-4751-828d-7aad5a7cb4ab tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:09.116754 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6435291-8f77-4751-828d-7aad5a7cb4ab tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:09.117458 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6435291-8f77-4751-828d-7aad5a7cb4ab tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:09.127522 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6435291-8f77-4751-828d-7aad5a7cb4ab tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:09.130132 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6435291-8f77-4751-828d-7aad5a7cb4ab tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:09.137028 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6435291-8f77-4751-828d-7aad5a7cb4ab tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:09.137521 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b6435291-8f77-4751-828d-7aad5a7cb4ab tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:09.725356 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b6435291-8f77-4751-828d-7aad5a7cb4ab tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:09.742982 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b6435291-8f77-4751-828d-7aad5a7cb4ab tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1472 microversion: 2.1 time: 0.656331 Aug 22 17:19:09.746671 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 770/1524] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:09 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1472 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:09.752147 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e29b68e3-a579-4aa3-a30d-2066f572d972 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Calling method '.version_select at 0x7f80096bd820>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:10.341992 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c262576c-cb96-4976-bca9-5e953aac3d88 tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] 10.222.0.96 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.508265 Aug 22 17:19:10.347078 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 755/1525] 10.222.0.96 () {60 vars in 1156 bytes} [Mon Aug 22 17:19:07 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2511 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 22 17:19:10.357264 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-df029af8-5df1-498a-95af-d6922aa2baa6 tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] Calling method '.version_select at 0x7f80096f44c0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:10.475292 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:10.518438 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e29b68e3-a579-4aa3-a30d-2066f572d972 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/d186c929-1787-46a0-972d-e427c5a61362" status: 202 len: 0 microversion: 2.1 time: 0.773147 Aug 22 17:19:10.519350 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 771/1526] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:09 2022] DELETE /compute/v2.1/os-security-groups/d186c929-1787-46a0-972d-e427c5a61362 => generated 0 bytes in 774 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:19:10.529538 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7bdcc127-daf4-43e5-a768-d3d9b110a8a7 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Calling method '.version_select at 0x7f8009a9e940>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:10.576272 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-df029af8-5df1-498a-95af-d6922aa2baa6 tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9" status: 200 len: 352 microversion: 2.1 time: 0.223454 Aug 22 17:19:10.576861 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 756/1527] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:19:10 2022] GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9 => generated 352 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:19:10.769469 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a431b980-ce07-42d1-874f-e1e6450c7384 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:10.770544 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-a431b980-ce07-42d1-874f-e1e6450c7384 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:10.788214 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a431b980-ce07-42d1-874f-e1e6450c7384 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:10.801323 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a431b980-ce07-42d1-874f-e1e6450c7384 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:10.801323 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a431b980-ce07-42d1-874f-e1e6450c7384 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:10.801323 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a431b980-ce07-42d1-874f-e1e6450c7384 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:10.811688 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a431b980-ce07-42d1-874f-e1e6450c7384 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:10.816027 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a431b980-ce07-42d1-874f-e1e6450c7384 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:11.727311 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a431b980-ce07-42d1-874f-e1e6450c7384 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:11.756718 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a431b980-ce07-42d1-874f-e1e6450c7384 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1472 microversion: 2.1 time: 0.990369 Aug 22 17:19:11.760749 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 757/1528] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:10 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1472 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:19:11.776893 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b87b7780-3f4b-4518-8100-226482d7bc92 tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] Calling method '.version_select at 0x7f80094494c0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:11.881132 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b87b7780-3f4b-4518-8100-226482d7bc92 tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9" status: 200 len: 352 microversion: 2.1 time: 0.117793 Aug 22 17:19:11.882240 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 758/1529] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:19:11 2022] GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9 => generated 352 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:11.918474 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7bdcc127-daf4-43e5-a768-d3d9b110a8a7 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/d5ef9875-c91e-4fc4-9ab8-acfe5af0e34f" status: 202 len: 0 microversion: 2.1 time: 1.393216 Aug 22 17:19:11.920105 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 772/1530] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:10 2022] DELETE /compute/v2.1/os-security-groups/d5ef9875-c91e-4fc4-9ab8-acfe5af0e34f => generated 0 bytes in 1396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:19:11.929569 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f45c76b2-ebc8-4ed6-98bb-525d899d50f3 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] Calling method '.version_select at 0x7f800944d790>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:12.789252 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f45c76b2-ebc8-4ed6-98bb-525d899d50f3 tempest-SecurityGroupRulesTestJSON-702621292 tempest-SecurityGroupRulesTestJSON-702621292-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/e0d4e1c8-1268-400f-b8b5-33506b47f25f" status: 202 len: 0 microversion: 2.1 time: 0.863798 Aug 22 17:19:12.790263 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 759/1531] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:11 2022] DELETE /compute/v2.1/os-security-groups/e0d4e1c8-1268-400f-b8b5-33506b47f25f => generated 0 bytes in 865 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:19:12.814332 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5a086ec4-1dce-4aea-bce1-a516c8908c19 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:12.817927 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-5a086ec4-1dce-4aea-bce1-a516c8908c19 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:12.863585 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5a086ec4-1dce-4aea-bce1-a516c8908c19 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:12.881203 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5a086ec4-1dce-4aea-bce1-a516c8908c19 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:12.882141 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5a086ec4-1dce-4aea-bce1-a516c8908c19 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:12.883351 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5a086ec4-1dce-4aea-bce1-a516c8908c19 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:12.884173 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5a086ec4-1dce-4aea-bce1-a516c8908c19 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:12.885960 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5a086ec4-1dce-4aea-bce1-a516c8908c19 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:12.899081 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0bf7063f-f14e-4434-8536-ee7af974cebb tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] Calling method '.version_select at 0x7f80094afee0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:13.120136 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0bf7063f-f14e-4434-8536-ee7af974cebb tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9" status: 200 len: 352 microversion: 2.1 time: 0.228069 Aug 22 17:19:13.121395 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 760/1532] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:19:12 2022] GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9 => generated 352 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:14.139018 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f7a5b02e-0ccb-419a-89ff-e3e7393502db tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] Calling method '.version_select at 0x7f8009449310>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:14.226835 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-5a086ec4-1dce-4aea-bce1-a516c8908c19 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:14.241397 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5a086ec4-1dce-4aea-bce1-a516c8908c19 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1472 microversion: 2.1 time: 1.440663 Aug 22 17:19:14.244749 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 773/1533] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:12 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1472 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:19:14.266898 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f7a5b02e-0ccb-419a-89ff-e3e7393502db tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9" status: 200 len: 353 microversion: 2.1 time: 0.134161 Aug 22 17:19:14.267990 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 761/1534] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:19:14 2022] GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9 => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:14.285602 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e2ce0c67-b263-4dbd-9c15-ba8d8263c911 tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] Calling method '.version_select at 0x7f80095f1f70>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:14.468492 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e2ce0c67-b263-4dbd-9c15-ba8d8263c911 tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9" status: 200 len: 353 microversion: 2.1 time: 0.187819 Aug 22 17:19:14.473809 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 774/1535] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:19:14 2022] GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9 => generated 353 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:14.500673 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-49720ddb-c118-4406-b6fe-b590bf5b81da tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] Calling method '.version_select at 0x7f800944d8b0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:14.890808 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-49720ddb-c118-4406-b6fe-b590bf5b81da tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] 10.222.0.96 "DELETE /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9" status: 202 len: 0 microversion: 2.1 time: 0.403198 Aug 22 17:19:14.896563 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 762/1536] 10.222.0.96 () {58 vars in 1248 bytes} [Mon Aug 22 17:19:14 2022] DELETE /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:19:14.906534 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-db846cf0-1174-4372-bc6f-a17b89b1fd06 tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] Calling method '.version_select at 0x7f80094af670>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:15.017942 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-db846cf0-1174-4372-bc6f-a17b89b1fd06 tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9" status: 200 len: 352 microversion: 2.1 time: 0.122362 Aug 22 17:19:15.018909 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 763/1537] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:19:14 2022] GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9 => generated 352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:19:15.034018 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6d307c70-80b7-49d2-aeb9-3bea637cfb5c tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Action: 'create', calling method: .version_select at 0x7f80096bd040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-70699415", "description": "tempest-description-664184524"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:15.303840 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-dd6ce585-2438-4cd3-acdc-25d782436f29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:15.304480 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-dd6ce585-2438-4cd3-acdc-25d782436f29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:15.320469 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dd6ce585-2438-4cd3-acdc-25d782436f29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:15.321327 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dd6ce585-2438-4cd3-acdc-25d782436f29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:15.323491 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dd6ce585-2438-4cd3-acdc-25d782436f29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:15.324422 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dd6ce585-2438-4cd3-acdc-25d782436f29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:15.333961 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dd6ce585-2438-4cd3-acdc-25d782436f29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:15.333961 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dd6ce585-2438-4cd3-acdc-25d782436f29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:16.025707 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-dd6ce585-2438-4cd3-acdc-25d782436f29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:16.025891 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-dd6ce585-2438-4cd3-acdc-25d782436f29 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1472 microversion: 2.1 time: 0.733950 Aug 22 17:19:16.027999 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 764/1538] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:15 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1472 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:19:16.039808 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7264da68-5630-40cb-aab5-3168d19ad4dd tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] Calling method '.version_select at 0x7f80094ed3a0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:16.229381 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7264da68-5630-40cb-aab5-3168d19ad4dd tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9" status: 200 len: 352 microversion: 2.1 time: 0.197349 Aug 22 17:19:16.229967 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 765/1539] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:19:16 2022] GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9 => generated 352 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:16.739478 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6d307c70-80b7-49d2-aeb9-3bea637cfb5c tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 2.022796 Aug 22 17:19:16.741793 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 775/1540] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:19:14 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 2026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:16.754610 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-3d129282-3f34-4fa9-9b30-afaa304b6bf3 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Action: 'create', calling method: .version_select at 0x7f80094490d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-588979164", "description": "tempest-description-33671720"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:17.066480 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f24f8682-262f-40b4-ad05-2382594159d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:17.067190 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f24f8682-262f-40b4-ad05-2382594159d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:17.079542 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f24f8682-262f-40b4-ad05-2382594159d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:17.080096 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f24f8682-262f-40b4-ad05-2382594159d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:17.080545 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f24f8682-262f-40b4-ad05-2382594159d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:17.081315 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f24f8682-262f-40b4-ad05-2382594159d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:17.081766 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f24f8682-262f-40b4-ad05-2382594159d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:17.082370 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f24f8682-262f-40b4-ad05-2382594159d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:17.783838 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-3d129282-3f34-4fa9-9b30-afaa304b6bf3 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 1.033140 Aug 22 17:19:17.791833 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 766/1541] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:19:16 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:17.804513 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fbe48134-7d8d-42fa-8da0-3d2a2c931011 tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] Calling method '.version_select at 0x7f8009440160>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:18.023974 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-fbe48134-7d8d-42fa-8da0-3d2a2c931011 tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9" status: 200 len: 352 microversion: 2.1 time: 0.227879 Aug 22 17:19:18.024779 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 767/1542] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:19:17 2022] GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9 => generated 352 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:18.030794 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7a7a2d1b-6671-4b66-bc5e-19893297a316 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-59556802", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "93ff4d84-3925-410f-b27a-31a45da33a58"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:18.192420 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-7a7a2d1b-6671-4b66-bc5e-19893297a316 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] validate_networks() for [('93ff4d84-3925-410f-b27a-31a45da33a58', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:19:18.355916 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f24f8682-262f-40b4-ad05-2382594159d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:18.367866 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f24f8682-262f-40b4-ad05-2382594159d0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1472 microversion: 2.1 time: 1.306576 Aug 22 17:19:18.373035 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 776/1543] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:17 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1472 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:19:19.039023 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-771a7db3-d020-49bf-9b95-323c8a024ad5 tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] Calling method '.version_select at 0x7f80092a28b0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-7a7a2d1b-6671-4b66-bc5e-19893297a316 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c41b3d36-606d-440d-87a3-50daf96e3f9d) Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:19:19.139117 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c41b3d36-606d-440d-87a3-50daf96e3f9d) Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-7a7a2d1b-6671-4b66-bc5e-19893297a316 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7a7a2d1b-6671-4b66-bc5e-19893297a316 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Request method failure captured: Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 206 Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7qSEQO9hofsiEsrQtv0pANASwYR5GbXOyj2-c6RXXhcu3-3IdrOWM_wwsTJi0qitTJkjmcRF8d4TgsYkUY-6tbPaXmH4y6dOymWTCnt46SH-KRdFtHdinQb5uFpSAK7xWaSfwiaFHWjb-33JK1M2hKNzHsz6jXXflBTSjWEI_Kc-V8 Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_28bc0eae58274deebf4277b7e3ca10c8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 87888a8417384b18baad12b5c7d8a69d Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-59556802", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "93ff4d84-3925-410f-b27a-31a45da33a58"}]}} Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-SecurityGroupsTestJSON-server-59556802', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '93ff4d84-3925-410f-b27a-31a45da33a58'}]}}} Aug 22 17:19:19.142841 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:19:19.149043 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c41b3d36-606d-440d-87a3-50daf96e3f9d) Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7a7a2d1b-6671-4b66-bc5e-19893297a316 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7a7a2d1b-6671-4b66-bc5e-19893297a316 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.122138 Aug 22 17:19:19.159665 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 768/1544] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:19:18 2022] POST /compute/v2.1/servers => generated 214 bytes in 1124 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:19:19.206979 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-771a7db3-d020-49bf-9b95-323c8a024ad5 tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9" status: 200 len: 352 microversion: 2.1 time: 0.172455 Aug 22 17:19:19.207768 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 777/1545] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:19:19 2022] GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9 => generated 352 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:19:19.224975 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f36b17d0-b6d0-4d94-9b4a-d1b6363e326b tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Action: 'create', calling method: .version_select at 0x7f80094ed9d0>, body: {"security_group": {"name": " tempest-securitygroup -1058366673 ", "description": "tempest-description-2048261335"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:19.417197 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-433f9470-7179-445c-babd-909a6c79cfe0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:19.418390 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-433f9470-7179-445c-babd-909a6c79cfe0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:19.439935 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-433f9470-7179-445c-babd-909a6c79cfe0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:19.441536 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-433f9470-7179-445c-babd-909a6c79cfe0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:19.443940 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-433f9470-7179-445c-babd-909a6c79cfe0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:19.443940 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-433f9470-7179-445c-babd-909a6c79cfe0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:19.443940 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-433f9470-7179-445c-babd-909a6c79cfe0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:19.444814 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-433f9470-7179-445c-babd-909a6c79cfe0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:21.174418 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f36b17d0-b6d0-4d94-9b4a-d1b6363e326b tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 1.984240 Aug 22 17:19:21.189156 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 769/1546] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:19:19 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 1987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:21.220905 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-400be1a9-d7a1-425c-9479-f4ab6e634490 tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] Calling method '.version_select at 0x7f80094af5e0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:21.267089 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-433f9470-7179-445c-babd-909a6c79cfe0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:21.306645 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-433f9470-7179-445c-babd-909a6c79cfe0 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1472 microversion: 2.1 time: 1.893384 Aug 22 17:19:21.319622 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 778/1547] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:19 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1472 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:21.352942 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9f626c18-fbd6-4fe4-a39a-80e58d1ce073 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f80092a2f70>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:21.374981 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-400be1a9-d7a1-425c-9479-f4ab6e634490 tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] HTTP exception thrown: Volume 1991a877-4f57-474f-ab6d-0f38ca30f3e9 could not be found. Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-400be1a9-d7a1-425c-9479-f4ab6e634490 tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] Request method failure captured: Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9 HTTP/1.1 Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7qL0KRSmL2IBh40bUKpdyIH-NHYNe8B93SWzM5U9fKeWxB1Wo3IpRlrxk0qjEWcALlzKqGnAZJGM8m6Cmoq0ofyOHzzx4vb45IMTcdn92xkcmU5tM64luALNHOzJ8wHrkYbfOD7sCeKNOTb1xEat4fAFUvtJFqnAFNShzyTg0PFVJM Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 9e9493e483cd4dbbb3746a004342dbc9 Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-VolumesGetTestJSON-15005233 Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9e9493e483cd4dbbb3746a004342dbc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_9e9493e483cd4dbbb3746a004342dbc9", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/9e9493e483cd4dbbb3746a004342dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/9e9493e483cd4dbbb3746a004342dbc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-VolumesGetTestJSON-15005233 Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 9e9493e483cd4dbbb3746a004342dbc9 Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-VolumesGetTestJSON-15005233 Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-VolumesGetTestJSON-15005233-project Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 75afc02f11884d648f9ad7a1bacfee8b Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-VolumesGetTestJSON-15005233-project Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: exception: Volume 1991a877-4f57-474f-ab6d-0f38ca30f3e9 could not be found. Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '1991a877-4f57-474f-ab6d-0f38ca30f3e9'} Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1991a877-4f57-474f-ab6d-0f38ca30f3e9 could not be found. (HTTP 404) (Request-ID: req-558bfcc2-b136-4533-95e9-1793e685c603) Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 17:19:21.414594 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1991a877-4f57-474f-ab6d-0f38ca30f3e9 could not be found. Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1991a877-4f57-474f-ab6d-0f38ca30f3e9 could not be found. Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1991a877-4f57-474f-ab6d-0f38ca30f3e9 could not be found. Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-400be1a9-d7a1-425c-9479-f4ab6e634490 tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] Returning 404 to user: Volume 1991a877-4f57-474f-ab6d-0f38ca30f3e9 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-400be1a9-d7a1-425c-9479-f4ab6e634490 tempest-VolumesGetTestJSON-15005233 tempest-VolumesGetTestJSON-15005233-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9" status: 404 len: 109 microversion: 2.1 time: 0.204240 Aug 22 17:19:21.429554 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 770/1548] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:19:21 2022] GET /compute/v2.1/os-volumes/1991a877-4f57-474f-ab6d-0f38ca30f3e9 => generated 109 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:19:22.057718 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9f626c18-fbd6-4fe4-a39a-80e58d1ce073 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "GET /compute/v2.1/os-security-groups/c6573121-dc1e-4133-b88a-60996d06284e" status: 200 len: 224 microversion: 2.1 time: 0.732740 Aug 22 17:19:22.059712 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 779/1549] 10.222.0.96 () {58 vars in 1269 bytes} [Mon Aug 22 17:19:21 2022] GET /compute/v2.1/os-security-groups/c6573121-dc1e-4133-b88a-60996d06284e => generated 224 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:22.076222 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d929851c-9dd2-4e4d-a44e-d03c645fd951 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f8009440b80>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:22.343467 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e0eb32a1-235b-4a83-aa57-ff6d64bc14df tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:22.345025 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-e0eb32a1-235b-4a83-aa57-ff6d64bc14df tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:22.366271 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=20 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:22.373238 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e0eb32a1-235b-4a83-aa57-ff6d64bc14df tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:22.375260 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e0eb32a1-235b-4a83-aa57-ff6d64bc14df tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:22.379629 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e0eb32a1-235b-4a83-aa57-ff6d64bc14df tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:22.385063 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e0eb32a1-235b-4a83-aa57-ff6d64bc14df tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:22.405680 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e0eb32a1-235b-4a83-aa57-ff6d64bc14df tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:22.407874 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e0eb32a1-235b-4a83-aa57-ff6d64bc14df tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:23.089070 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d929851c-9dd2-4e4d-a44e-d03c645fd951 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/c6573121-dc1e-4133-b88a-60996d06284e" status: 202 len: 0 microversion: 2.1 time: 1.019135 Aug 22 17:19:23.090445 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 771/1550] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:22 2022] DELETE /compute/v2.1/os-security-groups/c6573121-dc1e-4133-b88a-60996d06284e => generated 0 bytes in 1022 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:19:23.102148 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9b65babb-0905-4064-be3d-c28f1f92288c tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f80093c6670>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:23.215602 n-d-854030-1 devstack@n-api.service[123016]: DEBUG neutronclient.v2_0.client [None req-9b65babb-0905-4064-be3d-c28f1f92288c tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c6573121-dc1e-4133-b88a-60996d06284e does not exist", "detail": ""}} {{(pid=123016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:19:23.216942 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.security_group_api [None req-9b65babb-0905-4064-be3d-c28f1f92288c tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Neutron security group c6573121-dc1e-4133-b88a-60996d06284e not found {{(pid=123016) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 22 17:19:23.218446 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-9b65babb-0905-4064-be3d-c28f1f92288c tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] HTTP exception thrown: Security group c6573121-dc1e-4133-b88a-60996d06284e does not exist Aug 22 17:19:23.218446 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-3fc705d4-2fd8-45db-9b58-22bb003337e8'] Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9b65babb-0905-4064-be3d-c28f1f92288c tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Request method failure captured: Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-security-groups/c6573121-dc1e-4133-b88a-60996d06284e HTTP/1.1 Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7qSEQO9hofsiEsrQtv0pANASwYR5GbXOyj2-c6RXXhcu3-3IdrOWM_wwsTJi0qitTJkjmcRF8d4TgsYkUY-6tbPaXmH4y6dOymWTCnt46SH-KRdFtHdinQb5uFpSAK7xWaSfwiaFHWjb-33JK1M2hKNzHsz6jXXflBTSjWEI_Kc-V8 Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_28bc0eae58274deebf4277b7e3ca10c8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 87888a8417384b18baad12b5c7d8a69d Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: exception: Security group c6573121-dc1e-4133-b88a-60996d06284e does not exist Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-3fc705d4-2fd8-45db-9b58-22bb003337e8'] Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'c6573121-dc1e-4133-b88a-60996d06284e'} Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 22 17:19:23.232557 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c6573121-dc1e-4133-b88a-60996d06284e does not exist Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fc705d4-2fd8-45db-9b58-22bb003337e8'] Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c6573121-dc1e-4133-b88a-60996d06284e does not exist Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fc705d4-2fd8-45db-9b58-22bb003337e8'] Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c6573121-dc1e-4133-b88a-60996d06284e does not exist Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fc705d4-2fd8-45db-9b58-22bb003337e8'] Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c6573121-dc1e-4133-b88a-60996d06284e does not exist Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fc705d4-2fd8-45db-9b58-22bb003337e8'] Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9b65babb-0905-4064-be3d-c28f1f92288c tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Returning 404 to user: Security group c6573121-dc1e-4133-b88a-60996d06284e does not exist Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-3fc705d4-2fd8-45db-9b58-22bb003337e8'] {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9b65babb-0905-4064-be3d-c28f1f92288c tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "GET /compute/v2.1/os-security-groups/c6573121-dc1e-4133-b88a-60996d06284e" status: 404 len: 194 microversion: 2.1 time: 0.129993 Aug 22 17:19:23.236287 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 772/1551] 10.222.0.96 () {58 vars in 1269 bytes} [Mon Aug 22 17:19:23 2022] GET /compute/v2.1/os-security-groups/c6573121-dc1e-4133-b88a-60996d06284e => generated 194 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:19:23.243673 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-dabe1722-edb4-49ad-9a90-37815d4e0d7a tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Action: 'create', calling method: .version_select at 0x7f8009440f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-887089464", "description": "tempest-description-985158476"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:23.545044 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e0eb32a1-235b-4a83-aa57-ff6d64bc14df tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:23.572409 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e0eb32a1-235b-4a83-aa57-ff6d64bc14df tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1478 microversion: 2.1 time: 1.232457 Aug 22 17:19:23.573287 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 780/1552] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:22 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1478 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:19:23.683728 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-c43b0aff-a3f4-4d66-93a2-e5f0fd5518ec req-80ef26fe-6692-4a72-aa3e-a4139f0e4d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4961b018-19fe-4ddf-8b18-1f392dc1a893", "name": "network-vif-unplugged", "status": "completed", "tag": "83c67bcc-3180-44e8-84d7-e8a3bfa77f5e"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:23.708405 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-c43b0aff-a3f4-4d66-93a2-e5f0fd5518ec req-80ef26fe-6692-4a72-aa3e-a4139f0e4d5a service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:23.709296 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-c43b0aff-a3f4-4d66-93a2-e5f0fd5518ec req-80ef26fe-6692-4a72-aa3e-a4139f0e4d5a service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:23.710360 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-c43b0aff-a3f4-4d66-93a2-e5f0fd5518ec req-80ef26fe-6692-4a72-aa3e-a4139f0e4d5a service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:23.734770 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-c43b0aff-a3f4-4d66-93a2-e5f0fd5518ec req-80ef26fe-6692-4a72-aa3e-a4139f0e4d5a service nova] Creating event network-vif-unplugged:83c67bcc-3180-44e8-84d7-e8a3bfa77f5e for instance 4961b018-19fe-4ddf-8b18-1f392dc1a893 on n-h2-854030-1 Aug 22 17:19:23.743982 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-c43b0aff-a3f4-4d66-93a2-e5f0fd5518ec req-80ef26fe-6692-4a72-aa3e-a4139f0e4d5a service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068361 Aug 22 17:19:23.745565 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 781/1553] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:24.200649 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-dabe1722-edb4-49ad-9a90-37815d4e0d7a tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.964577 Aug 22 17:19:24.203520 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 773/1554] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:19:23 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:24.219640 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7ab2be06-0b49-4d1e-af77-3761c0525b52 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Action: 'create', calling method: .version_select at 0x7f80096e0430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-121849261", "description": "tempest-description-1011908531"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:24.601301 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e2941577-dec8-42e2-9f43-24da24fcaa68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:24.612794 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e2941577-dec8-42e2-9f43-24da24fcaa68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:24.612794 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e2941577-dec8-42e2-9f43-24da24fcaa68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:24.612794 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e2941577-dec8-42e2-9f43-24da24fcaa68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:24.612794 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e2941577-dec8-42e2-9f43-24da24fcaa68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:24.612794 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e2941577-dec8-42e2-9f43-24da24fcaa68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:24.612794 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e2941577-dec8-42e2-9f43-24da24fcaa68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:24.612794 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e2941577-dec8-42e2-9f43-24da24fcaa68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:25.172422 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e2941577-dec8-42e2-9f43-24da24fcaa68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:25.190932 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e2941577-dec8-42e2-9f43-24da24fcaa68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1478 microversion: 2.1 time: 0.594531 Aug 22 17:19:25.196578 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 774/1555] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:24 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1478 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:25.634693 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7ab2be06-0b49-4d1e-af77-3761c0525b52 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.422271 Aug 22 17:19:25.636424 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 782/1556] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:19:24 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:25.649542 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ba330336-b7d3-4646-843b-7b0b20a9dd34 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Action: 'create', calling method: .version_select at 0x7f8009470430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-975471168", "description": "tempest-description-251764087"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:26.219713 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0a1afe60-c597-4fcc-8708-6d84471b894b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:26.221215 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0a1afe60-c597-4fcc-8708-6d84471b894b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:26.244134 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0a1afe60-c597-4fcc-8708-6d84471b894b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:26.244908 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0a1afe60-c597-4fcc-8708-6d84471b894b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:26.245609 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0a1afe60-c597-4fcc-8708-6d84471b894b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:26.254268 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0a1afe60-c597-4fcc-8708-6d84471b894b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:26.254268 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0a1afe60-c597-4fcc-8708-6d84471b894b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:26.255727 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0a1afe60-c597-4fcc-8708-6d84471b894b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:26.358302 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=63 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:27.192733 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0a1afe60-c597-4fcc-8708-6d84471b894b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:27.204555 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0a1afe60-c597-4fcc-8708-6d84471b894b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1478 microversion: 2.1 time: 0.990320 Aug 22 17:19:27.221244 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 783/1557] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:26 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1478 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:27.632869 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ba330336-b7d3-4646-843b-7b0b20a9dd34 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.987340 Aug 22 17:19:27.634534 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 775/1558] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:19:25 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:27.668807 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9c75485d-a0f3-4f85-a920-289069344d41 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f800925a160>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:28.246516 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4687b975-2b9d-4d1b-8487-f1a9cc4651a3 tempest-ServerRescueTestJSONUnderV235-1979584174 tempest-ServerRescueTestJSONUnderV235-1979584174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1025204172", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:28.416549 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-4687b975-2b9d-4d1b-8487-f1a9cc4651a3 tempest-ServerRescueTestJSONUnderV235-1979584174 tempest-ServerRescueTestJSONUnderV235-1979584174-project] validate_networks() for [('a30dcab0-1c14-479c-b7a8-1ee7c5f282e0', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-4687b975-2b9d-4d1b-8487-f1a9cc4651a3 tempest-ServerRescueTestJSONUnderV235-1979584174 tempest-ServerRescueTestJSONUnderV235-1979584174-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-58bb24ec-6694-4bab-b997-9bab431b7823) Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:19:29.276758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:19:29.279868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:19:29.279868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:19:29.279868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:19:29.279868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:19:29.279868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:19:29.279868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:19:29.279868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:19:29.279868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:19:29.279868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:19:29.279868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:19:29.279868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:19:29.279868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:19:29.279868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:19:29.279868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:19:29.279868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:19:29.279868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-58bb24ec-6694-4bab-b997-9bab431b7823) Aug 22 17:19:29.279868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:29.283951 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-4687b975-2b9d-4d1b-8487-f1a9cc4651a3 tempest-ServerRescueTestJSONUnderV235-1979584174 tempest-ServerRescueTestJSONUnderV235-1979584174-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:29.283951 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4687b975-2b9d-4d1b-8487-f1a9cc4651a3 tempest-ServerRescueTestJSONUnderV235-1979584174 tempest-ServerRescueTestJSONUnderV235-1979584174-project] Request method failure captured: Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 247 Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7qfsiZmfVBoS-Q-wkgAZ68ZJM7KAlb0uXS2fuqLLpyt9HNDBEe0aTlO44WHKfT9WBBuhXnjXHx-8iz7ujq7bRuHH_rkh26pW4SCrh7Jn0PwGRG_n2Y7DKps5Oi58tpM3ssYH12sbB330ZVxesHKdI3GzbrxJiV5LWhzMnuE_YsXl4Y Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: c7f9d58f52004d70843fac1bd0c10b05 Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1979584174 Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c7f9d58f52004d70843fac1bd0c10b05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_c7f9d58f52004d70843fac1bd0c10b05", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c7f9d58f52004d70843fac1bd0c10b05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/c7f9d58f52004d70843fac1bd0c10b05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1979584174 Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: c7f9d58f52004d70843fac1bd0c10b05 Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1979584174 Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServerRescueTestJSONUnderV235-1979584174-project Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 3d5cdb0606564ad799a9344ab4237719 Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1979584174-project Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1025204172", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "D6*v16n5ZN7+49R", "networks": [{"uuid": "a30dcab0-1c14-479c-b7a8-1ee7c5f282e0"}]}} Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-ServerRescueTestJSONUnderV235-server-1025204172', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'adminPass': 'D6*v16n5ZN7+49R', 'networks': [{'uuid': 'a30dcab0-1c14-479c-b7a8-1ee7c5f282e0'}]}}} Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:19:29.286270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-58bb24ec-6694-4bab-b997-9bab431b7823) Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:29.291318 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:19:29.295513 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:19:29.295513 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:29.295513 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:29.295513 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:29.295513 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:29.295513 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:29.295513 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:29.295513 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:29.295513 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:29.295513 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:29.295513 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:29.295513 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:29.295513 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:29.295513 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:29.295513 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4687b975-2b9d-4d1b-8487-f1a9cc4651a3 tempest-ServerRescueTestJSONUnderV235-1979584174 tempest-ServerRescueTestJSONUnderV235-1979584174-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:29.295513 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:29.295513 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4687b975-2b9d-4d1b-8487-f1a9cc4651a3 tempest-ServerRescueTestJSONUnderV235-1979584174 tempest-ServerRescueTestJSONUnderV235-1979584174-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.417627 Aug 22 17:19:29.295513 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 776/1559] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:19:27 2022] POST /compute/v2.1/servers => generated 214 bytes in 1419 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 22 17:19:29.307348 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-beb67fb3-bf95-4fde-90c4-48c5447623bc tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:29.308367 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-beb67fb3-bf95-4fde-90c4-48c5447623bc tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:29.338257 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-beb67fb3-bf95-4fde-90c4-48c5447623bc tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:29.338791 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-beb67fb3-bf95-4fde-90c4-48c5447623bc tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:29.340019 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-beb67fb3-bf95-4fde-90c4-48c5447623bc tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:29.340019 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-beb67fb3-bf95-4fde-90c4-48c5447623bc tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:29.340408 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-beb67fb3-bf95-4fde-90c4-48c5447623bc tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:29.340849 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-beb67fb3-bf95-4fde-90c4-48c5447623bc tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:29.804575 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-beb67fb3-bf95-4fde-90c4-48c5447623bc tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:29.832518 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-beb67fb3-bf95-4fde-90c4-48c5447623bc tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1478 microversion: 2.1 time: 0.532091 Aug 22 17:19:29.845046 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 777/1560] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:29 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1478 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:29.864312 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-199436b4-7d5f-480b-9353-829180e2cf77 req-e43fe048-b122-4a4c-872d-262a296f5c33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4961b018-19fe-4ddf-8b18-1f392dc1a893", "name": "network-vif-plugged", "status": "completed", "tag": "83c67bcc-3180-44e8-84d7-e8a3bfa77f5e"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:29.902291 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-199436b4-7d5f-480b-9353-829180e2cf77 req-e43fe048-b122-4a4c-872d-262a296f5c33 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:29.913585 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-199436b4-7d5f-480b-9353-829180e2cf77 req-e43fe048-b122-4a4c-872d-262a296f5c33 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:29.914528 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-199436b4-7d5f-480b-9353-829180e2cf77 req-e43fe048-b122-4a4c-872d-262a296f5c33 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:29.951822 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-199436b4-7d5f-480b-9353-829180e2cf77 req-e43fe048-b122-4a4c-872d-262a296f5c33 service nova] Creating event network-vif-plugged:83c67bcc-3180-44e8-84d7-e8a3bfa77f5e for instance 4961b018-19fe-4ddf-8b18-1f392dc1a893 on n-h2-854030-1 Aug 22 17:19:29.972513 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-199436b4-7d5f-480b-9353-829180e2cf77 req-e43fe048-b122-4a4c-872d-262a296f5c33 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113797 Aug 22 17:19:29.976573 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 778/1561] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:30.050646 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9c75485d-a0f3-4f85-a920-289069344d41 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "GET /compute/v2.1/os-security-groups" status: 200 len: 1826 microversion: 2.1 time: 2.407057 Aug 22 17:19:30.053189 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 784/1562] 10.222.0.96 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:27 2022] GET /compute/v2.1/os-security-groups => generated 1826 bytes in 2410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:30.070380 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ea5af1d8-8c29-4cf8-8e93-59e14dafcfbc tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f80094a8430>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:30.831134 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ea5af1d8-8c29-4cf8-8e93-59e14dafcfbc tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/6831381d-47f7-4888-ac68-c29e8a2a8686" status: 202 len: 0 microversion: 2.1 time: 0.765536 Aug 22 17:19:30.834913 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 779/1563] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:30 2022] DELETE /compute/v2.1/os-security-groups/6831381d-47f7-4888-ac68-c29e8a2a8686 => generated 0 bytes in 770 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:19:30.841797 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d3ec269e-a290-4efe-ac80-9efe84d41fdd tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f800924bc10>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:30.863202 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6667fdef-fa0f-4a43-80bb-d189df13f608 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:30.864146 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-6667fdef-fa0f-4a43-80bb-d189df13f608 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:30.875273 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6667fdef-fa0f-4a43-80bb-d189df13f608 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:30.880984 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6667fdef-fa0f-4a43-80bb-d189df13f608 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:30.884766 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6667fdef-fa0f-4a43-80bb-d189df13f608 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:30.885594 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6667fdef-fa0f-4a43-80bb-d189df13f608 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:30.888314 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6667fdef-fa0f-4a43-80bb-d189df13f608 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:30.892807 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6667fdef-fa0f-4a43-80bb-d189df13f608 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:31.357735 n-d-854030-1 devstack@n-api.service[123015]: DEBUG neutronclient.v2_0.client [None req-d3ec269e-a290-4efe-ac80-9efe84d41fdd tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6831381d-47f7-4888-ac68-c29e8a2a8686 does not exist", "detail": ""}} {{(pid=123015) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:19:31.359819 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.security_group_api [None req-d3ec269e-a290-4efe-ac80-9efe84d41fdd tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Neutron security group 6831381d-47f7-4888-ac68-c29e8a2a8686 not found {{(pid=123015) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 22 17:19:31.360549 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-d3ec269e-a290-4efe-ac80-9efe84d41fdd tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] HTTP exception thrown: Security group 6831381d-47f7-4888-ac68-c29e8a2a8686 does not exist Aug 22 17:19:31.360549 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-4ace8c05-6518-451d-b9a5-7549a671b5c3'] Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d3ec269e-a290-4efe-ac80-9efe84d41fdd tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Request method failure captured: Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-security-groups/6831381d-47f7-4888-ac68-c29e8a2a8686 HTTP/1.1 Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7qSEQO9hofsiEsrQtv0pANASwYR5GbXOyj2-c6RXXhcu3-3IdrOWM_wwsTJi0qitTJkjmcRF8d4TgsYkUY-6tbPaXmH4y6dOymWTCnt46SH-KRdFtHdinQb5uFpSAK7xWaSfwiaFHWjb-33JK1M2hKNzHsz6jXXflBTSjWEI_Kc-V8 Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_28bc0eae58274deebf4277b7e3ca10c8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 87888a8417384b18baad12b5c7d8a69d Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: exception: Security group 6831381d-47f7-4888-ac68-c29e8a2a8686 does not exist Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-4ace8c05-6518-451d-b9a5-7549a671b5c3'] Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '6831381d-47f7-4888-ac68-c29e8a2a8686'} Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 22 17:19:31.363717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6831381d-47f7-4888-ac68-c29e8a2a8686 does not exist Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ace8c05-6518-451d-b9a5-7549a671b5c3'] Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6831381d-47f7-4888-ac68-c29e8a2a8686 does not exist Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ace8c05-6518-451d-b9a5-7549a671b5c3'] Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6831381d-47f7-4888-ac68-c29e8a2a8686 does not exist Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ace8c05-6518-451d-b9a5-7549a671b5c3'] Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6831381d-47f7-4888-ac68-c29e8a2a8686 does not exist Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ace8c05-6518-451d-b9a5-7549a671b5c3'] Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d3ec269e-a290-4efe-ac80-9efe84d41fdd tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Returning 404 to user: Security group 6831381d-47f7-4888-ac68-c29e8a2a8686 does not exist Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-4ace8c05-6518-451d-b9a5-7549a671b5c3'] {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d3ec269e-a290-4efe-ac80-9efe84d41fdd tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "GET /compute/v2.1/os-security-groups/6831381d-47f7-4888-ac68-c29e8a2a8686" status: 404 len: 194 microversion: 2.1 time: 0.529988 Aug 22 17:19:31.372366 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 785/1564] 10.222.0.96 () {58 vars in 1269 bytes} [Mon Aug 22 17:19:30 2022] GET /compute/v2.1/os-security-groups/6831381d-47f7-4888-ac68-c29e8a2a8686 => generated 194 bytes in 534 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:19:31.395781 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7966903c-5d75-4b9e-a268-b5b565b3acb5 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f80095fc700>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:31.547439 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-6667fdef-fa0f-4a43-80bb-d189df13f608 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:31.560859 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-6667fdef-fa0f-4a43-80bb-d189df13f608 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1478 microversion: 2.1 time: 0.700395 Aug 22 17:19:31.564089 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 780/1565] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:30 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1478 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:32.587389 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b4651f58-c311-4768-9de6-a3eebde1d2bd tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:32.588540 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b4651f58-c311-4768-9de6-a3eebde1d2bd tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:32.605810 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b4651f58-c311-4768-9de6-a3eebde1d2bd tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:32.606410 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b4651f58-c311-4768-9de6-a3eebde1d2bd tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:32.610818 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b4651f58-c311-4768-9de6-a3eebde1d2bd tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:32.611901 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b4651f58-c311-4768-9de6-a3eebde1d2bd tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:32.612570 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b4651f58-c311-4768-9de6-a3eebde1d2bd tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:32.613842 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b4651f58-c311-4768-9de6-a3eebde1d2bd tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:32.928314 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b4651f58-c311-4768-9de6-a3eebde1d2bd tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:32.937717 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b4651f58-c311-4768-9de6-a3eebde1d2bd tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1463 microversion: 2.1 time: 0.356966 Aug 22 17:19:32.938309 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 781/1566] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:32 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1463 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:32.972422 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-83ffe172-9037-42b5-b8d9-d2275734b529 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:32.982710 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-83ffe172-9037-42b5-b8d9-d2275734b529 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:33.014383 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83ffe172-9037-42b5-b8d9-d2275734b529 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:33.024720 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83ffe172-9037-42b5-b8d9-d2275734b529 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:33.025479 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83ffe172-9037-42b5-b8d9-d2275734b529 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:33.028918 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83ffe172-9037-42b5-b8d9-d2275734b529 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:33.031465 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83ffe172-9037-42b5-b8d9-d2275734b529 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:33.036452 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83ffe172-9037-42b5-b8d9-d2275734b529 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:33.261042 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7966903c-5d75-4b9e-a268-b5b565b3acb5 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/76a64906-add8-4042-9724-d4043cb7fd08" status: 202 len: 0 microversion: 2.1 time: 1.888204 Aug 22 17:19:33.267030 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 786/1567] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:31 2022] DELETE /compute/v2.1/os-security-groups/76a64906-add8-4042-9724-d4043cb7fd08 => generated 0 bytes in 1895 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:19:33.277620 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a1cc883e-feee-4129-b8da-9b6faf516c82 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f800925a040>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:33.385825 n-d-854030-1 devstack@n-api.service[123015]: DEBUG neutronclient.v2_0.client [None req-a1cc883e-feee-4129-b8da-9b6faf516c82 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 76a64906-add8-4042-9724-d4043cb7fd08 does not exist", "detail": ""}} {{(pid=123015) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:19:33.386504 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.security_group_api [None req-a1cc883e-feee-4129-b8da-9b6faf516c82 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Neutron security group 76a64906-add8-4042-9724-d4043cb7fd08 not found {{(pid=123015) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 22 17:19:33.392095 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-83ffe172-9037-42b5-b8d9-d2275734b529 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893/action" status: 202 len: 0 microversion: 2.1 time: 0.423945 Aug 22 17:19:33.392224 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-a1cc883e-feee-4129-b8da-9b6faf516c82 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] HTTP exception thrown: Security group 76a64906-add8-4042-9724-d4043cb7fd08 does not exist Aug 22 17:19:33.392224 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-a1a36447-ea7d-4add-bbfa-8bd91e8b459c'] Aug 22 17:19:33.394448 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 782/1568] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:19:32 2022] POST /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a1cc883e-feee-4129-b8da-9b6faf516c82 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Request method failure captured: Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-security-groups/76a64906-add8-4042-9724-d4043cb7fd08 HTTP/1.1 Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7qSEQO9hofsiEsrQtv0pANASwYR5GbXOyj2-c6RXXhcu3-3IdrOWM_wwsTJi0qitTJkjmcRF8d4TgsYkUY-6tbPaXmH4y6dOymWTCnt46SH-KRdFtHdinQb5uFpSAK7xWaSfwiaFHWjb-33JK1M2hKNzHsz6jXXflBTSjWEI_Kc-V8 Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_28bc0eae58274deebf4277b7e3ca10c8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 87888a8417384b18baad12b5c7d8a69d Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: exception: Security group 76a64906-add8-4042-9724-d4043cb7fd08 does not exist Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-a1a36447-ea7d-4add-bbfa-8bd91e8b459c'] Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '76a64906-add8-4042-9724-d4043cb7fd08'} Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 22 17:19:33.401909 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 76a64906-add8-4042-9724-d4043cb7fd08 does not exist Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1a36447-ea7d-4add-bbfa-8bd91e8b459c'] Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 76a64906-add8-4042-9724-d4043cb7fd08 does not exist Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1a36447-ea7d-4add-bbfa-8bd91e8b459c'] Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 76a64906-add8-4042-9724-d4043cb7fd08 does not exist Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1a36447-ea7d-4add-bbfa-8bd91e8b459c'] Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 76a64906-add8-4042-9724-d4043cb7fd08 does not exist Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1a36447-ea7d-4add-bbfa-8bd91e8b459c'] Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a1cc883e-feee-4129-b8da-9b6faf516c82 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Returning 404 to user: Security group 76a64906-add8-4042-9724-d4043cb7fd08 does not exist Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: Neutron server returns request_ids: ['req-a1a36447-ea7d-4add-bbfa-8bd91e8b459c'] {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a1cc883e-feee-4129-b8da-9b6faf516c82 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "GET /compute/v2.1/os-security-groups/76a64906-add8-4042-9724-d4043cb7fd08" status: 404 len: 194 microversion: 2.1 time: 0.135272 Aug 22 17:19:33.412818 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 787/1569] 10.222.0.96 () {58 vars in 1269 bytes} [Mon Aug 22 17:19:33 2022] GET /compute/v2.1/os-security-groups/76a64906-add8-4042-9724-d4043cb7fd08 => generated 194 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:19:33.418062 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0d1a8615-3a89-4c19-801a-52c09c95a7d8 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:33.420976 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-0d1a8615-3a89-4c19-801a-52c09c95a7d8 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:33.428985 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-eae60dfa-7fd4-456a-9528-55f489385a76 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f800924bb80>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:33.443614 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d1a8615-3a89-4c19-801a-52c09c95a7d8 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:33.447369 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d1a8615-3a89-4c19-801a-52c09c95a7d8 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:33.448010 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d1a8615-3a89-4c19-801a-52c09c95a7d8 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:33.455154 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d1a8615-3a89-4c19-801a-52c09c95a7d8 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:33.458791 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d1a8615-3a89-4c19-801a-52c09c95a7d8 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:33.459436 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d1a8615-3a89-4c19-801a-52c09c95a7d8 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:33.472721 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:33.553806 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d1a8615-3a89-4c19-801a-52c09c95a7d8 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:33.555493 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d1a8615-3a89-4c19-801a-52c09c95a7d8 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:33.559570 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-0d1a8615-3a89-4c19-801a-52c09c95a7d8 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:33.560057 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-0d1a8615-3a89-4c19-801a-52c09c95a7d8 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lazy-loading 'fault' on Instance uuid 4961b018-19fe-4ddf-8b18-1f392dc1a893 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:19:33.760836 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0d1a8615-3a89-4c19-801a-52c09c95a7d8 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1597 microversion: 2.1 time: 0.361800 Aug 22 17:19:33.762928 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 783/1570] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:33 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1597 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:33.786884 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-3ebe93a2-0385-4493-b431-b813c5765779 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:33.789156 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-3ebe93a2-0385-4493-b431-b813c5765779 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:33.805449 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3ebe93a2-0385-4493-b431-b813c5765779 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:33.806063 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3ebe93a2-0385-4493-b431-b813c5765779 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:33.806509 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3ebe93a2-0385-4493-b431-b813c5765779 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:33.807244 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3ebe93a2-0385-4493-b431-b813c5765779 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:33.807702 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3ebe93a2-0385-4493-b431-b813c5765779 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:33.808137 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3ebe93a2-0385-4493-b431-b813c5765779 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:34.337129 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-3ebe93a2-0385-4493-b431-b813c5765779 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893/action" status: 202 len: 0 microversion: 2.1 time: 0.555139 Aug 22 17:19:34.337984 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 784/1571] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:19:33 2022] POST /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:19:34.737202 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9f26e15a-3b95-4460-bde0-69846fa36126 tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] Action: 'create', calling method: .version_select at 0x7f80093c6700>, body: {"keypair": {"name": "tempest-keypair-1158608384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzhlITY5XRs8o0d1W0ElgKQHpwNcfIBNAJpuVByBUpY6lBELMQixN4cVJVoWnu67N/min89qMZgcSTodlSLVSppyiosiS+YDD09n9ZDvmdqqxgUyOUsezppdLPF9UxMQA=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:34.772363 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-9f26e15a-3b95-4460-bde0-69846fa36126 tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] Getting quotas for project 98ea4e0e0f7e46e0b7920256194c82d4. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:19:34.787862 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-9f26e15a-3b95-4460-bde0-69846fa36126 tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] Getting quotas for user 5cc533ed8b2e49aa936dc5002399f632 and project 98ea4e0e0f7e46e0b7920256194c82d4. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:19:34.912501 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-eae60dfa-7fd4-456a-9528-55f489385a76 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d" status: 202 len: 0 microversion: 2.1 time: 1.499236 Aug 22 17:19:34.914392 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 788/1572] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:33 2022] DELETE /compute/v2.1/os-security-groups/0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d => generated 0 bytes in 1502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:19:34.919865 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6515ec4f-31b0-476f-b92b-1d2e7f510507 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:34.921286 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-6515ec4f-31b0-476f-b92b-1d2e7f510507 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:34.946888 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9f26e15a-3b95-4460-bde0-69846fa36126 tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.607386 Aug 22 17:19:34.947720 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 785/1573] 10.222.0.96 () {62 vars in 1200 bytes} [Mon Aug 22 17:19:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 609 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 22 17:19:34.953518 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e1385242-1482-4bfd-899e-aba86600a9c8 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f8009440700>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:34.978206 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6515ec4f-31b0-476f-b92b-1d2e7f510507 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:34.979539 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6515ec4f-31b0-476f-b92b-1d2e7f510507 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:34.980395 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6515ec4f-31b0-476f-b92b-1d2e7f510507 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:34.981956 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6515ec4f-31b0-476f-b92b-1d2e7f510507 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:35.007244 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6515ec4f-31b0-476f-b92b-1d2e7f510507 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:35.012842 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6515ec4f-31b0-476f-b92b-1d2e7f510507 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:35.023923 n-d-854030-1 devstack@n-api.service[123016]: DEBUG neutronclient.v2_0.client [None req-e1385242-1482-4bfd-899e-aba86600a9c8 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d does not exist", "detail": ""}} {{(pid=123016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:19:35.025033 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.security_group_api [None req-e1385242-1482-4bfd-899e-aba86600a9c8 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Neutron security group 0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d not found {{(pid=123016) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 22 17:19:35.025618 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-e1385242-1482-4bfd-899e-aba86600a9c8 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] HTTP exception thrown: Security group 0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d does not exist Aug 22 17:19:35.025618 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-24bf10ee-e5c1-4014-8fac-4bcb65698cae'] Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e1385242-1482-4bfd-899e-aba86600a9c8 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Request method failure captured: Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-security-groups/0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d HTTP/1.1 Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7qSEQO9hofsiEsrQtv0pANASwYR5GbXOyj2-c6RXXhcu3-3IdrOWM_wwsTJi0qitTJkjmcRF8d4TgsYkUY-6tbPaXmH4y6dOymWTCnt46SH-KRdFtHdinQb5uFpSAK7xWaSfwiaFHWjb-33JK1M2hKNzHsz6jXXflBTSjWEI_Kc-V8 Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_28bc0eae58274deebf4277b7e3ca10c8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 87888a8417384b18baad12b5c7d8a69d Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: exception: Security group 0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d does not exist Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-24bf10ee-e5c1-4014-8fac-4bcb65698cae'] Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d'} Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 22 17:19:35.027696 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d does not exist Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24bf10ee-e5c1-4014-8fac-4bcb65698cae'] Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d does not exist Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24bf10ee-e5c1-4014-8fac-4bcb65698cae'] Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d does not exist Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24bf10ee-e5c1-4014-8fac-4bcb65698cae'] Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d does not exist Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24bf10ee-e5c1-4014-8fac-4bcb65698cae'] Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e1385242-1482-4bfd-899e-aba86600a9c8 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Returning 404 to user: Security group 0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d does not exist Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-24bf10ee-e5c1-4014-8fac-4bcb65698cae'] {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e1385242-1482-4bfd-899e-aba86600a9c8 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "GET /compute/v2.1/os-security-groups/0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d" status: 404 len: 194 microversion: 2.1 time: 0.081085 Aug 22 17:19:35.035144 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 786/1574] 10.222.0.96 () {58 vars in 1269 bytes} [Mon Aug 22 17:19:34 2022] GET /compute/v2.1/os-security-groups/0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:19:35.047811 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1caf6a65-dbb0-46e7-af37-51ace6ce9bb5 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f80093c65e0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:35.568317 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6515ec4f-31b0-476f-b92b-1d2e7f510507 tempest-ServersAdminTestJSON-923609062 tempest-ServersAdminTestJSON-923609062-project-admin] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1614 microversion: 2.1 time: 0.652637 Aug 22 17:19:35.568917 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 789/1575] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:34 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1614 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:35.594629 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b56be2e3-5775-42a4-9801-dd8743d30e80 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:35.595418 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b56be2e3-5775-42a4-9801-dd8743d30e80 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:35.617432 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b56be2e3-5775-42a4-9801-dd8743d30e80 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:35.617955 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b56be2e3-5775-42a4-9801-dd8743d30e80 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:35.618407 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b56be2e3-5775-42a4-9801-dd8743d30e80 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:35.619246 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b56be2e3-5775-42a4-9801-dd8743d30e80 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:35.619637 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b56be2e3-5775-42a4-9801-dd8743d30e80 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:35.620074 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b56be2e3-5775-42a4-9801-dd8743d30e80 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:35.678022 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b56be2e3-5775-42a4-9801-dd8743d30e80 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Going to try to terminate instance {{(pid=123015) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:19:35.994650 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1caf6a65-dbb0-46e7-af37-51ace6ce9bb5 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "GET /compute/v2.1/os-security-groups" status: 200 len: 1153 microversion: 2.1 time: 0.953005 Aug 22 17:19:36.001302 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 787/1576] 10.222.0.96 () {58 vars in 1158 bytes} [Mon Aug 22 17:19:35 2022] GET /compute/v2.1/os-security-groups => generated 1153 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:36.023562 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a6bf18c4-3b1d-4ac6-bb8d-1d9f8c8e9f42 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Action: 'create', calling method: .version_select at 0x7f80095244c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-750549538", "description": "tempest-description-1077768579"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:36.312586 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b56be2e3-5775-42a4-9801-dd8743d30e80 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "DELETE /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 204 len: 0 microversion: 2.1 time: 0.721931 Aug 22 17:19:36.317162 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 790/1577] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:19:35 2022] DELETE /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 0 bytes in 725 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:19:36.325853 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-eb818119-54f9-4791-b945-660c73e591c9 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:36.328104 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-eb818119-54f9-4791-b945-660c73e591c9 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:36.339043 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eb818119-54f9-4791-b945-660c73e591c9 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:36.340921 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eb818119-54f9-4791-b945-660c73e591c9 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:36.342479 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eb818119-54f9-4791-b945-660c73e591c9 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:36.348105 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eb818119-54f9-4791-b945-660c73e591c9 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:36.350701 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eb818119-54f9-4791-b945-660c73e591c9 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:36.351448 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-eb818119-54f9-4791-b945-660c73e591c9 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:37.066973 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-eb818119-54f9-4791-b945-660c73e591c9 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:37.077358 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-eb818119-54f9-4791-b945-660c73e591c9 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 200 len: 1467 microversion: 2.1 time: 0.758300 Aug 22 17:19:37.079827 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 791/1578] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:36 2022] GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 1467 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:37.808920 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a6bf18c4-3b1d-4ac6-bb8d-1d9f8c8e9f42 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.795005 Aug 22 17:19:37.817855 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 788/1579] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:19:36 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:37.825602 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8d264cad-fa82-4749-85f4-e9594e83cdf8 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Action: 'create', calling method: .version_select at 0x7f800925aa60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-739026714", "description": "tempest-description-2029990533"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:38.102246 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-690f448a-df87-41ca-afa1-7b6b7af97598 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:38.103094 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-690f448a-df87-41ca-afa1-7b6b7af97598 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:38.115732 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-690f448a-df87-41ca-afa1-7b6b7af97598 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:38.122210 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-690f448a-df87-41ca-afa1-7b6b7af97598 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:38.130444 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-690f448a-df87-41ca-afa1-7b6b7af97598 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:38.139542 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-690f448a-df87-41ca-afa1-7b6b7af97598 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:38.140424 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-690f448a-df87-41ca-afa1-7b6b7af97598 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:38.144372 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-690f448a-df87-41ca-afa1-7b6b7af97598 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:38.944295 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8d264cad-fa82-4749-85f4-e9594e83cdf8 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.125797 Aug 22 17:19:38.945798 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 792/1580] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:19:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:39.210101 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-690f448a-df87-41ca-afa1-7b6b7af97598 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:39.221258 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-690f448a-df87-41ca-afa1-7b6b7af97598 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 200 len: 1467 microversion: 2.1 time: 1.124400 Aug 22 17:19:39.235014 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 789/1581] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:38 2022] GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 1467 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:19:39.237987 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-748ebae2-93e0-4cb7-9380-ecfb4ace68e8 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-493409749", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "93ff4d84-3925-410f-b27a-31a45da33a58"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:39.442113 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-748ebae2-93e0-4cb7-9380-ecfb4ace68e8 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] validate_networks() for [('93ff4d84-3925-410f-b27a-31a45da33a58', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:19:40.247844 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-18102f32-e447-43ea-a4ea-4e7063167f68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:40.249861 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-18102f32-e447-43ea-a4ea-4e7063167f68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:40.264521 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-18102f32-e447-43ea-a4ea-4e7063167f68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:40.265317 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-18102f32-e447-43ea-a4ea-4e7063167f68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:40.265943 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-18102f32-e447-43ea-a4ea-4e7063167f68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:40.266894 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-18102f32-e447-43ea-a4ea-4e7063167f68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:40.267515 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-18102f32-e447-43ea-a4ea-4e7063167f68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:40.268121 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-18102f32-e447-43ea-a4ea-4e7063167f68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:40.722805 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-18102f32-e447-43ea-a4ea-4e7063167f68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:40.741569 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-18102f32-e447-43ea-a4ea-4e7063167f68 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 200 len: 1425 microversion: 2.1 time: 0.499993 Aug 22 17:19:40.746720 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 790/1582] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:40 2022] GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 1425 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:40.819041 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-ee8f9b04-0456-4576-8e8a-73f2e2962f6f req-9c0c8670-f736-433b-b830-aad16042f800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473177e8-4286-43c9-abb3-f54b110ac7ce", "name": "network-vif-deleted", "tag": "639dea3e-d6be-4635-a511-ce9ac0735ba1"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:40.847925 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-ee8f9b04-0456-4576-8e8a-73f2e2962f6f req-9c0c8670-f736-433b-b830-aad16042f800 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:40.849590 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-ee8f9b04-0456-4576-8e8a-73f2e2962f6f req-9c0c8670-f736-433b-b830-aad16042f800 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:40.866585 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-ee8f9b04-0456-4576-8e8a-73f2e2962f6f req-9c0c8670-f736-433b-b830-aad16042f800 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:40.985775 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-ee8f9b04-0456-4576-8e8a-73f2e2962f6f req-9c0c8670-f736-433b-b830-aad16042f800 service nova] Creating event network-vif-deleted:639dea3e-d6be-4635-a511-ce9ac0735ba1 for instance 473177e8-4286-43c9-abb3-f54b110ac7ce on n-h2-854030-1 Aug 22 17:19:41.062144 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-ee8f9b04-0456-4576-8e8a-73f2e2962f6f req-9c0c8670-f736-433b-b830-aad16042f800 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239524 Aug 22 17:19:41.065378 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 791/1583] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-748ebae2-93e0-4cb7-9380-ecfb4ace68e8 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-90fbc9d6-f6b0-4c7f-a374-00016090575f) Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:19:41.365982 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-90fbc9d6-f6b0-4c7f-a374-00016090575f) Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-748ebae2-93e0-4cb7-9380-ecfb4ace68e8 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-748ebae2-93e0-4cb7-9380-ecfb4ace68e8 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Request method failure captured: Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 207 Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7qSEQO9hofsiEsrQtv0pANASwYR5GbXOyj2-c6RXXhcu3-3IdrOWM_wwsTJi0qitTJkjmcRF8d4TgsYkUY-6tbPaXmH4y6dOymWTCnt46SH-KRdFtHdinQb5uFpSAK7xWaSfwiaFHWjb-33JK1M2hKNzHsz6jXXflBTSjWEI_Kc-V8 Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_28bc0eae58274deebf4277b7e3ca10c8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 87888a8417384b18baad12b5c7d8a69d Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-493409749", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "93ff4d84-3925-410f-b27a-31a45da33a58"}]}} Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-SecurityGroupsTestJSON-server-493409749', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '93ff4d84-3925-410f-b27a-31a45da33a58'}]}}} Aug 22 17:19:41.370686 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:19:41.375602 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-90fbc9d6-f6b0-4c7f-a374-00016090575f) Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-748ebae2-93e0-4cb7-9380-ecfb4ace68e8 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-748ebae2-93e0-4cb7-9380-ecfb4ace68e8 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.136838 Aug 22 17:19:41.385222 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 793/1584] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:19:39 2022] POST /compute/v2.1/servers => generated 214 bytes in 2138 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 22 17:19:41.403792 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-85e4b150-85f3-40c7-90e5-a6add31974a0 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Action: 'create', calling method: .version_select at 0x7f8009440c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-102854838", "description": "tempest-description-1485004406"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:41.773386 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9b5e85b8-fbdf-4016-bce2-4f27655a0849 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:41.774985 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9b5e85b8-fbdf-4016-bce2-4f27655a0849 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:41.787919 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b5e85b8-fbdf-4016-bce2-4f27655a0849 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:41.793336 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b5e85b8-fbdf-4016-bce2-4f27655a0849 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:41.794118 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b5e85b8-fbdf-4016-bce2-4f27655a0849 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:41.794349 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b5e85b8-fbdf-4016-bce2-4f27655a0849 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:41.794774 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b5e85b8-fbdf-4016-bce2-4f27655a0849 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:41.795220 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b5e85b8-fbdf-4016-bce2-4f27655a0849 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:41.886358 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b5e85b8-fbdf-4016-bce2-4f27655a0849 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:41.887089 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b5e85b8-fbdf-4016-bce2-4f27655a0849 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:41.887686 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b5e85b8-fbdf-4016-bce2-4f27655a0849 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:41.888295 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-9b5e85b8-fbdf-4016-bce2-4f27655a0849 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lazy-loading 'fault' on Instance uuid 473177e8-4286-43c9-abb3-f54b110ac7ce {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:19:42.141041 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9b5e85b8-fbdf-4016-bce2-4f27655a0849 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:42.152375 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9b5e85b8-fbdf-4016-bce2-4f27655a0849 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 200 len: 1301 microversion: 2.1 time: 0.382132 Aug 22 17:19:42.153034 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 794/1585] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:41 2022] GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 1301 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:42.593606 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-85e4b150-85f3-40c7-90e5-a6add31974a0 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.208208 Aug 22 17:19:42.607604 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-47834aa3-6986-40ec-8446-79808a1d5f24 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Action: 'update', calling method: .version_select at 0x7f800925a280>, body: {"security_group": {"name": "tempest-sg-hth-1016837873", "description": "tempest-description-hth-334008407"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:42.612156 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 792/1586] 10.222.0.96 () {60 vars in 1180 bytes} [Mon Aug 22 17:19:41 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:43.176875 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e935aed6-6597-4a26-85dc-675462670aed tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:43.177945 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e935aed6-6597-4a26-85dc-675462670aed tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 473177e8-4286-43c9-abb3-f54b110ac7ce] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:43.190317 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:43.192584 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e935aed6-6597-4a26-85dc-675462670aed tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:43.197968 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e935aed6-6597-4a26-85dc-675462670aed tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:43.198701 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e935aed6-6597-4a26-85dc-675462670aed tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:43.199642 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e935aed6-6597-4a26-85dc-675462670aed tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:43.200275 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e935aed6-6597-4a26-85dc-675462670aed tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:43.200881 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e935aed6-6597-4a26-85dc-675462670aed tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:43.235474 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-e935aed6-6597-4a26-85dc-675462670aed tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] HTTP exception thrown: Instance 473177e8-4286-43c9-abb3-f54b110ac7ce could not be found. Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e935aed6-6597-4a26-85dc-675462670aed tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Request method failure captured: Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce HTTP/1.1 Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7oB4G2sejpUYMEXSjZgAG-oNig3yRaRgSP6pes_bO0d0J87kr3fbZQ9oEWMBmdgmuN6BortClcCMsjnoB-n45SSl4W_-x50GEjvlXkLxwyYCQ-CG7MfWdSM5HHrUtlANCCSpjxwwNQe2ghYqNZboxH6OWlgapyIrR3H07gWaKbvqFs Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: d2ecfb79c01d4d40850d84c3cced9240 Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServersAdminTestJSON-189468355 Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d2ecfb79c01d4d40850d84c3cced9240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_d2ecfb79c01d4d40850d84c3cced9240", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d2ecfb79c01d4d40850d84c3cced9240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/d2ecfb79c01d4d40850d84c3cced9240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServersAdminTestJSON-189468355 Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: d2ecfb79c01d4d40850d84c3cced9240 Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServersAdminTestJSON-189468355 Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServersAdminTestJSON-189468355-project Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 72a0121eeba0467b9ac1030b4f2b6638 Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServersAdminTestJSON-189468355-project Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance 473177e8-4286-43c9-abb3-f54b110ac7ce could not be found. Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '473177e8-4286-43c9-abb3-f54b110ac7ce'} Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 473177e8-4286-43c9-abb3-f54b110ac7ce could not be found. Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 473177e8-4286-43c9-abb3-f54b110ac7ce could not be found. Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:43.240552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:43.245056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:43.245056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:43.245056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:43.245056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:43.245056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:43.245056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 473177e8-4286-43c9-abb3-f54b110ac7ce could not be found. Aug 22 17:19:43.245056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:43.250623 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e935aed6-6597-4a26-85dc-675462670aed tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Returning 404 to user: Instance 473177e8-4286-43c9-abb3-f54b110ac7ce could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:43.271130 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e935aed6-6597-4a26-85dc-675462670aed tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce" status: 404 len: 111 microversion: 2.1 time: 0.080756 Aug 22 17:19:43.271130 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 793/1587] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:43 2022] GET /compute/v2.1/servers/473177e8-4286-43c9-abb3-f54b110ac7ce => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:19:43.271675 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-21557278-b192-4c80-982f-6ea663b45287 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:43.272868 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-21557278-b192-4c80-982f-6ea663b45287 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 256c1311-1a56-4547-a142-0daf98661aff] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:43.288186 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21557278-b192-4c80-982f-6ea663b45287 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:43.288847 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21557278-b192-4c80-982f-6ea663b45287 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:43.289547 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21557278-b192-4c80-982f-6ea663b45287 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:43.290391 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21557278-b192-4c80-982f-6ea663b45287 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:43.296867 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21557278-b192-4c80-982f-6ea663b45287 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:43.297486 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-21557278-b192-4c80-982f-6ea663b45287 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:43.387236 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-21557278-b192-4c80-982f-6ea663b45287 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 256c1311-1a56-4547-a142-0daf98661aff] Going to try to terminate instance {{(pid=123016) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:19:44.091971 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-47834aa3-6986-40ec-8446-79808a1d5f24 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "PUT /compute/v2.1/os-security-groups/83c41682-186a-46cf-85cd-e514841d1c13" status: 200 len: 217 microversion: 2.1 time: 1.489059 Aug 22 17:19:44.102645 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 795/1588] 10.222.0.96 () {60 vars in 1290 bytes} [Mon Aug 22 17:19:42 2022] PUT /compute/v2.1/os-security-groups/83c41682-186a-46cf-85cd-e514841d1c13 => generated 217 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:19:44.107895 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-97fe423a-2fdb-46a8-b767-fd6da32b2ba4 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f80092a2af0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:44.407122 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-97fe423a-2fdb-46a8-b767-fd6da32b2ba4 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "GET /compute/v2.1/os-security-groups/83c41682-186a-46cf-85cd-e514841d1c13" status: 200 len: 217 microversion: 2.1 time: 0.303164 Aug 22 17:19:44.408548 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 796/1589] 10.222.0.96 () {58 vars in 1269 bytes} [Mon Aug 22 17:19:44 2022] GET /compute/v2.1/os-security-groups/83c41682-186a-46cf-85cd-e514841d1c13 => generated 217 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:44.422746 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f15cef1a-5c4d-4687-a238-33afbbabfbc3 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f80092a2a60>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:44.584930 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-21557278-b192-4c80-982f-6ea663b45287 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "DELETE /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff" status: 204 len: 0 microversion: 2.1 time: 1.322842 Aug 22 17:19:44.589420 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 794/1590] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:19:43 2022] DELETE /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff => generated 0 bytes in 1325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:19:44.597716 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7fdb1f7c-b7a0-4763-ae0a-3815552147d1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:44.597716 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-7fdb1f7c-b7a0-4763-ae0a-3815552147d1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 256c1311-1a56-4547-a142-0daf98661aff] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:44.626291 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7fdb1f7c-b7a0-4763-ae0a-3815552147d1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:44.629837 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7fdb1f7c-b7a0-4763-ae0a-3815552147d1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:44.633612 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7fdb1f7c-b7a0-4763-ae0a-3815552147d1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:44.636444 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7fdb1f7c-b7a0-4763-ae0a-3815552147d1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:44.638343 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7fdb1f7c-b7a0-4763-ae0a-3815552147d1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:44.640334 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7fdb1f7c-b7a0-4763-ae0a-3815552147d1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:44.811909 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:45.137015 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-7fdb1f7c-b7a0-4763-ae0a-3815552147d1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:45.150018 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7fdb1f7c-b7a0-4763-ae0a-3815552147d1 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff" status: 200 len: 1469 microversion: 2.1 time: 0.559094 Aug 22 17:19:45.157815 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 795/1591] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:44 2022] GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff => generated 1469 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:45.174653 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5f2dc513-6a76-45b9-aa7e-febb2316e41f tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2020757080", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4375fa14-b0f4-4689-a348-7d1dfebe436f"}], "security_groups": [{"name": "tempest-securitygroup--849010449"}], "key_name": "tempest-keypair-1158608384", "user_data": "}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:45.492196 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-5f2dc513-6a76-45b9-aa7e-febb2316e41f tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] validate_networks() for [('4375fa14-b0f4-4689-a348-7d1dfebe436f', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:19:45.798546 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f15cef1a-5c4d-4687-a238-33afbbabfbc3 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/83c41682-186a-46cf-85cd-e514841d1c13" status: 202 len: 0 microversion: 2.1 time: 1.377356 Aug 22 17:19:45.800649 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 797/1592] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:44 2022] DELETE /compute/v2.1/os-security-groups/83c41682-186a-46cf-85cd-e514841d1c13 => generated 0 bytes in 1383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:19:45.809654 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ab3e92ae-8be8-461a-bfac-0c4540a3de61 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f800924b430>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-5f2dc513-6a76-45b9-aa7e-febb2316e41f tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d4b87261-1653-4d7f-9ca4-a96a20f6e708) Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:19:45.880242 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:19:45.883949 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:19:45.883949 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:19:45.883949 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:19:45.883949 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:19:45.883949 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:19:45.883949 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:19:45.883949 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:19:45.883949 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:19:45.883949 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:19:45.883949 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:19:45.883949 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:19:45.883949 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:19:45.883949 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:19:45.883949 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:19:45.883949 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:19:45.883949 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d4b87261-1653-4d7f-9ca4-a96a20f6e708) Aug 22 17:19:45.883949 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:45.886066 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-5f2dc513-6a76-45b9-aa7e-febb2316e41f tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:45.886066 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5f2dc513-6a76-45b9-aa7e-febb2316e41f tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] Request method failure captured: Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 491 Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7qmz_AVOekDjF4SRezCVTyTjPqaG7Ui7WoZKAu-cgTd-2GC6tV9drqXnFoHtGDoMZADNU54YRoxbWBySB3AwXXQv2J14X-vVnZi19f5RpA7XbMW6aubeKWnxe7vu1qneiZionRKGovI00Mc83u1bKinhTCc-Je7eTdW4SD-8BEtCt0 Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 98ea4e0e0f7e46e0b7920256194c82d4 Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1460349284 Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/98ea4e0e0f7e46e0b7920256194c82d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_98ea4e0e0f7e46e0b7920256194c82d4", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/98ea4e0e0f7e46e0b7920256194c82d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/98ea4e0e0f7e46e0b7920256194c82d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1460349284 Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 98ea4e0e0f7e46e0b7920256194c82d4 Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1460349284 Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-AttachVolumeShelveTestJSON-1460349284-project Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 5cc533ed8b2e49aa936dc5002399f632 Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1460349284-project Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2020757080", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "4375fa14-b0f4-4689-a348-7d1dfebe436f"}], "security_groups": [{"name": "tempest-securitygroup--849010449"}], "key_name": "tempest-keypair-1158608384", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeShelveTestJSON-server-2020757080', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '4375fa14-b0f4-4689-a348-7d1dfebe436f'}], 'security_groups': [{'name': 'tempest-securitygroup--849010449'}], 'key_name': 'tempest-keypair-1158608384', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:19:45.891658 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d4b87261-1653-4d7f-9ca4-a96a20f6e708) Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:45.896247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5f2dc513-6a76-45b9-aa7e-febb2316e41f tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:45.901055 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:45.904709 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5f2dc513-6a76-45b9-aa7e-febb2316e41f tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.20 time: 0.744549 Aug 22 17:19:45.905769 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 796/1593] 10.222.0.96 () {62 vars in 1188 bytes} [Mon Aug 22 17:19:45 2022] POST /compute/v2.1/servers => generated 214 bytes in 747 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Aug 22 17:19:45.923269 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9a76bb65-07a9-4693-840c-8bd0a62ec902 tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] Calling method '.version_select at 0x7f8009470940>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:46.032826 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9a76bb65-07a9-4693-840c-8bd0a62ec902 tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158608384" status: 204 len: 0 microversion: 2.20 time: 0.115942 Aug 22 17:19:46.040527 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 797/1594] 10.222.0.96 () {60 vars in 1262 bytes} [Mon Aug 22 17:19:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158608384 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 17:19:46.176588 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7200e218-c469-4778-9ae1-9d8629ff6ce6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:46.177485 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-7200e218-c469-4778-9ae1-9d8629ff6ce6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 256c1311-1a56-4547-a142-0daf98661aff] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:46.192022 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7200e218-c469-4778-9ae1-9d8629ff6ce6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:46.192812 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7200e218-c469-4778-9ae1-9d8629ff6ce6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:46.193670 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7200e218-c469-4778-9ae1-9d8629ff6ce6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:46.194881 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7200e218-c469-4778-9ae1-9d8629ff6ce6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:46.196458 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7200e218-c469-4778-9ae1-9d8629ff6ce6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:46.202053 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7200e218-c469-4778-9ae1-9d8629ff6ce6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:46.918497 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ab3e92ae-8be8-461a-bfac-0c4540a3de61 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/8128743c-a3e6-4512-be01-bd77eeda63ce" status: 202 len: 0 microversion: 2.1 time: 1.113265 Aug 22 17:19:46.922712 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 798/1595] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:45 2022] DELETE /compute/v2.1/os-security-groups/8128743c-a3e6-4512-be01-bd77eeda63ce => generated 0 bytes in 1115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:19:46.929611 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a44d5fa9-80a1-4dec-ab28-af817d767d70 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f8009268430>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:47.010778 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-7200e218-c469-4778-9ae1-9d8629ff6ce6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:47.065599 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7200e218-c469-4778-9ae1-9d8629ff6ce6 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff" status: 200 len: 1469 microversion: 2.1 time: 0.892859 Aug 22 17:19:47.071612 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 798/1596] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:46 2022] GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff => generated 1469 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:47.906443 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a44d5fa9-80a1-4dec-ab28-af817d767d70 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/e5298869-919f-4b7e-a11a-f309e8c0d321" status: 202 len: 0 microversion: 2.1 time: 0.981468 Aug 22 17:19:47.907473 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 799/1597] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:46 2022] DELETE /compute/v2.1/os-security-groups/e5298869-919f-4b7e-a11a-f309e8c0d321 => generated 0 bytes in 983 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:19:47.916222 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-098b8794-d6df-4738-ac1e-415bba810ca6 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f80094938b0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:48.093308 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0033bf69-470b-4f9b-80bb-c32978f5e423 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:48.095781 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0033bf69-470b-4f9b-80bb-c32978f5e423 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 256c1311-1a56-4547-a142-0daf98661aff] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:48.115790 n-d-854030-1 devstack@n-api.service[123016]: DEBUG neutronclient.v2_0.client [None req-098b8794-d6df-4738-ac1e-415bba810ca6 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d does not exist", "detail": ""}} {{(pid=123016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:19:48.117233 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.security_group_api [None req-098b8794-d6df-4738-ac1e-415bba810ca6 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Neutron security group 0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d not found {{(pid=123016) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 22 17:19:48.118064 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-098b8794-d6df-4738-ac1e-415bba810ca6 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] HTTP exception thrown: Security group 0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d does not exist Aug 22 17:19:48.118064 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-f0409e65-301b-4ee6-9fd8-c44f77094f32'] Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-098b8794-d6df-4738-ac1e-415bba810ca6 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Request method failure captured: Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: request: DELETE /compute/v2.1/os-security-groups/0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d HTTP/1.1 Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7qSEQO9hofsiEsrQtv0pANASwYR5GbXOyj2-c6RXXhcu3-3IdrOWM_wwsTJi0qitTJkjmcRF8d4TgsYkUY-6tbPaXmH4y6dOymWTCnt46SH-KRdFtHdinQb5uFpSAK7xWaSfwiaFHWjb-33JK1M2hKNzHsz6jXXflBTSjWEI_Kc-V8 Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_28bc0eae58274deebf4277b7e3ca10c8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 87888a8417384b18baad12b5c7d8a69d Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: exception: Security group 0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d does not exist Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-f0409e65-301b-4ee6-9fd8-c44f77094f32'] Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d'} Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 22 17:19:48.121994 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d does not exist Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0409e65-301b-4ee6-9fd8-c44f77094f32'] Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d does not exist Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0409e65-301b-4ee6-9fd8-c44f77094f32'] Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d does not exist Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0409e65-301b-4ee6-9fd8-c44f77094f32'] Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d does not exist Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0409e65-301b-4ee6-9fd8-c44f77094f32'] Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-098b8794-d6df-4738-ac1e-415bba810ca6 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Returning 404 to user: Security group 0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d does not exist Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-f0409e65-301b-4ee6-9fd8-c44f77094f32'] {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-098b8794-d6df-4738-ac1e-415bba810ca6 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d" status: 404 len: 194 microversion: 2.1 time: 0.213542 Aug 22 17:19:48.127158 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 799/1598] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:47 2022] DELETE /compute/v2.1/os-security-groups/0b1999ba-eff2-4d85-8070-ef6aa6ab1e0d => generated 194 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:19:48.143688 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0033bf69-470b-4f9b-80bb-c32978f5e423 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:48.144182 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0033bf69-470b-4f9b-80bb-c32978f5e423 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:48.146438 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e594e45a-095d-462b-95b8-84a12fddbbe4 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f8009524b80>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:48.150436 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0033bf69-470b-4f9b-80bb-c32978f5e423 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:48.151287 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0033bf69-470b-4f9b-80bb-c32978f5e423 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:48.151888 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0033bf69-470b-4f9b-80bb-c32978f5e423 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:48.153651 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0033bf69-470b-4f9b-80bb-c32978f5e423 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:48.350111 n-d-854030-1 devstack@n-api.service[123016]: DEBUG neutronclient.v2_0.client [None req-e594e45a-095d-462b-95b8-84a12fddbbe4 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 76a64906-add8-4042-9724-d4043cb7fd08 does not exist", "detail": ""}} {{(pid=123016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:19:48.351057 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.security_group_api [None req-e594e45a-095d-462b-95b8-84a12fddbbe4 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Neutron security group 76a64906-add8-4042-9724-d4043cb7fd08 not found {{(pid=123016) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 22 17:19:48.351890 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-e594e45a-095d-462b-95b8-84a12fddbbe4 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] HTTP exception thrown: Security group 76a64906-add8-4042-9724-d4043cb7fd08 does not exist Aug 22 17:19:48.351890 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-43f76110-860a-4256-8f3b-e60134d6660c'] Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e594e45a-095d-462b-95b8-84a12fddbbe4 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Request method failure captured: Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: request: DELETE /compute/v2.1/os-security-groups/76a64906-add8-4042-9724-d4043cb7fd08 HTTP/1.1 Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7qSEQO9hofsiEsrQtv0pANASwYR5GbXOyj2-c6RXXhcu3-3IdrOWM_wwsTJi0qitTJkjmcRF8d4TgsYkUY-6tbPaXmH4y6dOymWTCnt46SH-KRdFtHdinQb5uFpSAK7xWaSfwiaFHWjb-33JK1M2hKNzHsz6jXXflBTSjWEI_Kc-V8 Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_28bc0eae58274deebf4277b7e3ca10c8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 87888a8417384b18baad12b5c7d8a69d Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: exception: Security group 76a64906-add8-4042-9724-d4043cb7fd08 does not exist Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-43f76110-860a-4256-8f3b-e60134d6660c'] Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '76a64906-add8-4042-9724-d4043cb7fd08'} Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 22 17:19:48.354050 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 76a64906-add8-4042-9724-d4043cb7fd08 does not exist Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43f76110-860a-4256-8f3b-e60134d6660c'] Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 76a64906-add8-4042-9724-d4043cb7fd08 does not exist Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43f76110-860a-4256-8f3b-e60134d6660c'] Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 76a64906-add8-4042-9724-d4043cb7fd08 does not exist Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43f76110-860a-4256-8f3b-e60134d6660c'] Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 76a64906-add8-4042-9724-d4043cb7fd08 does not exist Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43f76110-860a-4256-8f3b-e60134d6660c'] Aug 22 17:19:48.359826 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.364614 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e594e45a-095d-462b-95b8-84a12fddbbe4 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Returning 404 to user: Security group 76a64906-add8-4042-9724-d4043cb7fd08 does not exist Aug 22 17:19:48.364614 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-43f76110-860a-4256-8f3b-e60134d6660c'] {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:48.366117 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e594e45a-095d-462b-95b8-84a12fddbbe4 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/76a64906-add8-4042-9724-d4043cb7fd08" status: 404 len: 194 microversion: 2.1 time: 0.235259 Aug 22 17:19:48.367197 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 800/1599] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:48 2022] DELETE /compute/v2.1/os-security-groups/76a64906-add8-4042-9724-d4043cb7fd08 => generated 194 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:19:48.381343 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-980c9df4-88f2-481c-9292-cc14da9969f2 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f80094704c0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:48.411087 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0033bf69-470b-4f9b-80bb-c32978f5e423 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:48.435282 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0033bf69-470b-4f9b-80bb-c32978f5e423 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff" status: 200 len: 1427 microversion: 2.1 time: 0.348644 Aug 22 17:19:48.439323 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 800/1600] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:48 2022] GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff => generated 1427 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:19:48.521564 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-2b704397-e088-441c-97f4-bc5e0106021e req-d922bdcf-7f84-4be1-829d-78abbc64b6be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "256c1311-1a56-4547-a142-0daf98661aff", "name": "network-vif-deleted", "tag": "9fcf1432-c8b1-49d3-b6d6-a712dabb2995"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:48.551925 n-d-854030-1 devstack@n-api.service[123016]: DEBUG neutronclient.v2_0.client [None req-980c9df4-88f2-481c-9292-cc14da9969f2 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6831381d-47f7-4888-ac68-c29e8a2a8686 does not exist", "detail": ""}} {{(pid=123016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:19:48.552600 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.security_group_api [None req-980c9df4-88f2-481c-9292-cc14da9969f2 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Neutron security group 6831381d-47f7-4888-ac68-c29e8a2a8686 not found {{(pid=123016) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 22 17:19:48.553433 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-980c9df4-88f2-481c-9292-cc14da9969f2 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] HTTP exception thrown: Security group 6831381d-47f7-4888-ac68-c29e8a2a8686 does not exist Aug 22 17:19:48.553433 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-b63335b7-458a-4604-8888-2f4682447984'] Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-980c9df4-88f2-481c-9292-cc14da9969f2 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Request method failure captured: Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: request: DELETE /compute/v2.1/os-security-groups/6831381d-47f7-4888-ac68-c29e8a2a8686 HTTP/1.1 Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7qSEQO9hofsiEsrQtv0pANASwYR5GbXOyj2-c6RXXhcu3-3IdrOWM_wwsTJi0qitTJkjmcRF8d4TgsYkUY-6tbPaXmH4y6dOymWTCnt46SH-KRdFtHdinQb5uFpSAK7xWaSfwiaFHWjb-33JK1M2hKNzHsz6jXXflBTSjWEI_Kc-V8 Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_28bc0eae58274deebf4277b7e3ca10c8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 87888a8417384b18baad12b5c7d8a69d Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: exception: Security group 6831381d-47f7-4888-ac68-c29e8a2a8686 does not exist Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-b63335b7-458a-4604-8888-2f4682447984'] Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '6831381d-47f7-4888-ac68-c29e8a2a8686'} Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 22 17:19:48.556263 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6831381d-47f7-4888-ac68-c29e8a2a8686 does not exist Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b63335b7-458a-4604-8888-2f4682447984'] Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6831381d-47f7-4888-ac68-c29e8a2a8686 does not exist Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b63335b7-458a-4604-8888-2f4682447984'] Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6831381d-47f7-4888-ac68-c29e8a2a8686 does not exist Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b63335b7-458a-4604-8888-2f4682447984'] Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6831381d-47f7-4888-ac68-c29e8a2a8686 does not exist Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b63335b7-458a-4604-8888-2f4682447984'] Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-980c9df4-88f2-481c-9292-cc14da9969f2 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Returning 404 to user: Security group 6831381d-47f7-4888-ac68-c29e8a2a8686 does not exist Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-b63335b7-458a-4604-8888-2f4682447984'] {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:48.559552 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-980c9df4-88f2-481c-9292-cc14da9969f2 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/6831381d-47f7-4888-ac68-c29e8a2a8686" status: 404 len: 194 microversion: 2.1 time: 0.188159 Aug 22 17:19:48.563410 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 801/1601] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:48 2022] DELETE /compute/v2.1/os-security-groups/6831381d-47f7-4888-ac68-c29e8a2a8686 => generated 194 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:19:48.574913 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-04c44c74-d13d-4a0f-a7e7-c87e376f6228 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f8009493ca0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:48.604421 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-2b704397-e088-441c-97f4-bc5e0106021e req-d922bdcf-7f84-4be1-829d-78abbc64b6be service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:48.604421 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-2b704397-e088-441c-97f4-bc5e0106021e req-d922bdcf-7f84-4be1-829d-78abbc64b6be service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:48.604421 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-2b704397-e088-441c-97f4-bc5e0106021e req-d922bdcf-7f84-4be1-829d-78abbc64b6be service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:48.642467 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-2b704397-e088-441c-97f4-bc5e0106021e req-d922bdcf-7f84-4be1-829d-78abbc64b6be service nova] Creating event network-vif-deleted:9fcf1432-c8b1-49d3-b6d6-a712dabb2995 for instance 256c1311-1a56-4547-a142-0daf98661aff on n-h2-854030-1 Aug 22 17:19:48.658880 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-2b704397-e088-441c-97f4-bc5e0106021e req-d922bdcf-7f84-4be1-829d-78abbc64b6be service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144511 Aug 22 17:19:48.665347 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 801/1602] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:48.731091 n-d-854030-1 devstack@n-api.service[123016]: DEBUG neutronclient.v2_0.client [None req-04c44c74-d13d-4a0f-a7e7-c87e376f6228 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c6573121-dc1e-4133-b88a-60996d06284e does not exist", "detail": ""}} {{(pid=123016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 22 17:19:48.733782 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.security_group_api [None req-04c44c74-d13d-4a0f-a7e7-c87e376f6228 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Neutron security group c6573121-dc1e-4133-b88a-60996d06284e not found {{(pid=123016) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 22 17:19:48.734546 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-04c44c74-d13d-4a0f-a7e7-c87e376f6228 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] HTTP exception thrown: Security group c6573121-dc1e-4133-b88a-60996d06284e does not exist Aug 22 17:19:48.734546 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-109d1867-75fa-4a8c-8f3a-c6fc17822ee4'] Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-04c44c74-d13d-4a0f-a7e7-c87e376f6228 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Request method failure captured: Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: request: DELETE /compute/v2.1/os-security-groups/c6573121-dc1e-4133-b88a-60996d06284e HTTP/1.1 Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7qSEQO9hofsiEsrQtv0pANASwYR5GbXOyj2-c6RXXhcu3-3IdrOWM_wwsTJi0qitTJkjmcRF8d4TgsYkUY-6tbPaXmH4y6dOymWTCnt46SH-KRdFtHdinQb5uFpSAK7xWaSfwiaFHWjb-33JK1M2hKNzHsz6jXXflBTSjWEI_Kc-V8 Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_28bc0eae58274deebf4277b7e3ca10c8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/28bc0eae58274deebf4277b7e3ca10c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 28bc0eae58274deebf4277b7e3ca10c8 Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-992379818 Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 87888a8417384b18baad12b5c7d8a69d Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-SecurityGroupsTestJSON-992379818-project Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: exception: Security group c6573121-dc1e-4133-b88a-60996d06284e does not exist Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-109d1867-75fa-4a8c-8f3a-c6fc17822ee4'] Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'c6573121-dc1e-4133-b88a-60996d06284e'} Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 22 17:19:48.736640 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c6573121-dc1e-4133-b88a-60996d06284e does not exist Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-109d1867-75fa-4a8c-8f3a-c6fc17822ee4'] Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c6573121-dc1e-4133-b88a-60996d06284e does not exist Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-109d1867-75fa-4a8c-8f3a-c6fc17822ee4'] Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c6573121-dc1e-4133-b88a-60996d06284e does not exist Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-109d1867-75fa-4a8c-8f3a-c6fc17822ee4'] Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c6573121-dc1e-4133-b88a-60996d06284e does not exist Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-109d1867-75fa-4a8c-8f3a-c6fc17822ee4'] Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-04c44c74-d13d-4a0f-a7e7-c87e376f6228 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Returning 404 to user: Security group c6573121-dc1e-4133-b88a-60996d06284e does not exist Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: Neutron server returns request_ids: ['req-109d1867-75fa-4a8c-8f3a-c6fc17822ee4'] {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:48.740236 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-04c44c74-d13d-4a0f-a7e7-c87e376f6228 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/c6573121-dc1e-4133-b88a-60996d06284e" status: 404 len: 194 microversion: 2.1 time: 0.173332 Aug 22 17:19:48.745956 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 802/1603] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:48 2022] DELETE /compute/v2.1/os-security-groups/c6573121-dc1e-4133-b88a-60996d06284e => generated 194 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:19:48.751793 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8c9ade1a-bf71-4d73-9429-9f55799c96ab tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f800924b280>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:49.466494 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6ffc7cc9-30a0-419f-88ae-12f2f7719a4d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:49.469340 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-6ffc7cc9-30a0-419f-88ae-12f2f7719a4d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 256c1311-1a56-4547-a142-0daf98661aff] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:49.477830 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ffc7cc9-30a0-419f-88ae-12f2f7719a4d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:49.478877 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ffc7cc9-30a0-419f-88ae-12f2f7719a4d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:49.479561 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ffc7cc9-30a0-419f-88ae-12f2f7719a4d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:49.482371 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ffc7cc9-30a0-419f-88ae-12f2f7719a4d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:49.483950 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ffc7cc9-30a0-419f-88ae-12f2f7719a4d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:49.485795 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ffc7cc9-30a0-419f-88ae-12f2f7719a4d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:49.562236 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8c9ade1a-bf71-4d73-9429-9f55799c96ab tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/8b601887-4af2-491f-95ca-023b1f95848a" status: 202 len: 0 microversion: 2.1 time: 0.815789 Aug 22 17:19:49.563236 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 802/1604] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:48 2022] DELETE /compute/v2.1/os-security-groups/8b601887-4af2-491f-95ca-023b1f95848a => generated 0 bytes in 817 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:19:49.578294 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9d19198c-de7c-4b22-b407-52f64e32bc26 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] Calling method '.version_select at 0x7f80096e01f0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:49.635669 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ffc7cc9-30a0-419f-88ae-12f2f7719a4d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:49.639393 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ffc7cc9-30a0-419f-88ae-12f2f7719a4d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:49.640090 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-6ffc7cc9-30a0-419f-88ae-12f2f7719a4d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:49.644289 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-6ffc7cc9-30a0-419f-88ae-12f2f7719a4d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lazy-loading 'fault' on Instance uuid 256c1311-1a56-4547-a142-0daf98661aff {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:19:49.828349 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-6ffc7cc9-30a0-419f-88ae-12f2f7719a4d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:49.859102 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-6ffc7cc9-30a0-419f-88ae-12f2f7719a4d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff" status: 200 len: 1303 microversion: 2.1 time: 0.397935 Aug 22 17:19:49.861822 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 803/1605] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:49 2022] GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff => generated 1303 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:49.890388 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e6ef1555-4456-482a-914b-8a16de29ab6d tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] Action: 'create', calling method: .version_select at 0x7f80094a8550>, body: {"keypair": {"name": "tempest-keypair-1667446711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQJ4I4duvFKbJ670n6OqUgPSIjb2942KmQ42K+Ar0BlehyRqq5TcXH9Uehnw19iYn6XMdB7ke6igtgOAYdzjWj8LMAszEqktxuTgLNefuFszQ3yTuO37ZpkPgvjTBc9NA=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:49.910060 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-e6ef1555-4456-482a-914b-8a16de29ab6d tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] Getting quotas for project 98ea4e0e0f7e46e0b7920256194c82d4. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:19:49.917144 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-e6ef1555-4456-482a-914b-8a16de29ab6d tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] Getting quotas for user 5cc533ed8b2e49aa936dc5002399f632 and project 98ea4e0e0f7e46e0b7920256194c82d4. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:19:50.086015 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e6ef1555-4456-482a-914b-8a16de29ab6d tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.200560 Aug 22 17:19:50.087339 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 804/1606] 10.222.0.96 () {62 vars in 1200 bytes} [Mon Aug 22 17:19:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 202 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 22 17:19:50.773970 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9d19198c-de7c-4b22-b407-52f64e32bc26 tempest-SecurityGroupsTestJSON-992379818 tempest-SecurityGroupsTestJSON-992379818-project] 10.222.0.96 "DELETE /compute/v2.1/os-security-groups/2a3e6e8c-b6e1-4bc3-817c-1b08dc022c2c" status: 202 len: 0 microversion: 2.1 time: 1.205054 Aug 22 17:19:50.774759 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 803/1607] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:19:49 2022] DELETE /compute/v2.1/os-security-groups/2a3e6e8c-b6e1-4bc3-817c-1b08dc022c2c => generated 0 bytes in 1207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:19:50.893409 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-710ea22e-00b8-4e24-84c9-283d9ec1127b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:50.895772 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-710ea22e-00b8-4e24-84c9-283d9ec1127b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 256c1311-1a56-4547-a142-0daf98661aff] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:50.911690 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-710ea22e-00b8-4e24-84c9-283d9ec1127b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:50.911780 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-710ea22e-00b8-4e24-84c9-283d9ec1127b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:50.912200 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-710ea22e-00b8-4e24-84c9-283d9ec1127b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:50.919962 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-710ea22e-00b8-4e24-84c9-283d9ec1127b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:50.921916 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-710ea22e-00b8-4e24-84c9-283d9ec1127b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:50.922371 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-710ea22e-00b8-4e24-84c9-283d9ec1127b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:50.989943 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-710ea22e-00b8-4e24-84c9-283d9ec1127b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] HTTP exception thrown: Instance 256c1311-1a56-4547-a142-0daf98661aff could not be found. Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-710ea22e-00b8-4e24-84c9-283d9ec1127b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Request method failure captured: Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff HTTP/1.1 Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7oB4G2sejpUYMEXSjZgAG-oNig3yRaRgSP6pes_bO0d0J87kr3fbZQ9oEWMBmdgmuN6BortClcCMsjnoB-n45SSl4W_-x50GEjvlXkLxwyYCQ-CG7MfWdSM5HHrUtlANCCSpjxwwNQe2ghYqNZboxH6OWlgapyIrR3H07gWaKbvqFs Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: d2ecfb79c01d4d40850d84c3cced9240 Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServersAdminTestJSON-189468355 Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d2ecfb79c01d4d40850d84c3cced9240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_d2ecfb79c01d4d40850d84c3cced9240", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d2ecfb79c01d4d40850d84c3cced9240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/d2ecfb79c01d4d40850d84c3cced9240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServersAdminTestJSON-189468355 Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: d2ecfb79c01d4d40850d84c3cced9240 Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServersAdminTestJSON-189468355 Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServersAdminTestJSON-189468355-project Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 72a0121eeba0467b9ac1030b4f2b6638 Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServersAdminTestJSON-189468355-project Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance 256c1311-1a56-4547-a142-0daf98661aff could not be found. Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '256c1311-1a56-4547-a142-0daf98661aff'} Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 256c1311-1a56-4547-a142-0daf98661aff could not be found. Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 256c1311-1a56-4547-a142-0daf98661aff could not be found. Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:51.001340 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:51.007873 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:51.007873 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:51.007873 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:51.007873 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:51.007873 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:51.007873 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 256c1311-1a56-4547-a142-0daf98661aff could not be found. Aug 22 17:19:51.007873 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:51.007873 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-710ea22e-00b8-4e24-84c9-283d9ec1127b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Returning 404 to user: Instance 256c1311-1a56-4547-a142-0daf98661aff could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:51.007873 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-710ea22e-00b8-4e24-84c9-283d9ec1127b tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff" status: 404 len: 111 microversion: 2.1 time: 0.115330 Aug 22 17:19:51.007873 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 805/1608] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:50 2022] GET /compute/v2.1/servers/256c1311-1a56-4547-a142-0daf98661aff => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:19:51.013538 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-34fd3893-601c-49b1-9b9d-6eb54429cdcb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:51.014741 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-34fd3893-601c-49b1-9b9d-6eb54429cdcb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:51.039754 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-34fd3893-601c-49b1-9b9d-6eb54429cdcb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:51.039754 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-34fd3893-601c-49b1-9b9d-6eb54429cdcb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:51.039754 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-34fd3893-601c-49b1-9b9d-6eb54429cdcb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:51.048743 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-34fd3893-601c-49b1-9b9d-6eb54429cdcb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:51.049347 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-34fd3893-601c-49b1-9b9d-6eb54429cdcb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:51.049803 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-34fd3893-601c-49b1-9b9d-6eb54429cdcb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:51.138417 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-34fd3893-601c-49b1-9b9d-6eb54429cdcb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Going to try to terminate instance {{(pid=123015) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:19:51.665725 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-34fd3893-601c-49b1-9b9d-6eb54429cdcb tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "DELETE /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 204 len: 0 microversion: 2.1 time: 0.655854 Aug 22 17:19:51.670273 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 804/1609] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:19:51 2022] DELETE /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:19:51.676425 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-249bdab3-5a13-4ff5-880b-462021782c30 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:51.677496 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-249bdab3-5a13-4ff5-880b-462021782c30 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:51.686135 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-249bdab3-5a13-4ff5-880b-462021782c30 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:51.686720 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-249bdab3-5a13-4ff5-880b-462021782c30 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:51.687211 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-249bdab3-5a13-4ff5-880b-462021782c30 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:51.688343 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-249bdab3-5a13-4ff5-880b-462021782c30 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:51.688834 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-249bdab3-5a13-4ff5-880b-462021782c30 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:51.689335 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-249bdab3-5a13-4ff5-880b-462021782c30 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:52.106767 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-249bdab3-5a13-4ff5-880b-462021782c30 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:52.120551 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-249bdab3-5a13-4ff5-880b-462021782c30 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1469 microversion: 2.1 time: 0.448663 Aug 22 17:19:52.127287 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 806/1610] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:51 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1469 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:53.158375 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-892e1522-82f1-4b79-b0b9-11832e2a80b2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:53.164302 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-892e1522-82f1-4b79-b0b9-11832e2a80b2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:53.172713 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:53.192210 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-892e1522-82f1-4b79-b0b9-11832e2a80b2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:53.196297 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-892e1522-82f1-4b79-b0b9-11832e2a80b2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:53.199630 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-892e1522-82f1-4b79-b0b9-11832e2a80b2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:53.200945 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-892e1522-82f1-4b79-b0b9-11832e2a80b2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:53.205311 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-892e1522-82f1-4b79-b0b9-11832e2a80b2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:53.205311 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-892e1522-82f1-4b79-b0b9-11832e2a80b2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:53.691048 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-892e1522-82f1-4b79-b0b9-11832e2a80b2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:53.716686 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-892e1522-82f1-4b79-b0b9-11832e2a80b2 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1469 microversion: 2.1 time: 0.565819 Aug 22 17:19:53.721429 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 805/1611] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:53 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1469 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:54.657662 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-d6d3345a-d8fa-44eb-bf71-2f0b35a82845 req-bc0db0c8-c35a-4b2c-b639-e7466d034760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4961b018-19fe-4ddf-8b18-1f392dc1a893", "name": "network-vif-deleted", "tag": "83c67bcc-3180-44e8-84d7-e8a3bfa77f5e"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:54.689285 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-d6d3345a-d8fa-44eb-bf71-2f0b35a82845 req-bc0db0c8-c35a-4b2c-b639-e7466d034760 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:54.689830 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-d6d3345a-d8fa-44eb-bf71-2f0b35a82845 req-bc0db0c8-c35a-4b2c-b639-e7466d034760 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:54.692425 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-d6d3345a-d8fa-44eb-bf71-2f0b35a82845 req-bc0db0c8-c35a-4b2c-b639-e7466d034760 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:54.724418 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-d6d3345a-d8fa-44eb-bf71-2f0b35a82845 req-bc0db0c8-c35a-4b2c-b639-e7466d034760 service nova] Creating event network-vif-deleted:83c67bcc-3180-44e8-84d7-e8a3bfa77f5e for instance 4961b018-19fe-4ddf-8b18-1f392dc1a893 on n-h2-854030-1 Aug 22 17:19:54.738979 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-d6d3345a-d8fa-44eb-bf71-2f0b35a82845 req-bc0db0c8-c35a-4b2c-b639-e7466d034760 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086749 Aug 22 17:19:54.740449 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 807/1612] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:19:54.751345 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f63f6b52-b820-4e82-b16f-3b2654ffdf9d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:54.752618 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f63f6b52-b820-4e82-b16f-3b2654ffdf9d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:54.779285 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f63f6b52-b820-4e82-b16f-3b2654ffdf9d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:54.780483 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f63f6b52-b820-4e82-b16f-3b2654ffdf9d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:54.780939 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f63f6b52-b820-4e82-b16f-3b2654ffdf9d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:54.788001 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f63f6b52-b820-4e82-b16f-3b2654ffdf9d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:54.788600 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f63f6b52-b820-4e82-b16f-3b2654ffdf9d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:54.789056 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f63f6b52-b820-4e82-b16f-3b2654ffdf9d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:55.016150 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f63f6b52-b820-4e82-b16f-3b2654ffdf9d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:55.043559 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f63f6b52-b820-4e82-b16f-3b2654ffdf9d tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1427 microversion: 2.1 time: 0.302103 Aug 22 17:19:55.058910 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 806/1613] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:54 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1427 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:55.658990 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5be26b1d-4256-4a55-a47b-2b13c886913f tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-168795078", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4375fa14-b0f4-4689-a348-7d1dfebe436f"}], "security_groups": [{"name": "tempest-securitygroup--1444491856"}], "key_name": "tempest-keypair-1667446711", "user_data": "}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:56.072063 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b14376bf-b34a-4825-aec8-5aa76a0bad6f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:56.072694 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b14376bf-b34a-4825-aec8-5aa76a0bad6f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:56.085350 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b14376bf-b34a-4825-aec8-5aa76a0bad6f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:56.086756 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b14376bf-b34a-4825-aec8-5aa76a0bad6f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:56.087538 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b14376bf-b34a-4825-aec8-5aa76a0bad6f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:56.090129 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b14376bf-b34a-4825-aec8-5aa76a0bad6f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:56.090803 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b14376bf-b34a-4825-aec8-5aa76a0bad6f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:56.091429 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b14376bf-b34a-4825-aec8-5aa76a0bad6f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:56.191340 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b14376bf-b34a-4825-aec8-5aa76a0bad6f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:56.192031 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b14376bf-b34a-4825-aec8-5aa76a0bad6f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:56.201507 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b14376bf-b34a-4825-aec8-5aa76a0bad6f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:56.201507 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-b14376bf-b34a-4825-aec8-5aa76a0bad6f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lazy-loading 'fault' on Instance uuid 4961b018-19fe-4ddf-8b18-1f392dc1a893 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:19:56.202325 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-5be26b1d-4256-4a55-a47b-2b13c886913f tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] validate_networks() for [('4375fa14-b0f4-4689-a348-7d1dfebe436f', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:19:56.342079 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b14376bf-b34a-4825-aec8-5aa76a0bad6f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0121eeba0467b9ac1030b4f2b6638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ecfb79c01d4d40850d84c3cced9240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:19:56.353655 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b14376bf-b34a-4825-aec8-5aa76a0bad6f tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 200 len: 1304 microversion: 2.1 time: 0.286435 Aug 22 17:19:56.371837 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 807/1614] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:56 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 1304 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:57.387820 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-992d28de-c866-4241-b9dc-533663f90199 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:57.390022 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-992d28de-c866-4241-b9dc-533663f90199 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] [instance: 4961b018-19fe-4ddf-8b18-1f392dc1a893] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:19:57.398547 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-992d28de-c866-4241-b9dc-533663f90199 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:57.399529 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-992d28de-c866-4241-b9dc-533663f90199 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:57.400338 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-992d28de-c866-4241-b9dc-533663f90199 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-5be26b1d-4256-4a55-a47b-2b13c886913f tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0ad96d18-675c-499b-a93b-0151dc614ec1) Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:19:57.400449 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0ad96d18-675c-499b-a93b-0151dc614ec1) Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-5be26b1d-4256-4a55-a47b-2b13c886913f tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5be26b1d-4256-4a55-a47b-2b13c886913f tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] Request method failure captured: Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 491 Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7qmz_AVOekDjF4SRezCVTyTjPqaG7Ui7WoZKAu-cgTd-2GC6tV9drqXnFoHtGDoMZADNU54YRoxbWBySB3AwXXQv2J14X-vVnZi19f5RpA7XbMW6aubeKWnxe7vu1qneiZionRKGovI00Mc83u1bKinhTCc-Je7eTdW4SD-8BEtCt0 Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 98ea4e0e0f7e46e0b7920256194c82d4 Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1460349284 Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/98ea4e0e0f7e46e0b7920256194c82d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_98ea4e0e0f7e46e0b7920256194c82d4", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/98ea4e0e0f7e46e0b7920256194c82d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/98ea4e0e0f7e46e0b7920256194c82d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1460349284 Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 98ea4e0e0f7e46e0b7920256194c82d4 Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1460349284 Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-AttachVolumeShelveTestJSON-1460349284-project Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 5cc533ed8b2e49aa936dc5002399f632 Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1460349284-project Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-168795078", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "4375fa14-b0f4-4689-a348-7d1dfebe436f"}], "security_groups": [{"name": "tempest-securitygroup--1444491856"}], "key_name": "tempest-keypair-1667446711", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:19:57.403581 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeShelveTestJSON-server-168795078', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '4375fa14-b0f4-4689-a348-7d1dfebe436f'}], 'security_groups': [{'name': 'tempest-securitygroup--1444491856'}], 'key_name': 'tempest-keypair-1667446711', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:19:57.407156 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0ad96d18-675c-499b-a93b-0151dc614ec1) Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5be26b1d-4256-4a55-a47b-2b13c886913f tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5be26b1d-4256-4a55-a47b-2b13c886913f tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.20 time: 1.755996 Aug 22 17:19:57.415314 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 808/1615] 10.222.0.96 () {62 vars in 1188 bytes} [Mon Aug 22 17:19:55 2022] POST /compute/v2.1/servers => generated 214 bytes in 1758 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Aug 22 17:19:57.421660 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-992d28de-c866-4241-b9dc-533663f90199 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:19:57.421660 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-992d28de-c866-4241-b9dc-533663f90199 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:19:57.423405 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-992d28de-c866-4241-b9dc-533663f90199 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:19:57.428611 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:57.433526 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d55a3c01-d2f6-4f47-9655-be5c161c6d8f tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] Calling method '.version_select at 0x7f80094a8670>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:57.451382 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-992d28de-c866-4241-b9dc-533663f90199 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] HTTP exception thrown: Instance 4961b018-19fe-4ddf-8b18-1f392dc1a893 could not be found. Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-992d28de-c866-4241-b9dc-533663f90199 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Request method failure captured: Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 HTTP/1.1 Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7oB4G2sejpUYMEXSjZgAG-oNig3yRaRgSP6pes_bO0d0J87kr3fbZQ9oEWMBmdgmuN6BortClcCMsjnoB-n45SSl4W_-x50GEjvlXkLxwyYCQ-CG7MfWdSM5HHrUtlANCCSpjxwwNQe2ghYqNZboxH6OWlgapyIrR3H07gWaKbvqFs Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: d2ecfb79c01d4d40850d84c3cced9240 Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersAdminTestJSON-189468355 Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d2ecfb79c01d4d40850d84c3cced9240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_d2ecfb79c01d4d40850d84c3cced9240", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d2ecfb79c01d4d40850d84c3cced9240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/d2ecfb79c01d4d40850d84c3cced9240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersAdminTestJSON-189468355 Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: d2ecfb79c01d4d40850d84c3cced9240 Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersAdminTestJSON-189468355 Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersAdminTestJSON-189468355-project Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 72a0121eeba0467b9ac1030b4f2b6638 Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersAdminTestJSON-189468355-project Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance 4961b018-19fe-4ddf-8b18-1f392dc1a893 could not be found. Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '4961b018-19fe-4ddf-8b18-1f392dc1a893'} Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4961b018-19fe-4ddf-8b18-1f392dc1a893 could not be found. Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4961b018-19fe-4ddf-8b18-1f392dc1a893 could not be found. Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:57.455788 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:57.459417 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:57.459417 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:57.459417 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:57.459417 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:57.459417 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:57.459417 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4961b018-19fe-4ddf-8b18-1f392dc1a893 could not be found. Aug 22 17:19:57.459417 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:19:57.461064 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-992d28de-c866-4241-b9dc-533663f90199 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] Returning 404 to user: Instance 4961b018-19fe-4ddf-8b18-1f392dc1a893 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:57.462293 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-992d28de-c866-4241-b9dc-533663f90199 tempest-ServersAdminTestJSON-189468355 tempest-ServersAdminTestJSON-189468355-project] 10.222.0.96 "GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893" status: 404 len: 111 microversion: 2.1 time: 0.086216 Aug 22 17:19:57.466387 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 808/1616] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:19:57 2022] GET /compute/v2.1/servers/4961b018-19fe-4ddf-8b18-1f392dc1a893 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:19:57.612003 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d55a3c01-d2f6-4f47-9655-be5c161c6d8f tempest-AttachVolumeShelveTestJSON-1460349284 tempest-AttachVolumeShelveTestJSON-1460349284-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667446711" status: 204 len: 0 microversion: 2.20 time: 0.189139 Aug 22 17:19:57.619786 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 809/1617] 10.222.0.96 () {60 vars in 1262 bytes} [Mon Aug 22 17:19:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667446711 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 17:20:05.518385 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fff7cb3c-7bbc-437f-9864-2eff250e5688 tempest-ServersTestBootFromVolume-1936294080 tempest-ServersTestBootFromVolume-1936294080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1519893691", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "47efabf0-9dc2-4850-9173-7ac3f7112672"}], "security_groups": [{"name": "tempest-securitygroup--594751422"}], "key_name": "tempest-keypair-1456045215", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "740b033a-da91-4c1f-b05a-3d4b8a032cf8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:06.474929 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-fff7cb3c-7bbc-437f-9864-2eff250e5688 tempest-ServersTestBootFromVolume-1936294080 tempest-ServersTestBootFromVolume-1936294080-project] validate_networks() for [('47efabf0-9dc2-4850-9173-7ac3f7112672', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:20:07.062257 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:07.063238 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-fff7cb3c-7bbc-437f-9864-2eff250e5688 tempest-ServersTestBootFromVolume-1936294080 tempest-ServersTestBootFromVolume-1936294080-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-64ae46e6-3e14-4670-8272-1b8da7afb7ae) Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:20:07.121646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:20:07.125847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:20:07.125847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:20:07.125847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:20:07.125847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:20:07.125847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:20:07.125847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:20:07.125847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:20:07.125847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:20:07.125847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:20:07.125847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:20:07.125847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:20:07.125847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:20:07.125847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:20:07.125847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:20:07.125847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:20:07.125847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-64ae46e6-3e14-4670-8272-1b8da7afb7ae) Aug 22 17:20:07.125847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.125847 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-fff7cb3c-7bbc-437f-9864-2eff250e5688 tempest-ServersTestBootFromVolume-1936294080 tempest-ServersTestBootFromVolume-1936294080-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:07.125847 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fff7cb3c-7bbc-437f-9864-2eff250e5688 tempest-ServersTestBootFromVolume-1936294080 tempest-ServersTestBootFromVolume-1936294080-project] Request method failure captured: Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 788 Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7qAHZeI3pAWIKwUg70O7_4sIde1lBa_KRsId1KsvqqPPTGV0TbY0eQZ5qyXwXe0XU-sRRkI5K8y6oUqD0LLRydiRLhK-tY8RCMfMFE5f6EJsi5BjXXca7gx9V11zDRfuAJzPPB9DnzC0K0g1-IEOXtWIqg7tNLeH7oSYrS4QGOhd_8 Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 3fa7f7d4449041479a9f6e389245679b Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersTestBootFromVolume-1936294080 Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3fa7f7d4449041479a9f6e389245679b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_3fa7f7d4449041479a9f6e389245679b", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3fa7f7d4449041479a9f6e389245679b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/3fa7f7d4449041479a9f6e389245679b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersTestBootFromVolume-1936294080 Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 3fa7f7d4449041479a9f6e389245679b Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1936294080 Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersTestBootFromVolume-1936294080-project Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: b06a1e1550924c6ab38995a97a6890df Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersTestBootFromVolume-1936294080-project Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1519893691", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "U7^w6!b@a4P_vab", "networks": [{"uuid": "47efabf0-9dc2-4850-9173-7ac3f7112672"}], "security_groups": [{"name": "tempest-securitygroup--594751422"}], "key_name": "tempest-keypair-1456045215", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "740b033a-da91-4c1f-b05a-3d4b8a032cf8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "AUTO"}} Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ServersTestBootFromVolume-server-1519893691', 'imageRef': '', 'flavorRef': '452', 'metadata': {'hello': 'world'}, 'adminPass': 'U7^w6!b@a4P_vab', 'networks': [{'uuid': '47efabf0-9dc2-4850-9173-7ac3f7112672'}], 'security_groups': [{'name': 'tempest-securitygroup--594751422'}], 'key_name': 'tempest-keypair-1456045215', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': '740b033a-da91-4c1f-b05a-3d4b8a032cf8'}]}}} Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:20:07.127557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:20:07.140226 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-64ae46e6-3e14-4670-8272-1b8da7afb7ae) Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fff7cb3c-7bbc-437f-9864-2eff250e5688 tempest-ServersTestBootFromVolume-1936294080 tempest-ServersTestBootFromVolume-1936294080-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fff7cb3c-7bbc-437f-9864-2eff250e5688 tempest-ServersTestBootFromVolume-1936294080 tempest-ServersTestBootFromVolume-1936294080-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.616932 Aug 22 17:20:07.143821 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 809/1618] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:20:05 2022] POST /compute/v2.1/servers => generated 214 bytes in 1619 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:20:07.148829 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-00ce5bfc-6b04-424a-9bd0-b99c9c5aa013 tempest-ServersTestBootFromVolume-1936294080 tempest-ServersTestBootFromVolume-1936294080-project] Calling method '.version_select at 0x7f800925ab80>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:07.245850 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-00ce5bfc-6b04-424a-9bd0-b99c9c5aa013 tempest-ServersTestBootFromVolume-1936294080 tempest-ServersTestBootFromVolume-1936294080-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1456045215" status: 202 len: 0 microversion: 2.1 time: 0.109637 Aug 22 17:20:07.246635 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 810/1619] 10.222.0.96 () {58 vars in 1221 bytes} [Mon Aug 22 17:20:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1456045215 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:20:07.481151 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:07.554256 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1ee1f7ba-da0a-4a3b-a684-cde0a8fffa71 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] Calling method '.version_select at 0x7f80094a80d0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:07.595076 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-1ee1f7ba-da0a-4a3b-a684-cde0a8fffa71 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] HTTP exception thrown: Image not found. Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1ee1f7ba-da0a-4a3b-a684-cde0a8fffa71 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] Request method failure captured: Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: request: DELETE /compute/v2.1/images/305ce1a0-469b-453e-913a-7ebe2e5fab38/metadata/os_distro HTTP/1.1 Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7rGeTRz9Lo0VAohJn24tOp6ADTudwdBl-mVxi_-a_etJsdUkZd8Nd4Kz4bs7Yha77431xQArLr_GLUgXkCWbMO4ih4OaMMPSsYGXKN-SIGDneXNagCdeWGAMPKFbJP9qbNegfZIikNTYqP_7Qu8N3ydAoXL4YxMf7woh0HyXn9yr2A Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: ef906b4533fc4753a28aab0a8f385451 Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1053131268 Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ef906b4533fc4753a28aab0a8f385451"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_ef906b4533fc4753a28aab0a8f385451", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ef906b4533fc4753a28aab0a8f385451"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/ef906b4533fc4753a28aab0a8f385451"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1053131268 Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: ef906b4533fc4753a28aab0a8f385451 Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1053131268 Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ImagesMetadataNegativeTestJSON-1053131268-project Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 9da05e755e9b4fa5a418a8f2be9d8329 Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1053131268-project Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: exception: Image not found. Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'image_id': '305ce1a0-469b-453e-913a-7ebe2e5fab38', 'id': 'os_distro'} Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 305ce1a0-469b-453e-913a-7ebe2e5fab38 Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 22 17:20:07.604275 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 305ce1a0-469b-453e-913a-7ebe2e5fab38 could not be found. Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 22 17:20:07.608433 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.616498 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1ee1f7ba-da0a-4a3b-a684-cde0a8fffa71 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] Returning 404 to user: Image not found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:07.617678 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1ee1f7ba-da0a-4a3b-a684-cde0a8fffa71 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] 10.222.0.96 "DELETE /compute/v2.1/images/305ce1a0-469b-453e-913a-7ebe2e5fab38/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.557559 Aug 22 17:20:07.618846 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 810/1620] 10.222.0.96 () {58 vars in 1293 bytes} [Mon Aug 22 17:20:07 2022] DELETE /compute/v2.1/images/305ce1a0-469b-453e-913a-7ebe2e5fab38/metadata/os_distro => generated 62 bytes in 559 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:20:07.629864 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-37c2f04a-ea37-4e0d-ab39-c50f9fb71591 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] Calling method '.version_select at 0x7f8009268280>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:07.683729 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-37c2f04a-ea37-4e0d-ab39-c50f9fb71591 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] HTTP exception thrown: Image not found. Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-37c2f04a-ea37-4e0d-ab39-c50f9fb71591 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] Request method failure captured: Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/images/4dfe3ec9-ba06-4a70-8225-b845958fe65f/metadata/os_version HTTP/1.1 Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7rGeTRz9Lo0VAohJn24tOp6ADTudwdBl-mVxi_-a_etJsdUkZd8Nd4Kz4bs7Yha77431xQArLr_GLUgXkCWbMO4ih4OaMMPSsYGXKN-SIGDneXNagCdeWGAMPKFbJP9qbNegfZIikNTYqP_7Qu8N3ydAoXL4YxMf7woh0HyXn9yr2A Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: ef906b4533fc4753a28aab0a8f385451 Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1053131268 Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ef906b4533fc4753a28aab0a8f385451"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_ef906b4533fc4753a28aab0a8f385451", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ef906b4533fc4753a28aab0a8f385451"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/ef906b4533fc4753a28aab0a8f385451"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1053131268 Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: ef906b4533fc4753a28aab0a8f385451 Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1053131268 Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ImagesMetadataNegativeTestJSON-1053131268-project Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 9da05e755e9b4fa5a418a8f2be9d8329 Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1053131268-project Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: exception: Image not found. Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'image_id': '4dfe3ec9-ba06-4a70-8225-b845958fe65f', 'id': 'os_version'} Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4dfe3ec9-ba06-4a70-8225-b845958fe65f Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 22 17:20:07.687932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4dfe3ec9-ba06-4a70-8225-b845958fe65f could not be found. Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.691800 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-37c2f04a-ea37-4e0d-ab39-c50f9fb71591 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] Returning 404 to user: Image not found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:07.700629 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-37c2f04a-ea37-4e0d-ab39-c50f9fb71591 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] 10.222.0.96 "GET /compute/v2.1/images/4dfe3ec9-ba06-4a70-8225-b845958fe65f/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.068992 Aug 22 17:20:07.700629 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 811/1621] 10.222.0.96 () {58 vars in 1293 bytes} [Mon Aug 22 17:20:07 2022] GET /compute/v2.1/images/4dfe3ec9-ba06-4a70-8225-b845958fe65f/metadata/os_version => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:20:07.719388 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e1634036-e7b9-4eb3-9721-42f732f81bf8 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] Calling method '.version_select at 0x7f80094a89d0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:07.760946 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-e1634036-e7b9-4eb3-9721-42f732f81bf8 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] HTTP exception thrown: Image not found. Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e1634036-e7b9-4eb3-9721-42f732f81bf8 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] Request method failure captured: Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/images/0361fee1-439a-4e18-b235-cb3e651f1faa/metadata HTTP/1.1 Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7rGeTRz9Lo0VAohJn24tOp6ADTudwdBl-mVxi_-a_etJsdUkZd8Nd4Kz4bs7Yha77431xQArLr_GLUgXkCWbMO4ih4OaMMPSsYGXKN-SIGDneXNagCdeWGAMPKFbJP9qbNegfZIikNTYqP_7Qu8N3ydAoXL4YxMf7woh0HyXn9yr2A Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: ef906b4533fc4753a28aab0a8f385451 Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1053131268 Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ef906b4533fc4753a28aab0a8f385451"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_ef906b4533fc4753a28aab0a8f385451", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ef906b4533fc4753a28aab0a8f385451"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/ef906b4533fc4753a28aab0a8f385451"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1053131268 Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: ef906b4533fc4753a28aab0a8f385451 Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1053131268 Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ImagesMetadataNegativeTestJSON-1053131268-project Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 9da05e755e9b4fa5a418a8f2be9d8329 Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1053131268-project Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: exception: Image not found. Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'image_id': '0361fee1-439a-4e18-b235-cb3e651f1faa'} Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0361fee1-439a-4e18-b235-cb3e651f1faa Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 22 17:20:07.766352 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0361fee1-439a-4e18-b235-cb3e651f1faa could not be found. Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 22 17:20:07.770622 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.776011 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e1634036-e7b9-4eb3-9721-42f732f81bf8 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] Returning 404 to user: Image not found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:07.783704 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e1634036-e7b9-4eb3-9721-42f732f81bf8 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] 10.222.0.96 "GET /compute/v2.1/images/0361fee1-439a-4e18-b235-cb3e651f1faa/metadata" status: 404 len: 62 microversion: 2.1 time: 0.076152 Aug 22 17:20:07.785249 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 811/1622] 10.222.0.96 () {58 vars in 1260 bytes} [Mon Aug 22 17:20:07 2022] GET /compute/v2.1/images/0361fee1-439a-4e18-b235-cb3e651f1faa/metadata => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:20:07.796910 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-86598eac-4762-4149-a4fb-7817442ef12c tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] Action: 'update_all', calling method: .version_select at 0x7f800925a160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:07.825206 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-86598eac-4762-4149-a4fb-7817442ef12c tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] HTTP exception thrown: Image not found. Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-86598eac-4762-4149-a4fb-7817442ef12c tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] Request method failure captured: Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: request: PUT /compute/v2.1/images/6d467d68-c563-4789-8779-618a64119cc9/metadata HTTP/1.1 Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 57 Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7rGeTRz9Lo0VAohJn24tOp6ADTudwdBl-mVxi_-a_etJsdUkZd8Nd4Kz4bs7Yha77431xQArLr_GLUgXkCWbMO4ih4OaMMPSsYGXKN-SIGDneXNagCdeWGAMPKFbJP9qbNegfZIikNTYqP_7Qu8N3ydAoXL4YxMf7woh0HyXn9yr2A Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: ef906b4533fc4753a28aab0a8f385451 Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1053131268 Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ef906b4533fc4753a28aab0a8f385451"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_ef906b4533fc4753a28aab0a8f385451", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ef906b4533fc4753a28aab0a8f385451"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/ef906b4533fc4753a28aab0a8f385451"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1053131268 Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: ef906b4533fc4753a28aab0a8f385451 Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1053131268 Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ImagesMetadataNegativeTestJSON-1053131268-project Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 9da05e755e9b4fa5a418a8f2be9d8329 Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1053131268-project Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: exception: Image not found. Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'image_id': '6d467d68-c563-4789-8779-618a64119cc9', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6d467d68-c563-4789-8779-618a64119cc9 Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 22 17:20:07.828476 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6d467d68-c563-4789-8779-618a64119cc9 could not be found. Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 22 17:20:07.833308 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.839748 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-86598eac-4762-4149-a4fb-7817442ef12c tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] Returning 404 to user: Image not found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:07.841206 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-86598eac-4762-4149-a4fb-7817442ef12c tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] 10.222.0.96 "PUT /compute/v2.1/images/6d467d68-c563-4789-8779-618a64119cc9/metadata" status: 404 len: 62 microversion: 2.1 time: 0.050606 Aug 22 17:20:07.843023 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 812/1623] 10.222.0.96 () {60 vars in 1280 bytes} [Mon Aug 22 17:20:07 2022] PUT /compute/v2.1/images/6d467d68-c563-4789-8779-618a64119cc9/metadata => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:20:07.852631 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c2b79fb8-ca87-4bf7-888d-e415dd133171 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] Action: 'update', calling method: .version_select at 0x7f80094a8550>, body: {"meta": {"os_distro": "alt"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:07.894579 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-c2b79fb8-ca87-4bf7-888d-e415dd133171 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] HTTP exception thrown: Image not found. Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c2b79fb8-ca87-4bf7-888d-e415dd133171 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] Request method failure captured: Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: request: PUT /compute/v2.1/images/225d43ea-705d-4943-a3ca-479479d9ed3e/metadata/os_distro HTTP/1.1 Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 30 Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7rGeTRz9Lo0VAohJn24tOp6ADTudwdBl-mVxi_-a_etJsdUkZd8Nd4Kz4bs7Yha77431xQArLr_GLUgXkCWbMO4ih4OaMMPSsYGXKN-SIGDneXNagCdeWGAMPKFbJP9qbNegfZIikNTYqP_7Qu8N3ydAoXL4YxMf7woh0HyXn9yr2A Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: ef906b4533fc4753a28aab0a8f385451 Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1053131268 Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ef906b4533fc4753a28aab0a8f385451"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_ef906b4533fc4753a28aab0a8f385451", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ef906b4533fc4753a28aab0a8f385451"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/ef906b4533fc4753a28aab0a8f385451"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1053131268 Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: ef906b4533fc4753a28aab0a8f385451 Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1053131268 Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ImagesMetadataNegativeTestJSON-1053131268-project Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 9da05e755e9b4fa5a418a8f2be9d8329 Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1053131268-project Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: {"meta": {"os_distro": "alt"}} Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: exception: Image not found. Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'image_id': '225d43ea-705d-4943-a3ca-479479d9ed3e', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 225d43ea-705d-4943-a3ca-479479d9ed3e Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 22 17:20:07.898139 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 225d43ea-705d-4943-a3ca-479479d9ed3e could not be found. Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c2b79fb8-ca87-4bf7-888d-e415dd133171 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] Returning 404 to user: Image not found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c2b79fb8-ca87-4bf7-888d-e415dd133171 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] 10.222.0.96 "PUT /compute/v2.1/images/225d43ea-705d-4943-a3ca-479479d9ed3e/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.051360 Aug 22 17:20:07.901643 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 812/1624] 10.222.0.96 () {60 vars in 1310 bytes} [Mon Aug 22 17:20:07 2022] PUT /compute/v2.1/images/225d43ea-705d-4943-a3ca-479479d9ed3e/metadata/os_distro => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:20:07.914195 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-69fd8957-89b4-458a-9f56-41cbedd5ffd8 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] Action: 'create', calling method: .version_select at 0x7f80092689d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:07.944598 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-69fd8957-89b4-458a-9f56-41cbedd5ffd8 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] HTTP exception thrown: Image not found. Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-69fd8957-89b4-458a-9f56-41cbedd5ffd8 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] Request method failure captured: Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/images/1e919e86-50f7-40c1-b0d5-c99edb79924e/metadata HTTP/1.1 Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 57 Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7rGeTRz9Lo0VAohJn24tOp6ADTudwdBl-mVxi_-a_etJsdUkZd8Nd4Kz4bs7Yha77431xQArLr_GLUgXkCWbMO4ih4OaMMPSsYGXKN-SIGDneXNagCdeWGAMPKFbJP9qbNegfZIikNTYqP_7Qu8N3ydAoXL4YxMf7woh0HyXn9yr2A Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: ef906b4533fc4753a28aab0a8f385451 Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1053131268 Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ef906b4533fc4753a28aab0a8f385451"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_ef906b4533fc4753a28aab0a8f385451", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ef906b4533fc4753a28aab0a8f385451"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/ef906b4533fc4753a28aab0a8f385451"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1053131268 Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: ef906b4533fc4753a28aab0a8f385451 Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1053131268 Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ImagesMetadataNegativeTestJSON-1053131268-project Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 9da05e755e9b4fa5a418a8f2be9d8329 Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1053131268-project Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: exception: Image not found. Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'image_id': '1e919e86-50f7-40c1-b0d5-c99edb79924e', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1e919e86-50f7-40c1-b0d5-c99edb79924e Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 22 17:20:07.947562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1e919e86-50f7-40c1-b0d5-c99edb79924e could not be found. Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 22 17:20:07.952345 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:07.959507 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-69fd8957-89b4-458a-9f56-41cbedd5ffd8 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] Returning 404 to user: Image not found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:07.959507 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-69fd8957-89b4-458a-9f56-41cbedd5ffd8 tempest-ImagesMetadataNegativeTestJSON-1053131268 tempest-ImagesMetadataNegativeTestJSON-1053131268-project] 10.222.0.96 "POST /compute/v2.1/images/1e919e86-50f7-40c1-b0d5-c99edb79924e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.049506 Aug 22 17:20:07.959507 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 813/1625] 10.222.0.96 () {60 vars in 1281 bytes} [Mon Aug 22 17:20:07 2022] POST /compute/v2.1/images/1e919e86-50f7-40c1-b0d5-c99edb79924e/metadata => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 22 17:20:18.367060 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f7445ee3-0d2b-4777-b3a7-2815e5f016cb tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] 10.222.0.96 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 1.289140 Aug 22 17:20:18.367990 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 813/1626] 10.222.0.96 () {58 vars in 1128 bytes} [Mon Aug 22 17:20:17 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 1292 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 22 17:20:18.382159 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-dc7ef39f-7acb-4902-aa4b-f14efdb8a241 tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] Calling method '.version_select at 0x7f800925a160>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:18.403383 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:18.405140 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:18.445737 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-dc7ef39f-7acb-4902-aa4b-f14efdb8a241 tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] HTTP exception thrown: Image not found. Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-dc7ef39f-7acb-4902-aa4b-f14efdb8a241 tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] Request method failure captured: Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7rQvN96-9Daz0pyvozmCNncXqq3LhlB66GGamyc9e1HFUWq4N7DDj901qdrTZ--BvDXAHxS3jE08He-dIicaWM9cmQ6KU3sQh57HI8gDUD-C9F_pZahiN4Unkt8LK1UcxUkjEQa0uIHTKd6XMLxovAIvXCf4IUdNtsk7dIusVNVb8E Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 7ca7706e4c2f44fd88effbc34a20fc5f Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1774138819 Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7ca7706e4c2f44fd88effbc34a20fc5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7ca7706e4c2f44fd88effbc34a20fc5f", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7ca7706e4c2f44fd88effbc34a20fc5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7ca7706e4c2f44fd88effbc34a20fc5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1774138819 Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 7ca7706e4c2f44fd88effbc34a20fc5f Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1774138819 Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ImagesDeleteNegativeTestJSON-1774138819-project Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 87bfefdb5b034a5284c034ba5b1a7241 Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1774138819-project Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: exception: Image not found. Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '-1'} Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.452274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-dc7ef39f-7acb-4902-aa4b-f14efdb8a241 tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] Returning 404 to user: Image not found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-dc7ef39f-7acb-4902-aa4b-f14efdb8a241 tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] 10.222.0.96 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.078077 Aug 22 17:20:18.462016 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 814/1627] 10.222.0.96 () {58 vars in 1134 bytes} [Mon Aug 22 17:20:18 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:20:18.473351 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4140a9e7-3e47-4dc4-8da5-2303c992bb2c tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] Calling method '.version_select at 0x7f80094a8940>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:18.520027 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-4140a9e7-3e47-4dc4-8da5-2303c992bb2c tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] HTTP exception thrown: Image not found. Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4140a9e7-3e47-4dc4-8da5-2303c992bb2c tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] Request method failure captured: Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: request: DELETE /compute/v2.1/images/ae26fac4-b497-4e03-b5fc-0d9f8a130a7j HTTP/1.1 Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7rQvN96-9Daz0pyvozmCNncXqq3LhlB66GGamyc9e1HFUWq4N7DDj901qdrTZ--BvDXAHxS3jE08He-dIicaWM9cmQ6KU3sQh57HI8gDUD-C9F_pZahiN4Unkt8LK1UcxUkjEQa0uIHTKd6XMLxovAIvXCf4IUdNtsk7dIusVNVb8E Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 7ca7706e4c2f44fd88effbc34a20fc5f Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1774138819 Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7ca7706e4c2f44fd88effbc34a20fc5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7ca7706e4c2f44fd88effbc34a20fc5f", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7ca7706e4c2f44fd88effbc34a20fc5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7ca7706e4c2f44fd88effbc34a20fc5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1774138819 Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 7ca7706e4c2f44fd88effbc34a20fc5f Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1774138819 Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ImagesDeleteNegativeTestJSON-1774138819-project Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 87bfefdb5b034a5284c034ba5b1a7241 Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1774138819-project Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: exception: Image not found. Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'ae26fac4-b497-4e03-b5fc-0d9f8a130a7j'} Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ae26fac4-b497-4e03-b5fc-0d9f8a130a7j to delete Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ae26fac4-b497-4e03-b5fc-0d9f8a130a7j could not be found. Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:18.521845 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4140a9e7-3e47-4dc4-8da5-2303c992bb2c tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] Returning 404 to user: Image not found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4140a9e7-3e47-4dc4-8da5-2303c992bb2c tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] 10.222.0.96 "DELETE /compute/v2.1/images/ae26fac4-b497-4e03-b5fc-0d9f8a130a7j" status: 404 len: 62 microversion: 2.1 time: 0.057059 Aug 22 17:20:18.526475 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 814/1628] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:20:18 2022] DELETE /compute/v2.1/images/ae26fac4-b497-4e03-b5fc-0d9f8a130a7j => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:20:18.536922 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-00fd26a3-4d95-4548-b752-19835901cea5 tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] Calling method '.version_select at 0x7f800925ae50>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:18.565615 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-00fd26a3-4d95-4548-b752-19835901cea5 tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] HTTP exception thrown: Image not found. Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-00fd26a3-4d95-4548-b752-19835901cea5 tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] Request method failure captured: Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/images/8098e681-b3d7-4e72-bafd-234d37dfa74a1 HTTP/1.1 Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7rQvN96-9Daz0pyvozmCNncXqq3LhlB66GGamyc9e1HFUWq4N7DDj901qdrTZ--BvDXAHxS3jE08He-dIicaWM9cmQ6KU3sQh57HI8gDUD-C9F_pZahiN4Unkt8LK1UcxUkjEQa0uIHTKd6XMLxovAIvXCf4IUdNtsk7dIusVNVb8E Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 7ca7706e4c2f44fd88effbc34a20fc5f Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1774138819 Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7ca7706e4c2f44fd88effbc34a20fc5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7ca7706e4c2f44fd88effbc34a20fc5f", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7ca7706e4c2f44fd88effbc34a20fc5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7ca7706e4c2f44fd88effbc34a20fc5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1774138819 Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 7ca7706e4c2f44fd88effbc34a20fc5f Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1774138819 Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ImagesDeleteNegativeTestJSON-1774138819-project Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 87bfefdb5b034a5284c034ba5b1a7241 Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1774138819-project Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: exception: Image not found. Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '8098e681-b3d7-4e72-bafd-234d37dfa74a1'} Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8098e681-b3d7-4e72-bafd-234d37dfa74a1 to delete Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8098e681-b3d7-4e72-bafd-234d37dfa74a1 could not be found. Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:18.567562 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 22 17:20:18.572724 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.577398 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-00fd26a3-4d95-4548-b752-19835901cea5 tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] Returning 404 to user: Image not found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:18.580229 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-00fd26a3-4d95-4548-b752-19835901cea5 tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] 10.222.0.96 "DELETE /compute/v2.1/images/8098e681-b3d7-4e72-bafd-234d37dfa74a1" status: 404 len: 62 microversion: 2.1 time: 0.047062 Aug 22 17:20:18.581128 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 815/1629] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:20:18 2022] DELETE /compute/v2.1/images/8098e681-b3d7-4e72-bafd-234d37dfa74a1 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:20:18.592168 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b22888c5-cf28-46cc-a6f8-61af03fedb15 tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] Calling method '.version_select at 0x7f80096fbca0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:18.630943 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-b22888c5-cf28-46cc-a6f8-61af03fedb15 tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] HTTP exception thrown: Image not found. Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b22888c5-cf28-46cc-a6f8-61af03fedb15 tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] Request method failure captured: Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: request: DELETE /compute/v2.1/images/tempest-invalid-474973352 HTTP/1.1 Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7rQvN96-9Daz0pyvozmCNncXqq3LhlB66GGamyc9e1HFUWq4N7DDj901qdrTZ--BvDXAHxS3jE08He-dIicaWM9cmQ6KU3sQh57HI8gDUD-C9F_pZahiN4Unkt8LK1UcxUkjEQa0uIHTKd6XMLxovAIvXCf4IUdNtsk7dIusVNVb8E Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 7ca7706e4c2f44fd88effbc34a20fc5f Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1774138819 Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7ca7706e4c2f44fd88effbc34a20fc5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7ca7706e4c2f44fd88effbc34a20fc5f", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7ca7706e4c2f44fd88effbc34a20fc5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7ca7706e4c2f44fd88effbc34a20fc5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1774138819 Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 7ca7706e4c2f44fd88effbc34a20fc5f Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1774138819 Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ImagesDeleteNegativeTestJSON-1774138819-project Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 87bfefdb5b034a5284c034ba5b1a7241 Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1774138819-project Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: exception: Image not found. Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'tempest-invalid-474973352'} Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-474973352 to delete Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-474973352 could not be found. Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.633993 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 22 17:20:18.638073 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.642069 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b22888c5-cf28-46cc-a6f8-61af03fedb15 tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] Returning 404 to user: Image not found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:18.643111 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b22888c5-cf28-46cc-a6f8-61af03fedb15 tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] 10.222.0.96 "DELETE /compute/v2.1/images/tempest-invalid-474973352" status: 404 len: 62 microversion: 2.1 time: 0.055967 Aug 22 17:20:18.644203 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 815/1630] 10.222.0.96 () {58 vars in 1203 bytes} [Mon Aug 22 17:20:18 2022] DELETE /compute/v2.1/images/tempest-invalid-474973352 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:20:18.662515 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-69598b8a-c9ac-46db-8337-c20d6a7f9feb tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] Calling method '.version_select at 0x7f8009268b80>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:18.708303 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-69598b8a-c9ac-46db-8337-c20d6a7f9feb tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] HTTP exception thrown: Image not found. Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-69598b8a-c9ac-46db-8337-c20d6a7f9feb tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] Request method failure captured: Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/images/6094af94-dad6-49ac-ab6f-fbfcd0841545 HTTP/1.1 Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7rQvN96-9Daz0pyvozmCNncXqq3LhlB66GGamyc9e1HFUWq4N7DDj901qdrTZ--BvDXAHxS3jE08He-dIicaWM9cmQ6KU3sQh57HI8gDUD-C9F_pZahiN4Unkt8LK1UcxUkjEQa0uIHTKd6XMLxovAIvXCf4IUdNtsk7dIusVNVb8E Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 7ca7706e4c2f44fd88effbc34a20fc5f Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1774138819 Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7ca7706e4c2f44fd88effbc34a20fc5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7ca7706e4c2f44fd88effbc34a20fc5f", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7ca7706e4c2f44fd88effbc34a20fc5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7ca7706e4c2f44fd88effbc34a20fc5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1774138819 Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 7ca7706e4c2f44fd88effbc34a20fc5f Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1774138819 Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ImagesDeleteNegativeTestJSON-1774138819-project Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 87bfefdb5b034a5284c034ba5b1a7241 Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1774138819-project Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: exception: Image not found. Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '6094af94-dad6-49ac-ab6f-fbfcd0841545'} Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6094af94-dad6-49ac-ab6f-fbfcd0841545 to delete Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6094af94-dad6-49ac-ab6f-fbfcd0841545 could not be found. Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:18.710318 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 22 17:20:18.713878 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:18.717827 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-69598b8a-c9ac-46db-8337-c20d6a7f9feb tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] Returning 404 to user: Image not found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:18.719021 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-69598b8a-c9ac-46db-8337-c20d6a7f9feb tempest-ImagesDeleteNegativeTestJSON-1774138819 tempest-ImagesDeleteNegativeTestJSON-1774138819-project] 10.222.0.96 "DELETE /compute/v2.1/images/6094af94-dad6-49ac-ab6f-fbfcd0841545" status: 404 len: 62 microversion: 2.1 time: 0.060280 Aug 22 17:20:18.720154 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 816/1631] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:20:18 2022] DELETE /compute/v2.1/images/6094af94-dad6-49ac-ab6f-fbfcd0841545 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:20:19.767173 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-825d77e4-8f71-49f6-a005-e5cdfeb8b412 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Action: 'create', calling method: .version_select at 0x7f80094eddc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-326466226"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:21.258343 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-825d77e4-8f71-49f6-a005-e5cdfeb8b412 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.566082 Aug 22 17:20:21.258343 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 816/1632] 10.222.0.96 () {60 vars in 1155 bytes} [Mon Aug 22 17:20:18 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2568 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 22 17:20:21.280208 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-24cd6b9c-839d-4c87-9029-73f017b8cf4a tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f80092a2d30>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:21.458256 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-24cd6b9c-839d-4c87-9029-73f017b8cf4a tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed" status: 200 len: 344 microversion: 2.1 time: 0.183728 Aug 22 17:20:21.458256 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 817/1633] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:20:21 2022] GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed => generated 344 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:22.467573 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9eb7d4d8-85f4-4489-ab6e-dcece9031cac tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f8009470940>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:22.588012 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9eb7d4d8-85f4-4489-ab6e-dcece9031cac tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed" status: 200 len: 344 microversion: 2.1 time: 0.126236 Aug 22 17:20:22.588751 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 817/1634] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:20:22 2022] GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed => generated 344 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:23.329620 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-19275a39-8382-411b-a3fc-b6748dcf68bd tempest-InstanceActionsTestJSON-636966595 tempest-InstanceActionsTestJSON-636966595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-595466376", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "2293d1fa-acb4-40f7-ba2b-abb551f73c95"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:23.468413 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-19275a39-8382-411b-a3fc-b6748dcf68bd tempest-InstanceActionsTestJSON-636966595 tempest-InstanceActionsTestJSON-636966595-project] validate_networks() for [('2293d1fa-acb4-40f7-ba2b-abb551f73c95', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:20:23.604751 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-65c4a250-a353-41b6-adf6-f1340925a980 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f80094a8940>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:23.695749 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-65c4a250-a353-41b6-adf6-f1340925a980 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed" status: 200 len: 345 microversion: 2.1 time: 0.094932 Aug 22 17:20:23.697017 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 818/1635] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:20:23 2022] GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed => generated 345 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:20:23.709354 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1132434e-f142-47d5-b796-21ff227af715 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Action: 'create', calling method: .version_select at 0x7f80096fb280>, body: {"snapshot": {"volume_id": "4d987ea4-7290-4821-88c5-d013bf7f12ed", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1938438074"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-19275a39-8382-411b-a3fc-b6748dcf68bd tempest-InstanceActionsTestJSON-636966595 tempest-InstanceActionsTestJSON-636966595-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f439e53c-fced-4dc6-9eeb-07c3401f184f) Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:20:23.950654 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f439e53c-fced-4dc6-9eeb-07c3401f184f) Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-19275a39-8382-411b-a3fc-b6748dcf68bd tempest-InstanceActionsTestJSON-636966595 tempest-InstanceActionsTestJSON-636966595-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-19275a39-8382-411b-a3fc-b6748dcf68bd tempest-InstanceActionsTestJSON-636966595 tempest-InstanceActionsTestJSON-636966595-project] Request method failure captured: Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 208 Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7rWmKgokUjaP9UgE0ES56fP0jsFjnY5CZBNvkMBbKea9LnsgY6nZRqM4AQdK7jf8fLADnMViFSrF-eskoBPsYs2IgVimS3pujzeg4WDQdgDKTOIo2IlCO3Q3dNawpkdx9ndcrt5WN5Rc7Jwdi01N7yQk2uqQDIIBQouTRqPoS3RPPA Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 7ecd3af4b0154702b754df055d550167 Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-InstanceActionsTestJSON-636966595 Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7ecd3af4b0154702b754df055d550167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7ecd3af4b0154702b754df055d550167", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7ecd3af4b0154702b754df055d550167"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7ecd3af4b0154702b754df055d550167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-InstanceActionsTestJSON-636966595 Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 7ecd3af4b0154702b754df055d550167 Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-InstanceActionsTestJSON-636966595 Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-InstanceActionsTestJSON-636966595-project Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: f74686945a0849f3993f71b2dd1cdb57 Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-InstanceActionsTestJSON-636966595-project Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-InstanceActionsTestJSON-server-595466376", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "2293d1fa-acb4-40f7-ba2b-abb551f73c95"}]}} Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-InstanceActionsTestJSON-server-595466376', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '2293d1fa-acb4-40f7-ba2b-abb551f73c95'}]}}} Aug 22 17:20:23.954681 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:20:23.959427 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f439e53c-fced-4dc6-9eeb-07c3401f184f) Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-19275a39-8382-411b-a3fc-b6748dcf68bd tempest-InstanceActionsTestJSON-636966595 tempest-InstanceActionsTestJSON-636966595-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-19275a39-8382-411b-a3fc-b6748dcf68bd tempest-InstanceActionsTestJSON-636966595 tempest-InstanceActionsTestJSON-636966595-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.210864 Aug 22 17:20:23.970722 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 818/1636] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:20:22 2022] POST /compute/v2.1/servers => generated 214 bytes in 1213 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:20:24.363320 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1132434e-f142-47d5-b796-21ff227af715 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.657823 Aug 22 17:20:24.363902 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 819/1637] 10.222.0.96 () {60 vars in 1162 bytes} [Mon Aug 22 17:20:23 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:20:24.376814 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e33f627f-4c82-491c-8daa-2cc812081631 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f800925a040>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:24.567777 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e33f627f-4c82-491c-8daa-2cc812081631 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea" status: 200 len: 287 microversion: 2.1 time: 0.196684 Aug 22 17:20:24.590580 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 819/1638] 10.222.0.96 () {58 vars in 1251 bytes} [Mon Aug 22 17:20:24 2022] GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea => generated 287 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:24.590675 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-38039e5d-c938-4933-b032-656afca523c4 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f80094705e0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:24.713155 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-38039e5d-c938-4933-b032-656afca523c4 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.134191 Aug 22 17:20:24.716701 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 820/1639] 10.222.0.96 () {58 vars in 1140 bytes} [Mon Aug 22 17:20:24 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:24.724890 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-67e1e104-bcc0-4b25-b935-73ca922b6efa tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f80092a2d30>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:24.783153 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-67e1e104-bcc0-4b25-b935-73ca922b6efa tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea" status: 200 len: 287 microversion: 2.1 time: 0.062084 Aug 22 17:20:24.783585 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 820/1640] 10.222.0.96 () {58 vars in 1251 bytes} [Mon Aug 22 17:20:24 2022] GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:25.803014 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-65301c4e-acd7-4b28-9d25-317a915689e7 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f8009a2f5e0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:25.962264 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-65301c4e-acd7-4b28-9d25-317a915689e7 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea" status: 200 len: 287 microversion: 2.1 time: 0.169810 Aug 22 17:20:25.962923 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 821/1641] 10.222.0.96 () {58 vars in 1251 bytes} [Mon Aug 22 17:20:25 2022] GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea => generated 287 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:20:26.988443 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-19892df1-9043-4e1b-babc-1a5b0d109ee5 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f800925a1f0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:27.096753 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-19892df1-9043-4e1b-babc-1a5b0d109ee5 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea" status: 200 len: 287 microversion: 2.1 time: 0.114450 Aug 22 17:20:27.099437 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 821/1642] 10.222.0.96 () {58 vars in 1251 bytes} [Mon Aug 22 17:20:26 2022] GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea => generated 287 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:28.021343 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-82504cc6-c0da-4e76-a185-0baad32843a6 tempest-ListImagesTestJSON-2129992111 tempest-ListImagesTestJSON-2129992111-project] Calling method '.version_select at 0x7f8009470a60>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:28.115172 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f1502cc2-1612-4bd3-b103-33c63798415a tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f80096e03a0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:28.131746 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-82504cc6-c0da-4e76-a185-0baad32843a6 tempest-ListImagesTestJSON-2129992111 tempest-ListImagesTestJSON-2129992111-project] 10.222.0.96 "GET /compute/v2.1/images/11a48bbe-9c58-420e-95bf-5f8489a49f10" status: 200 len: 784 microversion: 2.1 time: 0.994918 Aug 22 17:20:28.139327 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 822/1643] 10.222.0.96 () {58 vars in 1233 bytes} [Mon Aug 22 17:20:27 2022] GET /compute/v2.1/images/11a48bbe-9c58-420e-95bf-5f8489a49f10 => generated 784 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:28.164613 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f7ef4783-eaea-4c3a-bb1d-3e9871c5c211 tempest-ListImagesTestJSON-2129992111 tempest-ListImagesTestJSON-2129992111-project] Calling method '.version_select at 0x7f800971cca0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:28.208446 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f1502cc2-1612-4bd3-b103-33c63798415a tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea" status: 200 len: 287 microversion: 2.1 time: 0.100727 Aug 22 17:20:28.209070 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 822/1644] 10.222.0.96 () {58 vars in 1251 bytes} [Mon Aug 22 17:20:28 2022] GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea => generated 287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:28.415894 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f7ef4783-eaea-4c3a-bb1d-3e9871c5c211 tempest-ListImagesTestJSON-2129992111 tempest-ListImagesTestJSON-2129992111-project] 10.222.0.96 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.265869 Aug 22 17:20:28.424034 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 823/1645] 10.222.0.96 () {58 vars in 1122 bytes} [Mon Aug 22 17:20:28 2022] GET /compute/v2.1/images => generated 445 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:28.430012 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4c08742a-d5b0-4365-9587-522e1c820db6 tempest-ListImagesTestJSON-2129992111 tempest-ListImagesTestJSON-2129992111-project] Calling method '.version_select at 0x7f8009268160>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:28.506635 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-4c08742a-d5b0-4365-9587-522e1c820db6 tempest-ListImagesTestJSON-2129992111 tempest-ListImagesTestJSON-2129992111-project] 10.222.0.96 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.079945 Aug 22 17:20:28.520831 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 823/1646] 10.222.0.96 () {58 vars in 1143 bytes} [Mon Aug 22 17:20:28 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:20:29.222799 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f8a7f964-dcd1-45cb-bf64-1bd44aa74527 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f8009a2ff70>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:29.283542 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f8a7f964-dcd1-45cb-bf64-1bd44aa74527 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea" status: 200 len: 288 microversion: 2.1 time: 0.065619 Aug 22 17:20:29.285152 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 824/1647] 10.222.0.96 () {58 vars in 1251 bytes} [Mon Aug 22 17:20:29 2022] GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea => generated 288 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:29.300327 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c75fbc8d-60e1-4c6d-8af7-39f8129735be tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f800925a790>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:29.487080 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c75fbc8d-60e1-4c6d-8af7-39f8129735be tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "DELETE /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea" status: 202 len: 0 microversion: 2.1 time: 0.194568 Aug 22 17:20:29.488566 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 824/1648] 10.222.0.96 () {58 vars in 1254 bytes} [Mon Aug 22 17:20:29 2022] DELETE /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:20:29.497126 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2cfa3a48-d40a-46c5-ba24-b8525cec5226 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f800a0751f0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:29.560846 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2cfa3a48-d40a-46c5-ba24-b8525cec5226 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea" status: 200 len: 287 microversion: 2.1 time: 0.067384 Aug 22 17:20:29.561821 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 825/1649] 10.222.0.96 () {58 vars in 1251 bytes} [Mon Aug 22 17:20:29 2022] GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:30.576603 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5d34730d-20e1-4b2a-9634-6ed4d98ab937 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f800925a430>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:30.646926 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5d34730d-20e1-4b2a-9634-6ed4d98ab937 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea" status: 200 len: 287 microversion: 2.1 time: 0.077003 Aug 22 17:20:30.647606 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 825/1650] 10.222.0.96 () {58 vars in 1251 bytes} [Mon Aug 22 17:20:30 2022] GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:31.662800 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e779275b-c836-4a74-b7a2-6b6b050ad511 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f8009a0cc10>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:31.733175 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e779275b-c836-4a74-b7a2-6b6b050ad511 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea" status: 200 len: 287 microversion: 2.1 time: 0.075608 Aug 22 17:20:31.734409 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 826/1651] 10.222.0.96 () {58 vars in 1251 bytes} [Mon Aug 22 17:20:31 2022] GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:32.748665 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-07142fdb-7cbc-48c1-8459-b567d255e4f5 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f800924b160>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:32.896712 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-07142fdb-7cbc-48c1-8459-b567d255e4f5 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea" status: 200 len: 287 microversion: 2.1 time: 0.145581 Aug 22 17:20:32.897820 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 826/1652] 10.222.0.96 () {58 vars in 1251 bytes} [Mon Aug 22 17:20:32 2022] GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea => generated 287 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:33.929691 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2d87aae6-c410-4205-877c-a68c06c2d25c tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f8009470820>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:33.969340 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-2d87aae6-c410-4205-877c-a68c06c2d25c tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] HTTP exception thrown: Snapshot 5d410b16-d840-4a36-87af-b684072ae0ea could not be found. Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2d87aae6-c410-4205-877c-a68c06c2d25c tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Request method failure captured: Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea HTTP/1.1 Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7rSHzfbUx-fdWl9GF-3wRxYxHmwz0iU7uwifuyPqFf8jpNBg5dz5I8q1YtE778_Syfl-XNHqIy5uTsEibwECFvfmPCFsR4-y5omn6H9OMMVyYZ9NNV7KGl3CRd8mfBMgz9xAKrQx0MgxiZE8Oi0wCiwU4bN4wZhqQ6KXnDifgutQ34 Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 4a1337a8fb7f460c88afee8031667533 Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1161757842 Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4a1337a8fb7f460c88afee8031667533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_4a1337a8fb7f460c88afee8031667533", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4a1337a8fb7f460c88afee8031667533"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/4a1337a8fb7f460c88afee8031667533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1161757842 Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 4a1337a8fb7f460c88afee8031667533 Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1161757842 Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-VolumesSnapshotsTestJSON-1161757842-project Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 0396f424904542b8a297949d09b495ec Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1161757842-project Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: exception: Snapshot 5d410b16-d840-4a36-87af-b684072ae0ea could not be found. Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '5d410b16-d840-4a36-87af-b684072ae0ea'} Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5d410b16-d840-4a36-87af-b684072ae0ea could not be found. (HTTP 404) (Request-ID: req-866cb08a-2b65-453b-8e83-f796a01d1224) Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 17:20:33.980899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5d410b16-d840-4a36-87af-b684072ae0ea could not be found. Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5d410b16-d840-4a36-87af-b684072ae0ea could not be found. Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5d410b16-d840-4a36-87af-b684072ae0ea could not be found. Aug 22 17:20:33.986744 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:33.996865 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2d87aae6-c410-4205-877c-a68c06c2d25c tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Returning 404 to user: Snapshot 5d410b16-d840-4a36-87af-b684072ae0ea could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:34.001728 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2d87aae6-c410-4205-877c-a68c06c2d25c tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea" status: 404 len: 111 microversion: 2.1 time: 0.090867 Aug 22 17:20:34.001728 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 827/1653] 10.222.0.96 () {58 vars in 1251 bytes} [Mon Aug 22 17:20:33 2022] GET /compute/v2.1/os-snapshots/5d410b16-d840-4a36-87af-b684072ae0ea => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:20:34.011353 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0a5019df-3757-44c8-8bd0-af79127f9a49 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f800924b3a0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:34.022706 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:34.269925 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0a5019df-3757-44c8-8bd0-af79127f9a49 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "DELETE /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed" status: 202 len: 0 microversion: 2.1 time: 0.264166 Aug 22 17:20:34.270950 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 827/1654] 10.222.0.96 () {58 vars in 1248 bytes} [Mon Aug 22 17:20:34 2022] DELETE /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:20:34.280707 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-caeaa764-b967-4fe6-96a8-c5d5999c87a9 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f8009a2f940>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:34.412497 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-caeaa764-b967-4fe6-96a8-c5d5999c87a9 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed" status: 200 len: 344 microversion: 2.1 time: 0.137015 Aug 22 17:20:34.413072 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 828/1655] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:20:34 2022] GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed => generated 344 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:35.454169 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-45b8e79b-04a1-44da-a5b9-59e414960724 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f800924b280>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:35.737769 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-45b8e79b-04a1-44da-a5b9-59e414960724 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed" status: 200 len: 344 microversion: 2.1 time: 0.313988 Aug 22 17:20:35.738655 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 828/1656] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:20:35 2022] GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed => generated 344 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:36.753954 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6d2254b7-3030-4693-a065-7099c755bf1f tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f8009470550>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:36.857760 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-6d2254b7-3030-4693-a065-7099c755bf1f tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed" status: 200 len: 344 microversion: 2.1 time: 0.109639 Aug 22 17:20:36.864791 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 829/1657] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:20:36 2022] GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed => generated 344 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:37.873879 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-35aed56f-fe0a-405a-a73d-5f21087251ba tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f800924bd30>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:37.954867 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-35aed56f-fe0a-405a-a73d-5f21087251ba tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed" status: 200 len: 344 microversion: 2.1 time: 0.085584 Aug 22 17:20:37.956082 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 829/1658] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:20:37 2022] GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed => generated 344 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:38.882200 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d66183fd-7572-46a6-ad62-f3c2edc4da0b tempest-ServersTestFqdnHostnames-679687293 tempest-ServersTestFqdnHostnames-679687293-project] Action: 'create', calling method: .version_select at 0x7f800c66e4c0>, body: {"keypair": {"name": "tempest-keypair-1255375044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFI7tBDUomCYX5NWRnUCnotTBX6ogh8kg+C/8ASqEXXp/r1GiBZyhRhoiEQ9ndyfTn2pjaZviVbFMR57uYqGEeo75oSsGRFAnjf3mSPJ1lG+8i+5NTnT4kLIszdOwBzm2g=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:38.923375 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-d66183fd-7572-46a6-ad62-f3c2edc4da0b tempest-ServersTestFqdnHostnames-679687293 tempest-ServersTestFqdnHostnames-679687293-project] Getting quotas for project 329ee1b59a634c578a9975a06885e2cc. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:20:38.951181 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-d66183fd-7572-46a6-ad62-f3c2edc4da0b tempest-ServersTestFqdnHostnames-679687293 tempest-ServersTestFqdnHostnames-679687293-project] Getting quotas for user d7e8d91e5bc149fd805504e9466e25d4 and project 329ee1b59a634c578a9975a06885e2cc. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:20:38.970681 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a304342a-4a2a-4e63-a9cb-0d6a04ebb85a tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f800925ac10>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:39.043826 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-a304342a-4a2a-4e63-a9cb-0d6a04ebb85a tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] HTTP exception thrown: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a304342a-4a2a-4e63-a9cb-0d6a04ebb85a tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Request method failure captured: Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed HTTP/1.1 Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7rSHzfbUx-fdWl9GF-3wRxYxHmwz0iU7uwifuyPqFf8jpNBg5dz5I8q1YtE778_Syfl-XNHqIy5uTsEibwECFvfmPCFsR4-y5omn6H9OMMVyYZ9NNV7KGl3CRd8mfBMgz9xAKrQx0MgxiZE8Oi0wCiwU4bN4wZhqQ6KXnDifgutQ34 Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 4a1337a8fb7f460c88afee8031667533 Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1161757842 Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4a1337a8fb7f460c88afee8031667533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_4a1337a8fb7f460c88afee8031667533", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4a1337a8fb7f460c88afee8031667533"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/4a1337a8fb7f460c88afee8031667533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1161757842 Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 4a1337a8fb7f460c88afee8031667533 Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1161757842 Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-VolumesSnapshotsTestJSON-1161757842-project Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 0396f424904542b8a297949d09b495ec Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1161757842-project Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: exception: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '4d987ea4-7290-4821-88c5-d013bf7f12ed'} Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. (HTTP 404) (Request-ID: req-4175c093-af59-48e4-9b4a-bb28ba3389a9) Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 17:20:39.048714 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a304342a-4a2a-4e63-a9cb-0d6a04ebb85a tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Returning 404 to user: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a304342a-4a2a-4e63-a9cb-0d6a04ebb85a tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed" status: 404 len: 109 microversion: 2.1 time: 0.085141 Aug 22 17:20:39.057895 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 830/1659] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:20:38 2022] GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:20:39.086837 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-756c1cbe-f593-4780-b69d-03666c226f7c tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f800925a790>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:39.098027 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d66183fd-7572-46a6-ad62-f3c2edc4da0b tempest-ServersTestFqdnHostnames-679687293 tempest-ServersTestFqdnHostnames-679687293-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.938659 Aug 22 17:20:39.099928 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 830/1660] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:20:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:39.173044 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-756c1cbe-f593-4780-b69d-03666c226f7c tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] HTTP exception thrown: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-756c1cbe-f593-4780-b69d-03666c226f7c tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Request method failure captured: Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed HTTP/1.1 Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7rSHzfbUx-fdWl9GF-3wRxYxHmwz0iU7uwifuyPqFf8jpNBg5dz5I8q1YtE778_Syfl-XNHqIy5uTsEibwECFvfmPCFsR4-y5omn6H9OMMVyYZ9NNV7KGl3CRd8mfBMgz9xAKrQx0MgxiZE8Oi0wCiwU4bN4wZhqQ6KXnDifgutQ34 Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 4a1337a8fb7f460c88afee8031667533 Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1161757842 Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4a1337a8fb7f460c88afee8031667533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_4a1337a8fb7f460c88afee8031667533", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4a1337a8fb7f460c88afee8031667533"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/4a1337a8fb7f460c88afee8031667533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1161757842 Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 4a1337a8fb7f460c88afee8031667533 Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1161757842 Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-VolumesSnapshotsTestJSON-1161757842-project Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 0396f424904542b8a297949d09b495ec Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1161757842-project Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: exception: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '4d987ea4-7290-4821-88c5-d013bf7f12ed'} Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. (HTTP 404) (Request-ID: req-92ded909-7cd1-4cb9-9606-a72d249dd10b) Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 17:20:39.180058 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.183875 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-756c1cbe-f593-4780-b69d-03666c226f7c tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Returning 404 to user: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:39.186581 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-756c1cbe-f593-4780-b69d-03666c226f7c tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "DELETE /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed" status: 404 len: 109 microversion: 2.1 time: 0.127819 Aug 22 17:20:39.187091 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 831/1661] 10.222.0.96 () {58 vars in 1248 bytes} [Mon Aug 22 17:20:39 2022] DELETE /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed => generated 109 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:20:39.216009 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6f131a6d-afda-4e82-91de-b34e957d4da2 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Calling method '.version_select at 0x7f800924b940>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:39.293525 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-6f131a6d-afda-4e82-91de-b34e957d4da2 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] HTTP exception thrown: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6f131a6d-afda-4e82-91de-b34e957d4da2 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Request method failure captured: Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed HTTP/1.1 Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7rSHzfbUx-fdWl9GF-3wRxYxHmwz0iU7uwifuyPqFf8jpNBg5dz5I8q1YtE778_Syfl-XNHqIy5uTsEibwECFvfmPCFsR4-y5omn6H9OMMVyYZ9NNV7KGl3CRd8mfBMgz9xAKrQx0MgxiZE8Oi0wCiwU4bN4wZhqQ6KXnDifgutQ34 Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 4a1337a8fb7f460c88afee8031667533 Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1161757842 Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4a1337a8fb7f460c88afee8031667533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_4a1337a8fb7f460c88afee8031667533", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4a1337a8fb7f460c88afee8031667533"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/4a1337a8fb7f460c88afee8031667533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1161757842 Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 4a1337a8fb7f460c88afee8031667533 Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1161757842 Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-VolumesSnapshotsTestJSON-1161757842-project Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 0396f424904542b8a297949d09b495ec Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1161757842-project Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: exception: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '4d987ea4-7290-4821-88c5-d013bf7f12ed'} Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. (HTTP 404) (Request-ID: req-a356da3b-427f-435c-86ee-b8b67c3b77c6) Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 17:20:39.297251 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6f131a6d-afda-4e82-91de-b34e957d4da2 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] Returning 404 to user: Volume 4d987ea4-7290-4821-88c5-d013bf7f12ed could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6f131a6d-afda-4e82-91de-b34e957d4da2 tempest-VolumesSnapshotsTestJSON-1161757842 tempest-VolumesSnapshotsTestJSON-1161757842-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed" status: 404 len: 109 microversion: 2.1 time: 0.107526 Aug 22 17:20:39.301860 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 832/1662] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:20:39 2022] GET /compute/v2.1/os-volumes/4d987ea4-7290-4821-88c5-d013bf7f12ed => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:20:39.915336 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-76ff61a2-5ae4-4836-b3b2-9b62f7dcdce9 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Action: 'create', calling method: .version_select at 0x7f8009470a60>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVdlKn4orRzcKv+GRWLGkG+9d1Cbj7lEqB2SKdS6PtRaUQsiPc1bMpuX5+Nqt1d5a3EPAGUkZHgZOMIdfMxO+2LuO9yUDmCBcesGKmdWzmmtXlJxZLvRPPtrXBb994EgA=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-76ff61a2-5ae4-4836-b3b2-9b62f7dcdce9 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Request method failure captured: Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 257 Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7rmcKFD1u0F9SGXhKRcs0s_YIGGCQ5_f5RHZxw1erdUOr3AKJ04IkTmj0XVjexVLBt4k2VjZZnt_eOoP48HeHRmSKdduk6_VNgGzFG1nphjnRcvZIKykXMhDPQShIOQxsbj0IBJ_KNDx5eF0GQ-5CFLVc_xxz4o9hizG77qe-cnyxs Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 3243c5a5533f4bbbb363b2e41c760b35 Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_3243c5a5533f4bbbb363b2e41c760b35", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 3243c5a5533f4bbbb363b2e41c760b35 Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-KeyPairsNegativeTestJSON-1825390587-project Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 104356b8a2024e889d764b4ba418b800 Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1825390587-project Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVdlKn4orRzcKv+GRWLGkG+9d1Cbj7lEqB2SKdS6PtRaUQsiPc1bMpuX5+Nqt1d5a3EPAGUkZHgZOMIdfMxO+2LuO9yUDmCBcesGKmdWzmmtXlJxZLvRPPtrXBb994EgA=="}} Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVdlKn4orRzcKv+GRWLGkG+9d1Cbj7lEqB2SKdS6PtRaUQsiPc1bMpuX5+Nqt1d5a3EPAGUkZHgZOMIdfMxO+2LuO9yUDmCBcesGKmdWzmmtXlJxZLvRPPtrXBb994EgA=='}}} Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 22 17:20:39.923578 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 22 17:20:39.927866 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:39.932475 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-76ff61a2-5ae4-4836-b3b2-9b62f7dcdce9 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:39.934880 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-76ff61a2-5ae4-4836-b3b2-9b62f7dcdce9 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.833340 Aug 22 17:20:39.940691 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 831/1663] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:20:39 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 836 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:20:39.948157 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8bb0311a-593c-43db-bbf9-94bbafb5a92b tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Action: 'create', calling method: .version_select at 0x7f80092a2ee0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-528262098", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:39.977779 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-8bb0311a-593c-43db-bbf9-94bbafb5a92b tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Getting quotas for project 3243c5a5533f4bbbb363b2e41c760b35. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:20:39.978395 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-8bb0311a-593c-43db-bbf9-94bbafb5a92b tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Getting quotas for user 104356b8a2024e889d764b4ba418b800 and project 3243c5a5533f4bbbb363b2e41c760b35. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:20:40.021574 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-8bb0311a-593c-43db-bbf9-94bbafb5a92b tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8bb0311a-593c-43db-bbf9-94bbafb5a92b tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Request method failure captured: Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 2166 Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7rmcKFD1u0F9SGXhKRcs0s_YIGGCQ5_f5RHZxw1erdUOr3AKJ04IkTmj0XVjexVLBt4k2VjZZnt_eOoP48HeHRmSKdduk6_VNgGzFG1nphjnRcvZIKykXMhDPQShIOQxsbj0IBJ_KNDx5eF0GQ-5CFLVc_xxz4o9hizG77qe-cnyxs Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 3243c5a5533f4bbbb363b2e41c760b35 Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_3243c5a5533f4bbbb363b2e41c760b35", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 3243c5a5533f4bbbb363b2e41c760b35 Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-KeyPairsNegativeTestJSON-1825390587-project Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 104356b8a2024e889d764b4ba418b800 Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1825390587-project Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-528262098", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:20:40.054171 n-d-854030-1 devstack@n-api.service[123015]: exception: Keypair data is invalid: failed to generate fingerprint Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-528262098', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:40.056384 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:40.061169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:40.061169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:40.061169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:40.061169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:40.061169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 22 17:20:40.061169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 22 17:20:40.061169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 22 17:20:40.061169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 22 17:20:40.061169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 22 17:20:40.061169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.061169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:40.061169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.061169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:40.061169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:40.061169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:40.061169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:40.061169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:40.061169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 22 17:20:40.061169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.065511 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8bb0311a-593c-43db-bbf9-94bbafb5a92b tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:40.066847 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8bb0311a-593c-43db-bbf9-94bbafb5a92b tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.125050 Aug 22 17:20:40.068043 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 833/1664] 10.222.0.96 () {60 vars in 1160 bytes} [Mon Aug 22 17:20:39 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 22 17:20:40.082651 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e43e9c28-f90d-40c3-ac65-ae94da3cb9b0 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Action: 'create', calling method: .version_select at 0x7f80094ed4c0>, body: {"keypair": {"name": "tempest-keypair-1103715297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRh8UAQJDeoo05Ej7xug2bGbdn0X+2rk6xkt5eY1QSg8MVvPdun6oc1Fk+Omaji7r7Eoa+iG7IZ/BWsMctO1s6HtKD74UsFklQgVDSjWiPCYTJ94IFgMxozMYDSya0/Pg=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:40.109955 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-e43e9c28-f90d-40c3-ac65-ae94da3cb9b0 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Getting quotas for project 3243c5a5533f4bbbb363b2e41c760b35. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:20:40.117678 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-e43e9c28-f90d-40c3-ac65-ae94da3cb9b0 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Getting quotas for user 104356b8a2024e889d764b4ba418b800 and project 3243c5a5533f4bbbb363b2e41c760b35. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:20:40.627407 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e43e9c28-f90d-40c3-ac65-ae94da3cb9b0 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.549116 Aug 22 17:20:40.629774 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 832/1665] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:20:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:40.644234 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-82a11703-7675-47ee-b894-99371b923a43 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Action: 'create', calling method: .version_select at 0x7f80091dc700>, body: {"keypair": {"name": "tempest-keypair-1103715297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4zVOr6vWWzDHqf0Wynpl8IBeBm7T7ZdvE+JB9Wz0YyVMpXWz3hk3+4h++mwrzH1ImzT2hgtkJtRNK5ahjTv3TlzoCcx4K0R85I4C+NVFb8gNcax92cya0gq4v43kaCvQ=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:40.673654 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-82a11703-7675-47ee-b894-99371b923a43 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Getting quotas for project 3243c5a5533f4bbbb363b2e41c760b35. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:20:40.681949 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-82a11703-7675-47ee-b894-99371b923a43 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Getting quotas for user 104356b8a2024e889d764b4ba418b800 and project 3243c5a5533f4bbbb363b2e41c760b35. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:20:40.761131 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-82a11703-7675-47ee-b894-99371b923a43 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] HTTP exception thrown: Key pair 'tempest-keypair-1103715297' already exists. Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-82a11703-7675-47ee-b894-99371b923a43 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Request method failure captured: Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 273 Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7rmcKFD1u0F9SGXhKRcs0s_YIGGCQ5_f5RHZxw1erdUOr3AKJ04IkTmj0XVjexVLBt4k2VjZZnt_eOoP48HeHRmSKdduk6_VNgGzFG1nphjnRcvZIKykXMhDPQShIOQxsbj0IBJ_KNDx5eF0GQ-5CFLVc_xxz4o9hizG77qe-cnyxs Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 3243c5a5533f4bbbb363b2e41c760b35 Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_3243c5a5533f4bbbb363b2e41c760b35", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 3243c5a5533f4bbbb363b2e41c760b35 Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-KeyPairsNegativeTestJSON-1825390587-project Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 104356b8a2024e889d764b4ba418b800 Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1825390587-project Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: {"keypair": {"name": "tempest-keypair-1103715297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4zVOr6vWWzDHqf0Wynpl8IBeBm7T7ZdvE+JB9Wz0YyVMpXWz3hk3+4h++mwrzH1ImzT2hgtkJtRNK5ahjTv3TlzoCcx4K0R85I4C+NVFb8gNcax92cya0gq4v43kaCvQ=="}} Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: exception: Key pair 'tempest-keypair-1103715297' already exists. Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1103715297', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4zVOr6vWWzDHqf0Wynpl8IBeBm7T7ZdvE+JB9Wz0YyVMpXWz3hk3+4h++mwrzH1ImzT2hgtkJtRNK5ahjTv3TlzoCcx4K0R85I4C+NVFb8gNcax92cya0gq4v43kaCvQ=='}}} Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result.read() Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '104356b8a2024e889d764b4ba418b800-tempest-keypair-1103715297' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 22 17:20:40.781506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi session.flush() Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result.read() Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 22 17:20:40.786137 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '104356b8a2024e889d764b4ba418b800-tempest-keypair-1103715297' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 22, 17, 20, 40, 713995), 'updated_at': None, 'name': 'tempest-keypair-1103715297', 'user_id': '104356b8a2024e889d764b4ba418b800', 'fingerprint': '09:65:f4:ab:63:bb:77:01:5b:3f:4a:dc:b6:4a:d4:bd', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4zVOr6vWWzDHqf0Wynpl8IBeBm7T7ZdvE+JB9Wz0YyVMpXWz3hk3+4h++mwrzH1ImzT2hgtkJtRNK5ahjTv3TlzoCcx4K0R85I4C+NVFb8gNcax92cya0gq4v43kaCvQ==', 'type': 'ssh'}] Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keypair.create() Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._create() Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1103715297' already exists. Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 22 17:20:40.796540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1103715297' already exists. Aug 22 17:20:40.800585 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.800585 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:40.800585 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.800585 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:40.800585 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:40.800585 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:40.800585 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:40.800585 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:40.800585 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1103715297' already exists. Aug 22 17:20:40.800585 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.800585 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-82a11703-7675-47ee-b894-99371b923a43 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Returning 409 to user: Key pair 'tempest-keypair-1103715297' already exists. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:40.800585 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-82a11703-7675-47ee-b894-99371b923a43 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.143810 Aug 22 17:20:40.800585 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 834/1666] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:20:40 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 22 17:20:40.801683 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-769cb120-90c7-4f6a-8c4c-8b0a847ab882 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Calling method '.version_select at 0x7f8009a2f9d0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:40.929924 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-769cb120-90c7-4f6a-8c4c-8b0a847ab882 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1103715297" status: 202 len: 0 microversion: 2.1 time: 0.137771 Aug 22 17:20:40.931340 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 833/1667] 10.222.0.96 () {58 vars in 1221 bytes} [Mon Aug 22 17:20:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1103715297 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:20:40.944370 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c6a032eb-a14b-44a8-9fc9-176e5b999c65 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Action: 'create', calling method: .version_select at 0x7f80091dc5e0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/9ty6kXQFV2qE5zo+ch2zFULqruMcTMSQBL+tmVrQM6j1e5GUDKD3KHoZAQYJaUhv4QuaU5PiDvfeWemFZKYN8jZ6hgO06xeBev6g6dFjkao3dfQwbQUGre0dSEPUaZw=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c6a032eb-a14b-44a8-9fc9-176e5b999c65 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Request method failure captured: Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 247 Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7rmcKFD1u0F9SGXhKRcs0s_YIGGCQ5_f5RHZxw1erdUOr3AKJ04IkTmj0XVjexVLBt4k2VjZZnt_eOoP48HeHRmSKdduk6_VNgGzFG1nphjnRcvZIKykXMhDPQShIOQxsbj0IBJ_KNDx5eF0GQ-5CFLVc_xxz4o9hizG77qe-cnyxs Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 3243c5a5533f4bbbb363b2e41c760b35 Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_3243c5a5533f4bbbb363b2e41c760b35", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 3243c5a5533f4bbbb363b2e41c760b35 Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-KeyPairsNegativeTestJSON-1825390587-project Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 104356b8a2024e889d764b4ba418b800 Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1825390587-project Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/9ty6kXQFV2qE5zo+ch2zFULqruMcTMSQBL+tmVrQM6j1e5GUDKD3KHoZAQYJaUhv4QuaU5PiDvfeWemFZKYN8jZ6hgO06xeBev6g6dFjkao3dfQwbQUGre0dSEPUaZw=="}} Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/9ty6kXQFV2qE5zo+ch2zFULqruMcTMSQBL+tmVrQM6j1e5GUDKD3KHoZAQYJaUhv4QuaU5PiDvfeWemFZKYN8jZ6hgO06xeBev6g6dFjkao3dfQwbQUGre0dSEPUaZw=='}}} Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi '' Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:20:40.955274 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:20:40.959675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:20:40.959675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:20:40.959675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:20:40.959675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:20:40.959675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 22 17:20:40.959675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.959675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:40.959675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.959675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:40.959675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:40.959675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:40.959675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:20:40.959675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:20:40.959675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 22 17:20:40.959675 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:40.962634 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c6a032eb-a14b-44a8-9fc9-176e5b999c65 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:40.963809 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c6a032eb-a14b-44a8-9fc9-176e5b999c65 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.023743 Aug 22 17:20:40.965065 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 835/1668] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:20:40 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:20:40.975586 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8c70b4d1-93d4-4fc1-9b0a-414c47644e5b tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Action: 'create', calling method: .version_select at 0x7f800a0ff3a0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2089412770", "public_key": " "}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:41.009355 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-8c70b4d1-93d4-4fc1-9b0a-414c47644e5b tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Getting quotas for project 3243c5a5533f4bbbb363b2e41c760b35. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:20:41.027886 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-8c70b4d1-93d4-4fc1-9b0a-414c47644e5b tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Getting quotas for user 104356b8a2024e889d764b4ba418b800 and project 3243c5a5533f4bbbb363b2e41c760b35. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:20:41.067371 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-8c70b4d1-93d4-4fc1-9b0a-414c47644e5b tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8c70b4d1-93d4-4fc1-9b0a-414c47644e5b tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Request method failure captured: Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 95 Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7rmcKFD1u0F9SGXhKRcs0s_YIGGCQ5_f5RHZxw1erdUOr3AKJ04IkTmj0XVjexVLBt4k2VjZZnt_eOoP48HeHRmSKdduk6_VNgGzFG1nphjnRcvZIKykXMhDPQShIOQxsbj0IBJ_KNDx5eF0GQ-5CFLVc_xxz4o9hizG77qe-cnyxs Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 3243c5a5533f4bbbb363b2e41c760b35 Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_3243c5a5533f4bbbb363b2e41c760b35", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 3243c5a5533f4bbbb363b2e41c760b35 Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-KeyPairsNegativeTestJSON-1825390587-project Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 104356b8a2024e889d764b4ba418b800 Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1825390587-project Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2089412770", "public_key": " "}} Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: exception: Keypair data is invalid: failed to generate fingerprint Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2089412770', 'public_key': ' '}}} Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:41.074033 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.086070 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8c70b4d1-93d4-4fc1-9b0a-414c47644e5b tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:41.087619 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8c70b4d1-93d4-4fc1-9b0a-414c47644e5b tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.114905 Aug 22 17:20:41.089813 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 834/1669] 10.222.0.96 () {60 vars in 1158 bytes} [Mon Aug 22 17:20:40 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 22 17:20:41.119836 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-49369eee-fc0b-4b82-8347-0c943b0af7c2 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Action: 'create', calling method: .version_select at 0x7f80092609d0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+/+HDeHw4tvEGPw7HewV4+5zoN+q1bIM0+OP1tSYvGMw/a8a0j1eK5z12xGQ/MlpVtTftFDd4mFvsbn2zJhyBPGw654/3motxCdX2NNA2VMLmuDVf4RTmZAzmQ+i/bSg=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-49369eee-fc0b-4b82-8347-0c943b0af7c2 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Request method failure captured: Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 507 Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7rmcKFD1u0F9SGXhKRcs0s_YIGGCQ5_f5RHZxw1erdUOr3AKJ04IkTmj0XVjexVLBt4k2VjZZnt_eOoP48HeHRmSKdduk6_VNgGzFG1nphjnRcvZIKykXMhDPQShIOQxsbj0IBJ_KNDx5eF0GQ-5CFLVc_xxz4o9hizG77qe-cnyxs Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 3243c5a5533f4bbbb363b2e41c760b35 Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_3243c5a5533f4bbbb363b2e41c760b35", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 3243c5a5533f4bbbb363b2e41c760b35 Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-KeyPairsNegativeTestJSON-1825390587-project Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 104356b8a2024e889d764b4ba418b800 Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1825390587-project Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+/+HDeHw4tvEGPw7HewV4+5zoN+q1bIM0+OP1tSYvGMw/a8a0j1eK5z12xGQ/MlpVtTftFDd4mFvsbn2zJhyBPGw654/3motxCdX2NNA2VMLmuDVf4RTmZAzmQ+i/bSg=="}} Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+/+HDeHw4tvEGPw7HewV4+5zoN+q1bIM0+OP1tSYvGMw/a8a0j1eK5z12xGQ/MlpVtTftFDd4mFvsbn2zJhyBPGw654/3motxCdX2NNA2VMLmuDVf4RTmZAzmQ+i/bSg=='}}} Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 22 17:20:41.149437 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-49369eee-fc0b-4b82-8347-0c943b0af7c2 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-49369eee-fc0b-4b82-8347-0c943b0af7c2 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.051011 Aug 22 17:20:41.161245 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 836/1670] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:20:41 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:20:41.183825 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1193b980-4180-42de-9dbb-03bfe85007b5 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Action: 'create', calling method: .version_select at 0x7f8009470820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1704279296", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:41.224851 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-1193b980-4180-42de-9dbb-03bfe85007b5 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Getting quotas for project 3243c5a5533f4bbbb363b2e41c760b35. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:20:41.257188 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-1193b980-4180-42de-9dbb-03bfe85007b5 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Getting quotas for user 104356b8a2024e889d764b4ba418b800 and project 3243c5a5533f4bbbb363b2e41c760b35. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:20:41.338459 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-1193b980-4180-42de-9dbb-03bfe85007b5 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1193b980-4180-42de-9dbb-03bfe85007b5 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Request method failure captured: Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 118 Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7rmcKFD1u0F9SGXhKRcs0s_YIGGCQ5_f5RHZxw1erdUOr3AKJ04IkTmj0XVjexVLBt4k2VjZZnt_eOoP48HeHRmSKdduk6_VNgGzFG1nphjnRcvZIKykXMhDPQShIOQxsbj0IBJ_KNDx5eF0GQ-5CFLVc_xxz4o9hizG77qe-cnyxs Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 3243c5a5533f4bbbb363b2e41c760b35 Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_3243c5a5533f4bbbb363b2e41c760b35", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 3243c5a5533f4bbbb363b2e41c760b35 Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-KeyPairsNegativeTestJSON-1825390587-project Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 104356b8a2024e889d764b4ba418b800 Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1825390587-project Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1704279296", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: exception: Keypair data is invalid: failed to generate fingerprint Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1704279296', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 22 17:20:41.346107 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1193b980-4180-42de-9dbb-03bfe85007b5 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1193b980-4180-42de-9dbb-03bfe85007b5 tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.182857 Aug 22 17:20:41.357046 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 835/1671] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:20:41 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 22 17:20:41.362826 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8280c12d-5c9e-4626-8507-9970d5f99fed tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Calling method '.version_select at 0x7f800924b4c0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:41.417032 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-8280c12d-5c9e-4626-8507-9970d5f99fed tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-982678554 not found for user 104356b8a2024e889d764b4ba418b800 Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8280c12d-5c9e-4626-8507-9970d5f99fed tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Request method failure captured: Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-982678554 HTTP/1.1 Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7rmcKFD1u0F9SGXhKRcs0s_YIGGCQ5_f5RHZxw1erdUOr3AKJ04IkTmj0XVjexVLBt4k2VjZZnt_eOoP48HeHRmSKdduk6_VNgGzFG1nphjnRcvZIKykXMhDPQShIOQxsbj0IBJ_KNDx5eF0GQ-5CFLVc_xxz4o9hizG77qe-cnyxs Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 3243c5a5533f4bbbb363b2e41c760b35 Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_3243c5a5533f4bbbb363b2e41c760b35", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/3243c5a5533f4bbbb363b2e41c760b35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 3243c5a5533f4bbbb363b2e41c760b35 Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1825390587 Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-KeyPairsNegativeTestJSON-1825390587-project Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 104356b8a2024e889d764b4ba418b800 Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1825390587-project Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: exception: Keypair tempest-keypair-non-existent-982678554 not found for user 104356b8a2024e889d764b4ba418b800 Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'tempest-keypair-non-existent-982678554'} Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise self.value Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6856, in delete_key_pair Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6877, in get_key_pair Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-982678554 not found for user 104356b8a2024e889d764b4ba418b800 Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.418975 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-982678554 not found for user 104356b8a2024e889d764b4ba418b800 Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-982678554 not found for user 104356b8a2024e889d764b4ba418b800 Aug 22 17:20:41.423187 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:41.428619 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8280c12d-5c9e-4626-8507-9970d5f99fed tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] Returning 404 to user: Keypair tempest-keypair-non-existent-982678554 not found for user 104356b8a2024e889d764b4ba418b800 {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:41.429669 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8280c12d-5c9e-4626-8507-9970d5f99fed tempest-KeyPairsNegativeTestJSON-1825390587 tempest-KeyPairsNegativeTestJSON-1825390587-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-982678554" status: 404 len: 144 microversion: 2.1 time: 0.072838 Aug 22 17:20:41.431240 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 837/1672] 10.222.0.96 () {58 vars in 1257 bytes} [Mon Aug 22 17:20:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-982678554 => generated 144 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:20:46.373839 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-afac1732-ed57-4fd0-b865-faee890e24ba tempest-TaggedBootDevicesTest-131510051 tempest-TaggedBootDevicesTest-131510051-project] Action: 'create', calling method: .version_select at 0x7f8009fbdd30>, body: {"keypair": {"name": "tempest-keypair-1103560391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPUfJn4dgIF9sJ9VFCiM4je3ZFGpJZ5DMKp757rFbZwO4XrsJbbJ/U5o6zCHM+QrBS5Z6HKPCeG/7xwwVmS4jm2xGEOuBVf1exyRzgvJXhTw0pd/VyIdRgIR6ph3ncFeQ=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:46.444894 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-afac1732-ed57-4fd0-b865-faee890e24ba tempest-TaggedBootDevicesTest-131510051 tempest-TaggedBootDevicesTest-131510051-project] Getting quotas for project e7a83b63b87548c7b1564219a1b491b1. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:20:46.475179 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-afac1732-ed57-4fd0-b865-faee890e24ba tempest-TaggedBootDevicesTest-131510051 tempest-TaggedBootDevicesTest-131510051-project] Getting quotas for user c47fc008053442778e7203bc70f701ac and project e7a83b63b87548c7b1564219a1b491b1. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:20:46.661120 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-afac1732-ed57-4fd0-b865-faee890e24ba tempest-TaggedBootDevicesTest-131510051 tempest-TaggedBootDevicesTest-131510051-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.294681 Aug 22 17:20:46.662404 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 836/1673] 10.222.0.96 () {62 vars in 1200 bytes} [Mon Aug 22 17:20:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 297 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 22 17:20:47.552492 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b809775c-3d51-4c10-9867-a4cb88578d3f tempest-ServersTestFqdnHostnames-679687293 tempest-ServersTestFqdnHostnames-679687293-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "0db40355-9ae4-4bbd-9ee1-1be69fab5923"}], "security_groups": [{"name": "tempest-securitygroup--1104091126"}], "key_name": "tempest-keypair-1255375044", "user_data": "}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:47.772416 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-b809775c-3d51-4c10-9867-a4cb88578d3f tempest-ServersTestFqdnHostnames-679687293 tempest-ServersTestFqdnHostnames-679687293-project] validate_networks() for [('0db40355-9ae4-4bbd-9ee1-1be69fab5923', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:20:48.640069 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2ef9f913-0bc9-44f8-9b8c-ad07f8deca91 tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] Action: 'create', calling method: .version_select at 0x7f80094ed5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-14470153", "metadata": {"Type": "work"}}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2ef9f913-0bc9-44f8-9b8c-ad07f8deca91 tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] Request method failure captured: Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 120 Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7rv6yugOy4wqg-i0ghJ0r4AT6bpBCDu30lRcz8sQDeBRfAjzPhaWnWEsJinyjOddwy1SHYKZ1bYG-GG7b5WrNmRYnZ-SCzm0JkSFkvo6wTIbi7nnbp7JimjEDBX00MtXfV6zAANC0xziKDqNmP0KyelRyKVbu0fMqBzkfjSiULRELQ Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: a213b03eb24a4be4aed762bf8cf7c1c8 Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-VolumesNegativeTest-2075994299 Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a213b03eb24a4be4aed762bf8cf7c1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_a213b03eb24a4be4aed762bf8cf7c1c8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a213b03eb24a4be4aed762bf8cf7c1c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/a213b03eb24a4be4aed762bf8cf7c1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-VolumesNegativeTest-2075994299 Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: a213b03eb24a4be4aed762bf8cf7c1c8 Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-VolumesNegativeTest-2075994299 Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-VolumesNegativeTest-2075994299-project Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: f3d71e83e89b4ee4ad45a47a0a714c61 Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-VolumesNegativeTest-2075994299-project Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-14470153", "metadata": {"Type": "work"}}} Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-14470153', 'metadata': {'Type': 'work'}}}} Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi '#$%' Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:20:48.651988 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:20:48.657355 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 17:20:48.657355 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.657355 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:48.657355 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.657355 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:48.657355 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:48.657355 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:48.657355 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:20:48.657355 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:20:48.657355 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 17:20:48.657355 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.663955 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2ef9f913-0bc9-44f8-9b8c-ad07f8deca91 tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:48.665185 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2ef9f913-0bc9-44f8-9b8c-ad07f8deca91 tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] 10.222.0.96 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.821204 Aug 22 17:20:48.670513 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 837/1674] 10.222.0.96 () {60 vars in 1156 bytes} [Mon Aug 22 17:20:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 827 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:20:48.692677 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2effe435-01b9-4075-8f88-1c71bea905c9 tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] Action: 'create', calling method: .version_select at 0x7f80094a8f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1605644320", "metadata": {"Type": "work"}}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-b809775c-3d51-4c10-9867-a4cb88578d3f tempest-ServersTestFqdnHostnames-679687293 tempest-ServersTestFqdnHostnames-679687293-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-12b58181-e838-4465-9857-dbe22fc79bff) Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:20:48.704589 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:20:48.708540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:20:48.708540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:20:48.708540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:20:48.708540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:20:48.708540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:20:48.708540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:20:48.708540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:20:48.708540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:20:48.708540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:20:48.708540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:20:48.708540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:20:48.708540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:20:48.708540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:20:48.708540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:20:48.708540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:20:48.708540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-12b58181-e838-4465-9857-dbe22fc79bff) Aug 22 17:20:48.708540 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.711087 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-b809775c-3d51-4c10-9867-a4cb88578d3f tempest-ServersTestFqdnHostnames-679687293 tempest-ServersTestFqdnHostnames-679687293-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:48.711087 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b809775c-3d51-4c10-9867-a4cb88578d3f tempest-ServersTestFqdnHostnames-679687293 tempest-ServersTestFqdnHostnames-679687293-project] Request method failure captured: Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 499 Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7rmZyaYGLEeMZRUa9W0jIGIikHD6HJC65UX-ppBJZIZE8pBXIT9EM8HGkCAbkbVu0I9qU_dkElG0xOfB7HpsmoRYCta4qwlv4BWIKBPW6eQLbwyuuGh7rhEM-W9ATeENYKfBcFANgn9NPXc-NTG9lTryfu9ya-x65O0h703reFvzgw Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 329ee1b59a634c578a9975a06885e2cc Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersTestFqdnHostnames-679687293 Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/329ee1b59a634c578a9975a06885e2cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_329ee1b59a634c578a9975a06885e2cc", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/329ee1b59a634c578a9975a06885e2cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/329ee1b59a634c578a9975a06885e2cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersTestFqdnHostnames-679687293 Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 329ee1b59a634c578a9975a06885e2cc Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-679687293 Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersTestFqdnHostnames-679687293-project Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: d7e8d91e5bc149fd805504e9466e25d4 Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersTestFqdnHostnames-679687293-project Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "X8=kfE4q!nJJ6tZ", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "0db40355-9ae4-4bbd-9ee1-1be69fab5923"}], "security_groups": [{"name": "tempest-securitygroup--1104091126"}], "key_name": "tempest-keypair-1255375044", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'guest-instance-1.domain.com', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'adminPass': 'X8=kfE4q!nJJ6tZ', 'networks': [{'uuid': '0db40355-9ae4-4bbd-9ee1-1be69fab5923'}], 'security_groups': [{'name': 'tempest-securitygroup--1104091126'}], 'key_name': 'tempest-keypair-1255375044', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:20:48.713707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-12b58181-e838-4465-9857-dbe22fc79bff) Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:48.717289 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:48.720976 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:48.720976 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:48.720976 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:48.720976 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:20:48.720976 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:20:48.720976 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:48.720976 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.720976 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.720976 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:48.720976 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.720976 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:48.720976 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:48.720976 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:48.720976 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:48.720976 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:48.720976 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:48.720976 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.720976 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.723922 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b809775c-3d51-4c10-9867-a4cb88578d3f tempest-ServersTestFqdnHostnames-679687293 tempest-ServersTestFqdnHostnames-679687293-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:48.723922 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:48.725743 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b809775c-3d51-4c10-9867-a4cb88578d3f tempest-ServersTestFqdnHostnames-679687293 tempest-ServersTestFqdnHostnames-679687293-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.181293 Aug 22 17:20:48.726919 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 838/1675] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:20:47 2022] POST /compute/v2.1/servers => generated 214 bytes in 1185 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2effe435-01b9-4075-8f88-1c71bea905c9 tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] Request method failure captured: Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 120 Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7rv6yugOy4wqg-i0ghJ0r4AT6bpBCDu30lRcz8sQDeBRfAjzPhaWnWEsJinyjOddwy1SHYKZ1bYG-GG7b5WrNmRYnZ-SCzm0JkSFkvo6wTIbi7nnbp7JimjEDBX00MtXfV6zAANC0xziKDqNmP0KyelRyKVbu0fMqBzkfjSiULRELQ Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: a213b03eb24a4be4aed762bf8cf7c1c8 Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-VolumesNegativeTest-2075994299 Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a213b03eb24a4be4aed762bf8cf7c1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_a213b03eb24a4be4aed762bf8cf7c1c8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a213b03eb24a4be4aed762bf8cf7c1c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/a213b03eb24a4be4aed762bf8cf7c1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-VolumesNegativeTest-2075994299 Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: a213b03eb24a4be4aed762bf8cf7c1c8 Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-VolumesNegativeTest-2075994299 Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-VolumesNegativeTest-2075994299-project Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: f3d71e83e89b4ee4ad45a47a0a714c61 Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-VolumesNegativeTest-2075994299-project Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1605644320", "metadata": {"Type": "work"}}} Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1605644320', 'metadata': {'Type': 'work'}}}} Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi '0' Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:20:48.729813 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:20:48.734070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 17:20:48.734070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.734070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:48.734070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.734070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:48.734070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:48.734070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:48.734070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:20:48.734070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:20:48.734070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 17:20:48.734070 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.738311 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2effe435-01b9-4075-8f88-1c71bea905c9 tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:48.742972 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2effe435-01b9-4075-8f88-1c71bea905c9 tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] 10.222.0.96 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.061873 Aug 22 17:20:48.743788 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 838/1676] 10.222.0.96 () {60 vars in 1156 bytes} [Mon Aug 22 17:20:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 22 17:20:48.773627 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-82a7a1d3-0f54-47e1-97ad-55fd6ffad513 tempest-ServersTestFqdnHostnames-679687293 tempest-ServersTestFqdnHostnames-679687293-project] Calling method '.version_select at 0x7f800925a790>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:48.773738 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8200228c-cc1d-40f7-9e1d-2fcbe047fda4 tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] Action: 'create', calling method: .version_select at 0x7f80096fbaf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-995627863", "metadata": {"Type": "work"}}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8200228c-cc1d-40f7-9e1d-2fcbe047fda4 tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] Request method failure captured: Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 118 Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7rv6yugOy4wqg-i0ghJ0r4AT6bpBCDu30lRcz8sQDeBRfAjzPhaWnWEsJinyjOddwy1SHYKZ1bYG-GG7b5WrNmRYnZ-SCzm0JkSFkvo6wTIbi7nnbp7JimjEDBX00MtXfV6zAANC0xziKDqNmP0KyelRyKVbu0fMqBzkfjSiULRELQ Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: a213b03eb24a4be4aed762bf8cf7c1c8 Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-VolumesNegativeTest-2075994299 Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a213b03eb24a4be4aed762bf8cf7c1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_a213b03eb24a4be4aed762bf8cf7c1c8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a213b03eb24a4be4aed762bf8cf7c1c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/a213b03eb24a4be4aed762bf8cf7c1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-VolumesNegativeTest-2075994299 Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: a213b03eb24a4be4aed762bf8cf7c1c8 Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-VolumesNegativeTest-2075994299 Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-VolumesNegativeTest-2075994299-project Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: f3d71e83e89b4ee4ad45a47a0a714c61 Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-VolumesNegativeTest-2075994299-project Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-995627863", "metadata": {"Type": "work"}}} Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-995627863', 'metadata': {'Type': 'work'}}}} Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi '' Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:20:48.784749 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:20:48.788615 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 17:20:48.788615 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.788615 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:48.788615 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.788615 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:48.788615 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:48.788615 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:48.788615 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:20:48.788615 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:20:48.788615 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 17:20:48.788615 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.795186 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8200228c-cc1d-40f7-9e1d-2fcbe047fda4 tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:48.802120 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8200228c-cc1d-40f7-9e1d-2fcbe047fda4 tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] 10.222.0.96 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.047668 Aug 22 17:20:48.806896 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 839/1677] 10.222.0.96 () {60 vars in 1156 bytes} [Mon Aug 22 17:20:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:20:48.823056 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2f29f824-e52d-4db9-b226-e4562088b86e tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] Calling method '.version_select at 0x7f8009a2f9d0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:48.892567 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-82a7a1d3-0f54-47e1-97ad-55fd6ffad513 tempest-ServersTestFqdnHostnames-679687293 tempest-ServersTestFqdnHostnames-679687293-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255375044" status: 202 len: 0 microversion: 2.1 time: 0.155997 Aug 22 17:20:48.894341 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 839/1678] 10.222.0.96 () {58 vars in 1221 bytes} [Mon Aug 22 17:20:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255375044 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-2f29f824-e52d-4db9-b226-e4562088b86e tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] HTTP exception thrown: Volume tempest-invalid-1328679794 could not be found. Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2f29f824-e52d-4db9-b226-e4562088b86e tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] Request method failure captured: Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1328679794 HTTP/1.1 Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7rv6yugOy4wqg-i0ghJ0r4AT6bpBCDu30lRcz8sQDeBRfAjzPhaWnWEsJinyjOddwy1SHYKZ1bYG-GG7b5WrNmRYnZ-SCzm0JkSFkvo6wTIbi7nnbp7JimjEDBX00MtXfV6zAANC0xziKDqNmP0KyelRyKVbu0fMqBzkfjSiULRELQ Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: a213b03eb24a4be4aed762bf8cf7c1c8 Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-VolumesNegativeTest-2075994299 Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a213b03eb24a4be4aed762bf8cf7c1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_a213b03eb24a4be4aed762bf8cf7c1c8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a213b03eb24a4be4aed762bf8cf7c1c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/a213b03eb24a4be4aed762bf8cf7c1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-VolumesNegativeTest-2075994299 Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: a213b03eb24a4be4aed762bf8cf7c1c8 Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-VolumesNegativeTest-2075994299 Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-VolumesNegativeTest-2075994299-project Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: f3d71e83e89b4ee4ad45a47a0a714c61 Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-VolumesNegativeTest-2075994299-project Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: exception: Volume tempest-invalid-1328679794 could not be found. Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'tempest-invalid-1328679794'} Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1328679794 could not be found. (HTTP 404) (Request-ID: req-f58e7fc0-529d-4fbb-8a30-81a565924761) Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 17:20:48.926815 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1328679794 could not be found. Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1328679794 could not be found. Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1328679794 could not be found. Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2f29f824-e52d-4db9-b226-e4562088b86e tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] Returning 404 to user: Volume tempest-invalid-1328679794 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2f29f824-e52d-4db9-b226-e4562088b86e tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] 10.222.0.96 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1328679794" status: 404 len: 99 microversion: 2.1 time: 0.106047 Aug 22 17:20:48.930555 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 840/1679] 10.222.0.96 () {58 vars in 1218 bytes} [Mon Aug 22 17:20:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1328679794 => generated 99 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:20:48.934150 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e791b9cd-6a51-4f3b-835d-5e4a930f6259 tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] 10.222.0.96 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004615 Aug 22 17:20:48.936278 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 840/1680] 10.222.0.96 () {58 vars in 1140 bytes} [Mon Aug 22 17:20:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 22 17:20:48.946782 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-dac905ff-19a5-4923-9c4c-bc40068f56a9 tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004969 Aug 22 17:20:48.957181 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 841/1681] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:20:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 22 17:20:48.982277 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ee59bddb-7b2b-47f7-85f0-e8f55e83460a tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] Calling method '.version_select at 0x7f800972cf70>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:49.047257 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-ee59bddb-7b2b-47f7-85f0-e8f55e83460a tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] HTTP exception thrown: Volume aaf85ef6-5d12-4aec-8f28-f2037ad17821 could not be found. Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ee59bddb-7b2b-47f7-85f0-e8f55e83460a tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] Request method failure captured: Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: request: DELETE /compute/v2.1/os-volumes/aaf85ef6-5d12-4aec-8f28-f2037ad17821 HTTP/1.1 Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7rv6yugOy4wqg-i0ghJ0r4AT6bpBCDu30lRcz8sQDeBRfAjzPhaWnWEsJinyjOddwy1SHYKZ1bYG-GG7b5WrNmRYnZ-SCzm0JkSFkvo6wTIbi7nnbp7JimjEDBX00MtXfV6zAANC0xziKDqNmP0KyelRyKVbu0fMqBzkfjSiULRELQ Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: a213b03eb24a4be4aed762bf8cf7c1c8 Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-VolumesNegativeTest-2075994299 Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a213b03eb24a4be4aed762bf8cf7c1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_a213b03eb24a4be4aed762bf8cf7c1c8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a213b03eb24a4be4aed762bf8cf7c1c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/a213b03eb24a4be4aed762bf8cf7c1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-VolumesNegativeTest-2075994299 Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: a213b03eb24a4be4aed762bf8cf7c1c8 Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-VolumesNegativeTest-2075994299 Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-VolumesNegativeTest-2075994299-project Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: f3d71e83e89b4ee4ad45a47a0a714c61 Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-VolumesNegativeTest-2075994299-project Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: method: Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: exception: Volume aaf85ef6-5d12-4aec-8f28-f2037ad17821 could not be found. Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'aaf85ef6-5d12-4aec-8f28-f2037ad17821'} Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aaf85ef6-5d12-4aec-8f28-f2037ad17821 could not be found. (HTTP 404) (Request-ID: req-49b2a68b-8922-48c7-a707-3e9eb1d7e019) Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 17:20:49.050358 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aaf85ef6-5d12-4aec-8f28-f2037ad17821 could not be found. Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aaf85ef6-5d12-4aec-8f28-f2037ad17821 could not be found. Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aaf85ef6-5d12-4aec-8f28-f2037ad17821 could not be found. Aug 22 17:20:49.057644 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:49.069935 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ee59bddb-7b2b-47f7-85f0-e8f55e83460a tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] Returning 404 to user: Volume aaf85ef6-5d12-4aec-8f28-f2037ad17821 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:49.069935 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ee59bddb-7b2b-47f7-85f0-e8f55e83460a tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] 10.222.0.96 "DELETE /compute/v2.1/os-volumes/aaf85ef6-5d12-4aec-8f28-f2037ad17821" status: 404 len: 109 microversion: 2.1 time: 0.089279 Aug 22 17:20:49.072094 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 841/1682] 10.222.0.96 () {58 vars in 1248 bytes} [Mon Aug 22 17:20:48 2022] DELETE /compute/v2.1/os-volumes/aaf85ef6-5d12-4aec-8f28-f2037ad17821 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:20:49.076924 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ef7f616e-fa5c-4129-9115-2ad45d7bfbc9 tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] Calling method '.version_select at 0x7f80094a8b80>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:49.138643 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-ef7f616e-fa5c-4129-9115-2ad45d7bfbc9 tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] HTTP exception thrown: Volume e58911b3-a625-4400-9ed5-42204671254c could not be found. Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ef7f616e-fa5c-4129-9115-2ad45d7bfbc9 tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] Request method failure captured: Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/os-volumes/e58911b3-a625-4400-9ed5-42204671254c HTTP/1.1 Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7rv6yugOy4wqg-i0ghJ0r4AT6bpBCDu30lRcz8sQDeBRfAjzPhaWnWEsJinyjOddwy1SHYKZ1bYG-GG7b5WrNmRYnZ-SCzm0JkSFkvo6wTIbi7nnbp7JimjEDBX00MtXfV6zAANC0xziKDqNmP0KyelRyKVbu0fMqBzkfjSiULRELQ Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: a213b03eb24a4be4aed762bf8cf7c1c8 Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-VolumesNegativeTest-2075994299 Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a213b03eb24a4be4aed762bf8cf7c1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_a213b03eb24a4be4aed762bf8cf7c1c8", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a213b03eb24a4be4aed762bf8cf7c1c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/a213b03eb24a4be4aed762bf8cf7c1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-VolumesNegativeTest-2075994299 Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: a213b03eb24a4be4aed762bf8cf7c1c8 Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-VolumesNegativeTest-2075994299 Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-VolumesNegativeTest-2075994299-project Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: f3d71e83e89b4ee4ad45a47a0a714c61 Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-VolumesNegativeTest-2075994299-project Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: method: Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: exception: Volume e58911b3-a625-4400-9ed5-42204671254c could not be found. Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'e58911b3-a625-4400-9ed5-42204671254c'} Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e58911b3-a625-4400-9ed5-42204671254c could not be found. (HTTP 404) (Request-ID: req-8b5efbd4-1868-4e52-be55-ebd7b45ac1c8) Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 17:20:49.145293 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e58911b3-a625-4400-9ed5-42204671254c could not be found. Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e58911b3-a625-4400-9ed5-42204671254c could not be found. Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e58911b3-a625-4400-9ed5-42204671254c could not be found. Aug 22 17:20:49.149560 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:20:49.155131 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ef7f616e-fa5c-4129-9115-2ad45d7bfbc9 tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] Returning 404 to user: Volume e58911b3-a625-4400-9ed5-42204671254c could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:49.156281 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ef7f616e-fa5c-4129-9115-2ad45d7bfbc9 tempest-VolumesNegativeTest-2075994299 tempest-VolumesNegativeTest-2075994299-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/e58911b3-a625-4400-9ed5-42204671254c" status: 404 len: 109 microversion: 2.1 time: 0.085540 Aug 22 17:20:49.157503 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 842/1683] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:20:49 2022] GET /compute/v2.1/os-volumes/e58911b3-a625-4400-9ed5-42204671254c => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:20:52.863876 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=8 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:52.871117 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a0918c58-ccb1-4018-a37a-b8585d0f44f5 tempest-TaggedBootDevicesTest-131510051 tempest-TaggedBootDevicesTest-131510051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1614137573", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "6bad5f1d-0545-4ad8-89a2-04859d401a21"}, {"port": "9ba752a3-de41-49de-9747-852206f7567f", "tag": "port-1"}, {"port": "d8a502e5-7178-401f-b114-77e7a90bb323", "tag": "port-2"}, {"uuid": "7f6c7383-ba3e-4d9f-bc1c-338c783c6a83", "tag": "net-1"}, {"uuid": "7f6c7383-ba3e-4d9f-bc1c-338c783c6a83"}, {"uuid": "04983873-770e-4898-898f-5e7a4b1eab22", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "04983873-770e-4898-898f-5e7a4b1eab22", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "28685781-9dd7-492e-b619-3b5a7a743aad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a6cfbdcb-c4ba-4f7e-956f-35ee62a89c91", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "5da438a4-8a19-4574-b086-3ea764d01f55", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--269716012"}], "key_name": "tempest-keypair-1103560391", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:53.127726 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-a0918c58-ccb1-4018-a37a-b8585d0f44f5 tempest-TaggedBootDevicesTest-131510051 tempest-TaggedBootDevicesTest-131510051-project] validate_networks() for [('6bad5f1d-0545-4ad8-89a2-04859d401a21', None, None, None, None, None), (None, None, '9ba752a3-de41-49de-9747-852206f7567f', None, None, None), (None, None, 'd8a502e5-7178-401f-b114-77e7a90bb323', None, None, None), ('7f6c7383-ba3e-4d9f-bc1c-338c783c6a83', None, None, None, None, None), ('7f6c7383-ba3e-4d9f-bc1c-338c783c6a83', None, None, None, None, None), ('04983873-770e-4898-898f-5e7a4b1eab22', '10.2.2.100', None, None, None, None), ('04983873-770e-4898-898f-5e7a4b1eab22', '10.2.2.200', None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-a0918c58-ccb1-4018-a37a-b8585d0f44f5 tempest-TaggedBootDevicesTest-131510051 tempest-TaggedBootDevicesTest-131510051-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f5d3e799-032f-4fce-af90-25c48f79cb27) Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:20:54.654295 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:20:54.658652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:20:54.658652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:20:54.658652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:20:54.658652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:20:54.658652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:20:54.658652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:20:54.658652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:20:54.658652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:20:54.658652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:20:54.658652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:20:54.658652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:20:54.658652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:20:54.658652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:20:54.658652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:20:54.658652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f5d3e799-032f-4fce-af90-25c48f79cb27) Aug 22 17:20:54.658652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:54.658652 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-a0918c58-ccb1-4018-a37a-b8585d0f44f5 tempest-TaggedBootDevicesTest-131510051 tempest-TaggedBootDevicesTest-131510051-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:54.658652 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a0918c58-ccb1-4018-a37a-b8585d0f44f5 tempest-TaggedBootDevicesTest-131510051 tempest-TaggedBootDevicesTest-131510051-project] Request method failure captured: Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 1344 Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7qJwXif2uXctyT6zpsBJQgJCqXHTSm40BzF2JNlOKODtvhrtcXX_5D6C42DnrHVysihCHjfSB5xvmPmP7E1EkNoZmhMYWEB-LGLqSC_HLmKOvuvS3yRSeduH3amWMsQBbvUp7-8dDIGixaw0Piq3n1tJ_VNINAaJR_ios_xbchABT8 Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-Openstack-Nova-Api-Version: 2.32 Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: e7a83b63b87548c7b1564219a1b491b1 Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-TaggedBootDevicesTest-131510051 Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e7a83b63b87548c7b1564219a1b491b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_e7a83b63b87548c7b1564219a1b491b1", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e7a83b63b87548c7b1564219a1b491b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/e7a83b63b87548c7b1564219a1b491b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-TaggedBootDevicesTest-131510051 Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: e7a83b63b87548c7b1564219a1b491b1 Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-TaggedBootDevicesTest-131510051 Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-TaggedBootDevicesTest-131510051-project Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: c47fc008053442778e7203bc70f701ac Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-TaggedBootDevicesTest-131510051-project Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-device-tagging-server-1614137573", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "6bad5f1d-0545-4ad8-89a2-04859d401a21"}, {"port": "9ba752a3-de41-49de-9747-852206f7567f", "tag": "port-1"}, {"port": "d8a502e5-7178-401f-b114-77e7a90bb323", "tag": "port-2"}, {"uuid": "7f6c7383-ba3e-4d9f-bc1c-338c783c6a83", "tag": "net-1"}, {"uuid": "7f6c7383-ba3e-4d9f-bc1c-338c783c6a83"}, {"uuid": "04983873-770e-4898-898f-5e7a4b1eab22", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "04983873-770e-4898-898f-5e7a4b1eab22", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "28685781-9dd7-492e-b619-3b5a7a743aad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a6cfbdcb-c4ba-4f7e-956f-35ee62a89c91", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "5da438a4-8a19-4574-b086-3ea764d01f55", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--269716012"}], "key_name": "tempest-keypair-1103560391", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-device-tagging-server-1614137573', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'config_drive': True, 'networks': [{'uuid': '6bad5f1d-0545-4ad8-89a2-04859d401a21'}, {'port': '9ba752a3-de41-49de-9747-852206f7567f', 'tag': 'port-1'}, {'port': 'd8a502e5-7178-401f-b114-77e7a90bb323', 'tag': 'port-2'}, {'uuid': '7f6c7383-ba3e-4d9f-bc1c-338c783c6a83', 'tag': 'net-1'}, {'uuid': '7f6c7383-ba3e-4d9f-bc1c-338c783c6a83'}, {'uuid': '04983873-770e-4898-898f-5e7a4b1eab22', 'fixed_ip': '10.2.2.100', 'tag': 'net-2-100'}, {'uuid': '04983873-770e-4898-898f-5e7a4b1eab22', 'fixed_ip': '10.2.2.200', 'tag': 'net-2-200'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'tag': 'boot', 'volume_id': '28685781-9dd7-492e-b619-3b5a7a743aad', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 1, 'tag': 'other', 'volume_id': 'a6cfbdcb-c4ba-4f7e-956f-35ee62a89c91', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 2, 'volume_id': '5da438a4-8a19-4574-b086-3ea764d01f55', 'delete_on_termination': False}], 'security_groups': [{'name': 'tempest-securitygroup--269716012'}], 'key_name': 'tempest-keypair-1103560391', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:20:54.661300 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:20:54.664742 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f5d3e799-032f-4fce-af90-25c48f79cb27) Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a0918c58-ccb1-4018-a37a-b8585d0f44f5 tempest-TaggedBootDevicesTest-131510051 tempest-TaggedBootDevicesTest-131510051-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:20:54.669123 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a0918c58-ccb1-4018-a37a-b8585d0f44f5 tempest-TaggedBootDevicesTest-131510051 tempest-TaggedBootDevicesTest-131510051-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.32 time: 1.801290 Aug 22 17:20:54.675208 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 842/1684] 10.222.0.96 () {62 vars in 1189 bytes} [Mon Aug 22 17:20:52 2022] POST /compute/v2.1/servers => generated 214 bytes in 1810 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Aug 22 17:20:54.695531 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7b244ac8-233a-4f42-a4ff-a5a8897b96a3 tempest-TaggedBootDevicesTest-131510051 tempest-TaggedBootDevicesTest-131510051-project] Calling method '.version_select at 0x7f80099ca670>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:54.849216 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7b244ac8-233a-4f42-a4ff-a5a8897b96a3 tempest-TaggedBootDevicesTest-131510051 tempest-TaggedBootDevicesTest-131510051-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1103560391" status: 204 len: 0 microversion: 2.32 time: 0.161724 Aug 22 17:20:54.853781 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 843/1685] 10.222.0.96 () {60 vars in 1262 bytes} [Mon Aug 22 17:20:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1103560391 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 17:20:59.639927 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d077660f-4ff0-408d-9a5c-4749965f54a4 tempest-ListServersNegativeTestJSON-621499458 tempest-ListServersNegativeTestJSON-621499458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1315840877", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "3744113e-4cc3-41c6-a51e-06474d85c48a"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:20:59.753561 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-d077660f-4ff0-408d-9a5c-4749965f54a4 tempest-ListServersNegativeTestJSON-621499458 tempest-ListServersNegativeTestJSON-621499458-project] validate_networks() for [('3744113e-4cc3-41c6-a51e-06474d85c48a', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-d077660f-4ff0-408d-9a5c-4749965f54a4 tempest-ListServersNegativeTestJSON-621499458 tempest-ListServersNegativeTestJSON-621499458-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-399df981-4c3a-4729-9a33-d991114a5028) Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:00.888558 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-399df981-4c3a-4729-9a33-d991114a5028) Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-d077660f-4ff0-408d-9a5c-4749965f54a4 tempest-ListServersNegativeTestJSON-621499458 tempest-ListServersNegativeTestJSON-621499458-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d077660f-4ff0-408d-9a5c-4749965f54a4 tempest-ListServersNegativeTestJSON-621499458 tempest-ListServersNegativeTestJSON-621499458-project] Request method failure captured: Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 229 Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7r6Vl200pHBnY6t2QqaUXNO5gUJaLjq78ef8pCjcpZygP557pGOoEaOtybL-xDCgRoLNtwHCerVxBjQjIYr0z3tQ3C4G_khi506c3d8BoRI6ZXC5CG0FzTnRTuc5U6Dz6p8-HJTfMXWPMi5fKUQCEAiLOw3CFcE3bwPeh-IsEB4XAM Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 09fca2f55189447bb545ad5b6df4de97 Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ListServersNegativeTestJSON-621499458 Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "tempest-type-1668296735", "name": "tempest-service-312744266", "endpoints": [{"region": "tempest-region-903499676", "publicURL": "https://url-427990651.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/09fca2f55189447bb545ad5b6df4de97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_09fca2f55189447bb545ad5b6df4de97", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "tempest-type-1957459767", "name": "tempest-service-1577044403", "endpoints": [{"region": "tempest-region-1026335163", "internalURL": "https://url-1001817633.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/09fca2f55189447bb545ad5b6df4de97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/09fca2f55189447bb545ad5b6df4de97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ListServersNegativeTestJSON-621499458 Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 09fca2f55189447bb545ad5b6df4de97 Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-621499458 Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ListServersNegativeTestJSON-621499458-project Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 914599fab51444fa870a5f456356f300 Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ListServersNegativeTestJSON-621499458-project Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1315840877", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "3744113e-4cc3-41c6-a51e-06474d85c48a"}]}} Aug 22 17:21:00.892710 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ListServersNegativeTestJSON-server-1315840877', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'min_count': 3, 'networks': [{'uuid': '3744113e-4cc3-41c6-a51e-06474d85c48a'}]}}} Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:00.907098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-399df981-4c3a-4729-9a33-d991114a5028) Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d077660f-4ff0-408d-9a5c-4749965f54a4 tempest-ListServersNegativeTestJSON-621499458 tempest-ListServersNegativeTestJSON-621499458-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d077660f-4ff0-408d-9a5c-4749965f54a4 tempest-ListServersNegativeTestJSON-621499458 tempest-ListServersNegativeTestJSON-621499458-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.805906 Aug 22 17:21:00.911136 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 843/1686] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:20:59 2022] POST /compute/v2.1/servers => generated 214 bytes in 1810 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:21:09.271700 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=20 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:21:09.272579 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:21:10.226710 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9ca0f4c5-4d81-49ca-bb93-76e00d9eec4f tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1385682899", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:21:10.336600 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-9ca0f4c5-4d81-49ca-bb93-76e00d9eec4f tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] validate_networks() for [('6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-9ca0f4c5-4d81-49ca-bb93-76e00d9eec4f tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1abd46a0-1a4e-4fc4-a7df-f38a296d62f8) Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:11.531790 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1abd46a0-1a4e-4fc4-a7df-f38a296d62f8) Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-9ca0f4c5-4d81-49ca-bb93-76e00d9eec4f tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9ca0f4c5-4d81-49ca-bb93-76e00d9eec4f tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Request method failure captured: Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 207 Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7sDVlwKMxfpY-tvvZFYCadViCG5ZvxlE9T70BMG5BGTfQkUzyKtVSjZe6i7zHXhkrT_fBWVpnggfK-cXVCxCv66Gcw99ZItU7E5YWJGH7h2qRH9w_Octrd6by2HocHlIdIZA1Lt2TSWabdojF94aUQcTbyIDwH_gFBmLNXbwNFbIH4 Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: e756fbc69d95466abaa6d46ff932bf81 Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "tempest-type-1668296735", "name": "tempest-service-312744266", "endpoints": [{"region": "tempest-region-903499676", "publicURL": "https://url-427990651.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_e756fbc69d95466abaa6d46ff932bf81", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: e756fbc69d95466abaa6d46ff932bf81 Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-DeleteServersTestJSON-1119220928-project Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: afd6e54bba86409895616376d55d0f79 Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-DeleteServersTestJSON-1119220928-project Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-DeleteServersTestJSON-server-1385682899", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf"}]}} Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:11.535718 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-1385682899', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf'}]}}} Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:11.563389 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1abd46a0-1a4e-4fc4-a7df-f38a296d62f8) Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9ca0f4c5-4d81-49ca-bb93-76e00d9eec4f tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9ca0f4c5-4d81-49ca-bb93-76e00d9eec4f tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.265827 Aug 22 17:21:11.575191 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 844/1687] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:21:09 2022] POST /compute/v2.1/servers => generated 214 bytes in 2267 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:21:12.264106 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:21:12.270450 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4a279eda-c386-4fb2-b20c-990c1697d8f4 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-143829964", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:21:12.338628 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-4a279eda-c386-4fb2-b20c-990c1697d8f4 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] validate_networks() for [('6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:21:12.674362 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:21:12.674362 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:21:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.96) !!! Aug 22 17:21:13.694016 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:21:13.695609 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:21:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-4a279eda-c386-4fb2-b20c-990c1697d8f4 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7a03a30e-9bb8-436a-94ca-7985ed52cf35) Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:13.769325 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7a03a30e-9bb8-436a-94ca-7985ed52cf35) Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-4a279eda-c386-4fb2-b20c-990c1697d8f4 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4a279eda-c386-4fb2-b20c-990c1697d8f4 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Request method failure captured: Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 206 Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7sDVlwKMxfpY-tvvZFYCadViCG5ZvxlE9T70BMG5BGTfQkUzyKtVSjZe6i7zHXhkrT_fBWVpnggfK-cXVCxCv66Gcw99ZItU7E5YWJGH7h2qRH9w_Octrd6by2HocHlIdIZA1Lt2TSWabdojF94aUQcTbyIDwH_gFBmLNXbwNFbIH4 Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: e756fbc69d95466abaa6d46ff932bf81 Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "tempest-type-1668296735", "name": "tempest-service-312744266", "endpoints": [{"region": "tempest-region-903499676", "publicURL": "https://url-427990651.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_e756fbc69d95466abaa6d46ff932bf81", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: e756fbc69d95466abaa6d46ff932bf81 Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-DeleteServersTestJSON-1119220928-project Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: afd6e54bba86409895616376d55d0f79 Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-DeleteServersTestJSON-1119220928-project Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-DeleteServersTestJSON-server-143829964", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf"}]}} Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:21:13.777377 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-143829964', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf'}]}}} Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:13.786269 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7a03a30e-9bb8-436a-94ca-7985ed52cf35) Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4a279eda-c386-4fb2-b20c-990c1697d8f4 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-4a279eda-c386-4fb2-b20c-990c1697d8f4 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.512441 Aug 22 17:21:13.801730 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 844/1688] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:21:12 2022] POST /compute/v2.1/servers => generated 214 bytes in 1514 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:21:14.418126 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-77ad983d-00fa-487f-b2db-f2c88587ee7d tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-73880754", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:21:15.627473 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-77ad983d-00fa-487f-b2db-f2c88587ee7d tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] validate_networks() for [('6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-77ad983d-00fa-487f-b2db-f2c88587ee7d tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e1368239-f46a-4148-9df7-9fabd22d3b15) Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:16.931608 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e1368239-f46a-4148-9df7-9fabd22d3b15) Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-77ad983d-00fa-487f-b2db-f2c88587ee7d tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-77ad983d-00fa-487f-b2db-f2c88587ee7d tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Request method failure captured: Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 205 Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7sDVlwKMxfpY-tvvZFYCadViCG5ZvxlE9T70BMG5BGTfQkUzyKtVSjZe6i7zHXhkrT_fBWVpnggfK-cXVCxCv66Gcw99ZItU7E5YWJGH7h2qRH9w_Octrd6by2HocHlIdIZA1Lt2TSWabdojF94aUQcTbyIDwH_gFBmLNXbwNFbIH4 Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: e756fbc69d95466abaa6d46ff932bf81 Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "tempest-type-1668296735", "name": "tempest-service-312744266", "endpoints": [{"region": "tempest-region-903499676", "publicURL": "https://url-427990651.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_e756fbc69d95466abaa6d46ff932bf81", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: e756fbc69d95466abaa6d46ff932bf81 Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-DeleteServersTestJSON-1119220928-project Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: afd6e54bba86409895616376d55d0f79 Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-DeleteServersTestJSON-1119220928-project Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-DeleteServersTestJSON-server-73880754", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf"}]}} Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:16.939514 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-73880754', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf'}]}}} Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:16.943606 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e1368239-f46a-4148-9df7-9fabd22d3b15) Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-77ad983d-00fa-487f-b2db-f2c88587ee7d tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:21:16.952130 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-77ad983d-00fa-487f-b2db-f2c88587ee7d tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.525892 Aug 22 17:21:16.958118 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 845/1689] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:21:14 2022] POST /compute/v2.1/servers => generated 214 bytes in 2541 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:21:17.861041 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-92d9956a-b6d3-420e-8cc6-ae6d8ea7b13a tempest-TaggedBootDevicesTest_v242-1966384244 tempest-TaggedBootDevicesTest_v242-1966384244-project] Action: 'create', calling method: .version_select at 0x7f800924be50>, body: {"keypair": {"name": "tempest-keypair-990654996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMD3k1qH3TA0bFaGLsC4j3BqpTO1hT9IHV3NjTppLt/CZCoorOFpTN9/Gqru7VsMmOmKIv+tCLgd1qVTibMCfARMyx9sflUqmOtC/4AQtW+yocK3Eyq/TwkIh3+/P4YeGg=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:21:17.909785 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e23688a3-ebee-42b1-ba56-585645110ea5 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-881097496", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:21:17.951388 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-92d9956a-b6d3-420e-8cc6-ae6d8ea7b13a tempest-TaggedBootDevicesTest_v242-1966384244 tempest-TaggedBootDevicesTest_v242-1966384244-project] Getting quotas for project 1404ae20b8c34b61a77e581568896161. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:21:17.979172 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-92d9956a-b6d3-420e-8cc6-ae6d8ea7b13a tempest-TaggedBootDevicesTest_v242-1966384244 tempest-TaggedBootDevicesTest_v242-1966384244-project] Getting quotas for user 7fe36891ec61436091da7ecb1b8f2228 and project 1404ae20b8c34b61a77e581568896161. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:21:18.038291 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-e23688a3-ebee-42b1-ba56-585645110ea5 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] validate_networks() for [('6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:21:18.253320 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-92d9956a-b6d3-420e-8cc6-ae6d8ea7b13a tempest-TaggedBootDevicesTest_v242-1966384244 tempest-TaggedBootDevicesTest_v242-1966384244-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.397830 Aug 22 17:21:18.254107 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 845/1690] 10.222.0.96 () {62 vars in 1200 bytes} [Mon Aug 22 17:21:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 400 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-e23688a3-ebee-42b1-ba56-585645110ea5 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-939c0d74-09a5-469d-a9dc-502b5b9901db) Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:19.558997 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-939c0d74-09a5-469d-a9dc-502b5b9901db) Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-e23688a3-ebee-42b1-ba56-585645110ea5 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e23688a3-ebee-42b1-ba56-585645110ea5 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Request method failure captured: Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 206 Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7sDVlwKMxfpY-tvvZFYCadViCG5ZvxlE9T70BMG5BGTfQkUzyKtVSjZe6i7zHXhkrT_fBWVpnggfK-cXVCxCv66Gcw99ZItU7E5YWJGH7h2qRH9w_Octrd6by2HocHlIdIZA1Lt2TSWabdojF94aUQcTbyIDwH_gFBmLNXbwNFbIH4 Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: e756fbc69d95466abaa6d46ff932bf81 Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "tempest-type-1668296735", "name": "tempest-service-312744266", "endpoints": [{"region": "tempest-region-903499676", "publicURL": "https://url-427990651.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_e756fbc69d95466abaa6d46ff932bf81", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: e756fbc69d95466abaa6d46ff932bf81 Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-DeleteServersTestJSON-1119220928-project Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: afd6e54bba86409895616376d55d0f79 Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-DeleteServersTestJSON-1119220928-project Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-DeleteServersTestJSON-server-881097496", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf"}]}} Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:19.564077 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-881097496', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf'}]}}} Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:19.571828 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-939c0d74-09a5-469d-a9dc-502b5b9901db) Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e23688a3-ebee-42b1-ba56-585645110ea5 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e23688a3-ebee-42b1-ba56-585645110ea5 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.659947 Aug 22 17:21:19.581561 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 846/1691] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:21:17 2022] POST /compute/v2.1/servers => generated 214 bytes in 1662 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 22 17:21:20.211970 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-36a31e9d-98b6-46c6-97ee-b5d92f86cbbe tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1151544669", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:21:20.922667 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-36a31e9d-98b6-46c6-97ee-b5d92f86cbbe tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] validate_networks() for [('6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-36a31e9d-98b6-46c6-97ee-b5d92f86cbbe tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b122feac-6cbb-4a40-9be4-2b08ae7b7ed9) Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:22.020700 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b122feac-6cbb-4a40-9be4-2b08ae7b7ed9) Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-36a31e9d-98b6-46c6-97ee-b5d92f86cbbe tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-36a31e9d-98b6-46c6-97ee-b5d92f86cbbe tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Request method failure captured: Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 207 Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7sDVlwKMxfpY-tvvZFYCadViCG5ZvxlE9T70BMG5BGTfQkUzyKtVSjZe6i7zHXhkrT_fBWVpnggfK-cXVCxCv66Gcw99ZItU7E5YWJGH7h2qRH9w_Octrd6by2HocHlIdIZA1Lt2TSWabdojF94aUQcTbyIDwH_gFBmLNXbwNFbIH4 Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: e756fbc69d95466abaa6d46ff932bf81 Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "tempest-type-1668296735", "name": "tempest-service-312744266", "endpoints": [{"region": "tempest-region-903499676", "publicURL": "https://url-427990651.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_e756fbc69d95466abaa6d46ff932bf81", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: e756fbc69d95466abaa6d46ff932bf81 Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-DeleteServersTestJSON-1119220928-project Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: afd6e54bba86409895616376d55d0f79 Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-DeleteServersTestJSON-1119220928-project Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-DeleteServersTestJSON-server-1151544669", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf"}]}} Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:21:22.025169 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-1151544669', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf'}]}}} Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:22.028973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b122feac-6cbb-4a40-9be4-2b08ae7b7ed9) Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-36a31e9d-98b6-46c6-97ee-b5d92f86cbbe tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:21:22.038175 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-36a31e9d-98b6-46c6-97ee-b5d92f86cbbe tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.818760 Aug 22 17:21:22.042392 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 846/1692] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:21:20 2022] POST /compute/v2.1/servers => generated 214 bytes in 1835 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:21:22.524724 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4d57fa5e-3ffc-4972-b30f-3d4e234c3e06 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-681818929", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:21:22.671473 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-4d57fa5e-3ffc-4972-b30f-3d4e234c3e06 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] validate_networks() for [('6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-4d57fa5e-3ffc-4972-b30f-3d4e234c3e06 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1e01fb4f-2b1a-45d5-b949-2eaa9b5aa0ec) Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:23.772733 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:23.777814 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:23.777814 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:23.777814 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:23.777814 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:23.777814 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:23.777814 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:23.777814 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:23.777814 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:23.777814 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:23.777814 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:23.777814 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:23.777814 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:23.777814 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:23.777814 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:23.777814 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1e01fb4f-2b1a-45d5-b949-2eaa9b5aa0ec) Aug 22 17:21:23.777814 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:23.781354 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-4d57fa5e-3ffc-4972-b30f-3d4e234c3e06 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:23.781354 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4d57fa5e-3ffc-4972-b30f-3d4e234c3e06 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Request method failure captured: Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 206 Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7sDVlwKMxfpY-tvvZFYCadViCG5ZvxlE9T70BMG5BGTfQkUzyKtVSjZe6i7zHXhkrT_fBWVpnggfK-cXVCxCv66Gcw99ZItU7E5YWJGH7h2qRH9w_Octrd6by2HocHlIdIZA1Lt2TSWabdojF94aUQcTbyIDwH_gFBmLNXbwNFbIH4 Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: e756fbc69d95466abaa6d46ff932bf81 Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "tempest-type-1668296735", "name": "tempest-service-312744266", "endpoints": [{"region": "tempest-region-903499676", "publicURL": "https://url-427990651.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_e756fbc69d95466abaa6d46ff932bf81", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: e756fbc69d95466abaa6d46ff932bf81 Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-DeleteServersTestJSON-1119220928-project Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: afd6e54bba86409895616376d55d0f79 Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-DeleteServersTestJSON-1119220928-project Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-DeleteServersTestJSON-server-681818929", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf"}]}} Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-681818929', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf'}]}}} Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:23.784506 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1e01fb4f-2b1a-45d5-b949-2eaa9b5aa0ec) Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:21:23.795402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:21:23.798875 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:21:23.798875 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:23.798875 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:23.798875 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:23.798875 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:23.798875 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:23.798875 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:23.798875 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:23.798875 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:23.798875 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:21:23.798875 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:21:23.798875 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:23.798875 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:23.798875 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:23.798875 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4d57fa5e-3ffc-4972-b30f-3d4e234c3e06 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:23.798875 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:21:23.798875 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4d57fa5e-3ffc-4972-b30f-3d4e234c3e06 tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.268507 Aug 22 17:21:23.798875 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 847/1693] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:21:22 2022] POST /compute/v2.1/servers => generated 214 bytes in 1270 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 22 17:21:24.426687 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5b008faa-4e59-4927-a323-237004c73ffb tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-802610663", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:21:24.617511 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-5b008faa-4e59-4927-a323-237004c73ffb tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] validate_networks() for [('6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-5b008faa-4e59-4927-a323-237004c73ffb tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ba251542-098f-40a5-b322-1de1ab8d4454) Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:26.473015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ba251542-098f-40a5-b322-1de1ab8d4454) Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-5b008faa-4e59-4927-a323-237004c73ffb tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5b008faa-4e59-4927-a323-237004c73ffb tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Request method failure captured: Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 206 Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7sDVlwKMxfpY-tvvZFYCadViCG5ZvxlE9T70BMG5BGTfQkUzyKtVSjZe6i7zHXhkrT_fBWVpnggfK-cXVCxCv66Gcw99ZItU7E5YWJGH7h2qRH9w_Octrd6by2HocHlIdIZA1Lt2TSWabdojF94aUQcTbyIDwH_gFBmLNXbwNFbIH4 Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: e756fbc69d95466abaa6d46ff932bf81 Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "tempest-type-1668296735", "name": "tempest-service-312744266", "endpoints": [{"region": "tempest-region-903499676", "publicURL": "https://url-427990651.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_e756fbc69d95466abaa6d46ff932bf81", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/e756fbc69d95466abaa6d46ff932bf81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: e756fbc69d95466abaa6d46ff932bf81 Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-DeleteServersTestJSON-1119220928 Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-DeleteServersTestJSON-1119220928-project Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: afd6e54bba86409895616376d55d0f79 Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-DeleteServersTestJSON-1119220928-project Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-DeleteServersTestJSON-server-802610663", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf"}]}} Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:21:26.477029 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-802610663', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '6bc6d4a4-ef0b-4d49-9d5d-fcb3468919bf'}]}}} Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:26.487124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ba251542-098f-40a5-b322-1de1ab8d4454) Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5b008faa-4e59-4927-a323-237004c73ffb tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5b008faa-4e59-4927-a323-237004c73ffb tempest-DeleteServersTestJSON-1119220928 tempest-DeleteServersTestJSON-1119220928-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.056916 Aug 22 17:21:26.491359 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 847/1694] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:21:24 2022] POST /compute/v2.1/servers => generated 214 bytes in 2063 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:21:26.661437 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e12d3d47-5002-45cf-8cd1-af25f2ae1057 tempest-TaggedBootDevicesTest_v242-1966384244 tempest-TaggedBootDevicesTest_v242-1966384244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-415922671", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f8ad4ce1-42f9-481c-825a-ece09fadc18e"}, {"port": "c7d6481c-cb21-41a3-bfe4-153ccc041716", "tag": "port-1"}, {"port": "973ecb7b-cf37-400f-a65b-8b6ef81167f4", "tag": "port-2"}, {"uuid": "4f0848fb-51b8-493f-8439-70fe570b5aa6", "tag": "net-1"}, {"uuid": "4f0848fb-51b8-493f-8439-70fe570b5aa6"}, {"uuid": "6ef437b4-c84b-460e-bc52-3895c1574500", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6ef437b4-c84b-460e-bc52-3895c1574500", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "def7e7bc-3a02-4f80-93d2-3e718670d49c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f1ed7eb1-6f2a-4986-9e17-255e8e2ad1aa", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7b941a30-6baf-4cb2-bb04-ed6b14a99892", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--466374323"}], "key_name": "tempest-keypair-990654996", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:21:26.977907 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-e12d3d47-5002-45cf-8cd1-af25f2ae1057 tempest-TaggedBootDevicesTest_v242-1966384244 tempest-TaggedBootDevicesTest_v242-1966384244-project] validate_networks() for [('f8ad4ce1-42f9-481c-825a-ece09fadc18e', None, None, None, None, None), (None, None, 'c7d6481c-cb21-41a3-bfe4-153ccc041716', None, None, None), (None, None, '973ecb7b-cf37-400f-a65b-8b6ef81167f4', None, None, None), ('4f0848fb-51b8-493f-8439-70fe570b5aa6', None, None, None, None, None), ('4f0848fb-51b8-493f-8439-70fe570b5aa6', None, None, None, None, None), ('6ef437b4-c84b-460e-bc52-3895c1574500', '10.2.2.100', None, None, None, None), ('6ef437b4-c84b-460e-bc52-3895c1574500', '10.2.2.200', None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-e12d3d47-5002-45cf-8cd1-af25f2ae1057 tempest-TaggedBootDevicesTest_v242-1966384244 tempest-TaggedBootDevicesTest_v242-1966384244-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-277cda53-bb97-4b29-82de-3ff7e82e7ed7) Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:28.649890 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-277cda53-bb97-4b29-82de-3ff7e82e7ed7) Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-e12d3d47-5002-45cf-8cd1-af25f2ae1057 tempest-TaggedBootDevicesTest_v242-1966384244 tempest-TaggedBootDevicesTest_v242-1966384244-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e12d3d47-5002-45cf-8cd1-af25f2ae1057 tempest-TaggedBootDevicesTest_v242-1966384244 tempest-TaggedBootDevicesTest_v242-1966384244-project] Request method failure captured: Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 1342 Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7q6y5hdVbuAHNdgacLX-rbgPsbQ5N3lVg-oVMINgdbUH0jIRW0dukys_FjgrEhmxArPTcSWTr1_BftfV0AsYMSJOxIksAuJCE7yZM6tzDFQLoc3QuNZkzxTrWAqw3sbrgIOgwra8IReo0BW9Q8bEwg70dBsPhDN41rKhhyP6IA_E5M Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-Openstack-Nova-Api-Version: 2.42 Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 1404ae20b8c34b61a77e581568896161 Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1966384244 Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1404ae20b8c34b61a77e581568896161"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_1404ae20b8c34b61a77e581568896161", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1404ae20b8c34b61a77e581568896161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/1404ae20b8c34b61a77e581568896161"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1966384244 Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 1404ae20b8c34b61a77e581568896161 Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1966384244 Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-TaggedBootDevicesTest_v242-1966384244-project Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 7fe36891ec61436091da7ecb1b8f2228 Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1966384244-project Aug 22 17:21:28.654113 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-device-tagging-server-415922671", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f8ad4ce1-42f9-481c-825a-ece09fadc18e"}, {"port": "c7d6481c-cb21-41a3-bfe4-153ccc041716", "tag": "port-1"}, {"port": "973ecb7b-cf37-400f-a65b-8b6ef81167f4", "tag": "port-2"}, {"uuid": "4f0848fb-51b8-493f-8439-70fe570b5aa6", "tag": "net-1"}, {"uuid": "4f0848fb-51b8-493f-8439-70fe570b5aa6"}, {"uuid": "6ef437b4-c84b-460e-bc52-3895c1574500", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6ef437b4-c84b-460e-bc52-3895c1574500", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "def7e7bc-3a02-4f80-93d2-3e718670d49c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f1ed7eb1-6f2a-4986-9e17-255e8e2ad1aa", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7b941a30-6baf-4cb2-bb04-ed6b14a99892", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--466374323"}], "key_name": "tempest-keypair-990654996", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-device-tagging-server-415922671', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'config_drive': True, 'networks': [{'uuid': 'f8ad4ce1-42f9-481c-825a-ece09fadc18e'}, {'port': 'c7d6481c-cb21-41a3-bfe4-153ccc041716', 'tag': 'port-1'}, {'port': '973ecb7b-cf37-400f-a65b-8b6ef81167f4', 'tag': 'port-2'}, {'uuid': '4f0848fb-51b8-493f-8439-70fe570b5aa6', 'tag': 'net-1'}, {'uuid': '4f0848fb-51b8-493f-8439-70fe570b5aa6'}, {'uuid': '6ef437b4-c84b-460e-bc52-3895c1574500', 'fixed_ip': '10.2.2.100', 'tag': 'net-2-100'}, {'uuid': '6ef437b4-c84b-460e-bc52-3895c1574500', 'fixed_ip': '10.2.2.200', 'tag': 'net-2-200'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'tag': 'boot', 'volume_id': 'def7e7bc-3a02-4f80-93d2-3e718670d49c', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 1, 'tag': 'other', 'volume_id': 'f1ed7eb1-6f2a-4986-9e17-255e8e2ad1aa', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 2, 'volume_id': '7b941a30-6baf-4cb2-bb04-ed6b14a99892', 'delete_on_termination': False}], 'security_groups': [{'name': 'tempest-securitygroup--466374323'}], 'key_name': 'tempest-keypair-990654996', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:28.663586 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-277cda53-bb97-4b29-82de-3ff7e82e7ed7) Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:28.672690 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:28.676655 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:28.676655 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:28.676655 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:28.676655 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:28.676655 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:21:28.676655 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:21:28.676655 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:28.676655 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:28.676655 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:28.676655 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e12d3d47-5002-45cf-8cd1-af25f2ae1057 tempest-TaggedBootDevicesTest_v242-1966384244 tempest-TaggedBootDevicesTest_v242-1966384244-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:28.676655 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:21:28.676655 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e12d3d47-5002-45cf-8cd1-af25f2ae1057 tempest-TaggedBootDevicesTest_v242-1966384244 tempest-TaggedBootDevicesTest_v242-1966384244-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.42 time: 1.999131 Aug 22 17:21:28.677506 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9327afd0-8f6f-426f-aa8f-7109d58944ce tempest-TaggedBootDevicesTest_v242-1966384244 tempest-TaggedBootDevicesTest_v242-1966384244-project] Calling method '.version_select at 0x7f80096e0280>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:21:28.678902 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 848/1695] 10.222.0.96 () {62 vars in 1189 bytes} [Mon Aug 22 17:21:26 2022] POST /compute/v2.1/servers => generated 214 bytes in 2022 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Aug 22 17:21:28.686864 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:21:28.858349 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9327afd0-8f6f-426f-aa8f-7109d58944ce tempest-TaggedBootDevicesTest_v242-1966384244 tempest-TaggedBootDevicesTest_v242-1966384244-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-990654996" status: 204 len: 0 microversion: 2.42 time: 0.192610 Aug 22 17:21:28.859820 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 848/1696] 10.222.0.96 () {60 vars in 1259 bytes} [Mon Aug 22 17:21:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-990654996 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 17:21:32.760718 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7f629926-7115-48a9-aed9-ee06e5952fcd tempest-ServersTestMultiNic-1440453221 tempest-ServersTestMultiNic-1440453221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1141359237", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "81ce82b8-eada-4192-84a8-df097c686e38"}, {"uuid": "fc4f34b6-8e35-49e9-9dee-3d02eae74cdd"}, {"uuid": "81ce82b8-eada-4192-84a8-df097c686e38"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:21:32.910821 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-7f629926-7115-48a9-aed9-ee06e5952fcd tempest-ServersTestMultiNic-1440453221 tempest-ServersTestMultiNic-1440453221-project] validate_networks() for [('81ce82b8-eada-4192-84a8-df097c686e38', None, None, None, None, None), ('fc4f34b6-8e35-49e9-9dee-3d02eae74cdd', None, None, None, None, None), ('81ce82b8-eada-4192-84a8-df097c686e38', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-7f629926-7115-48a9-aed9-ee06e5952fcd tempest-ServersTestMultiNic-1440453221 tempest-ServersTestMultiNic-1440453221-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-31db0bc9-a09e-4a40-bb22-90301e0be503) Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:34.189056 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:34.198836 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:34.198836 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:34.198836 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:34.198836 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:34.198836 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:34.198836 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:34.198836 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:34.198836 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:34.198836 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:34.198836 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:34.198836 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:34.198836 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:34.198836 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:34.198836 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:34.198836 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-31db0bc9-a09e-4a40-bb22-90301e0be503) Aug 22 17:21:34.198836 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:34.198836 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-7f629926-7115-48a9-aed9-ee06e5952fcd tempest-ServersTestMultiNic-1440453221 tempest-ServersTestMultiNic-1440453221-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:34.198836 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7f629926-7115-48a9-aed9-ee06e5952fcd tempest-ServersTestMultiNic-1440453221 tempest-ServersTestMultiNic-1440453221-project] Request method failure captured: Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 305 Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7sUdBMzah0UhZt5_LCEFtIgbJP58OxBLnwY3H18O8HCpqVyQgvaEJyIwtarPxnaA0Nin8kLoa3mFMuVRyxv6Vw9ZaJe00S6fcu-PlHySEOoyFoNRzexrmmA7PXT95cZIGi8PPvVLrJud8hLOaqXTOCWk4fxf3KcUepItc3F8nLf32A Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 996c9fcb6e04474cba9c6926b8c77d9f Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServersTestMultiNic-1440453221 Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/996c9fcb6e04474cba9c6926b8c77d9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_996c9fcb6e04474cba9c6926b8c77d9f", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/996c9fcb6e04474cba9c6926b8c77d9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/996c9fcb6e04474cba9c6926b8c77d9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServersTestMultiNic-1440453221 Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 996c9fcb6e04474cba9c6926b8c77d9f Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServersTestMultiNic-1440453221 Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServersTestMultiNic-1440453221-project Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 11269aaa0436403cb2da59911c671314 Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServersTestMultiNic-1440453221-project Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-ServersTestMultiNic-server-1141359237", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "81ce82b8-eada-4192-84a8-df097c686e38"}, {"uuid": "fc4f34b6-8e35-49e9-9dee-3d02eae74cdd"}, {"uuid": "81ce82b8-eada-4192-84a8-df097c686e38"}]}} Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-ServersTestMultiNic-server-1141359237', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '81ce82b8-eada-4192-84a8-df097c686e38'}, {'uuid': 'fc4f34b6-8e35-49e9-9dee-3d02eae74cdd'}, {'uuid': '81ce82b8-eada-4192-84a8-df097c686e38'}]}}} Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:34.204446 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-31db0bc9-a09e-4a40-bb22-90301e0be503) Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:21:34.208048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:21:34.217843 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:21:34.217843 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:34.217843 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:34.217843 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:34.217843 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:34.217843 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:34.217843 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:34.217843 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:34.217843 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:34.217843 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:21:34.217843 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:21:34.217843 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:34.217843 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:34.217843 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:34.217843 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7f629926-7115-48a9-aed9-ee06e5952fcd tempest-ServersTestMultiNic-1440453221 tempest-ServersTestMultiNic-1440453221-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:34.217843 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:21:34.223316 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7f629926-7115-48a9-aed9-ee06e5952fcd tempest-ServersTestMultiNic-1440453221 tempest-ServersTestMultiNic-1440453221-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.467989 Aug 22 17:21:34.226053 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 849/1697] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:21:32 2022] POST /compute/v2.1/servers => generated 214 bytes in 1471 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:21:41.197915 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:21:41.858796 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-654cc90c-b7ed-42f8-b12c-b63d467df24b tempest-ServerAddressesTestJSON-1583594650 tempest-ServerAddressesTestJSON-1583594650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1159031229", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "e922148c-d4e9-4741-b3cf-e009bc8a72f5"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:21:42.002100 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-654cc90c-b7ed-42f8-b12c-b63d467df24b tempest-ServerAddressesTestJSON-1583594650 tempest-ServerAddressesTestJSON-1583594650-project] validate_networks() for [('e922148c-d4e9-4741-b3cf-e009bc8a72f5', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-654cc90c-b7ed-42f8-b12c-b63d467df24b tempest-ServerAddressesTestJSON-1583594650 tempest-ServerAddressesTestJSON-1583594650-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bd2daa8b-f28e-49a7-835f-f93fbda2997e) Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:43.474951 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:43.479559 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:43.479559 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:43.479559 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:43.479559 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:43.479559 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:43.479559 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:43.479559 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:43.479559 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:43.479559 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:43.479559 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:43.479559 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:43.479559 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:43.479559 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:43.479559 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:43.479559 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:43.479559 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bd2daa8b-f28e-49a7-835f-f93fbda2997e) Aug 22 17:21:43.479559 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:43.484136 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-654cc90c-b7ed-42f8-b12c-b63d467df24b tempest-ServerAddressesTestJSON-1583594650 tempest-ServerAddressesTestJSON-1583594650-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:43.484136 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-654cc90c-b7ed-42f8-b12c-b63d467df24b tempest-ServerAddressesTestJSON-1583594650 tempest-ServerAddressesTestJSON-1583594650-project] Request method failure captured: Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 209 Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7sk9cx-ImtX80VkYMKh4QUq6Uqx1BhyonGdd5-QrSmhdcF9ysFW-tpVzOslrKuAwJotGPos4FFKNZn0qkT9gWaAI2iWEKkG0T4_kAmNhqCylyyS9uzTffnr8b_TzYhGVSug1O_ms45CRHBUga96F1UxtjT2betRGIM5Tfc2ZTWZQVo Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 68ce2b1f0ba247d2aec95f411a065e16 Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServerAddressesTestJSON-1583594650 Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/68ce2b1f0ba247d2aec95f411a065e16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_68ce2b1f0ba247d2aec95f411a065e16", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/68ce2b1f0ba247d2aec95f411a065e16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/68ce2b1f0ba247d2aec95f411a065e16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServerAddressesTestJSON-1583594650 Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 68ce2b1f0ba247d2aec95f411a065e16 Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1583594650 Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServerAddressesTestJSON-1583594650-project Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 7b95380b7c2e4740adb0acd3115f0fb9 Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServerAddressesTestJSON-1583594650-project Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1159031229", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "e922148c-d4e9-4741-b3cf-e009bc8a72f5"}]}} Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ServerAddressesTestJSON-server-1159031229', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'e922148c-d4e9-4741-b3cf-e009bc8a72f5'}]}}} Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:43.487506 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bd2daa8b-f28e-49a7-835f-f93fbda2997e) Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:21:43.492245 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:21:43.503868 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:43.503868 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:43.503868 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:43.503868 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:43.503868 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:43.503868 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:43.503868 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:43.503868 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:43.503868 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:21:43.503868 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:21:43.503868 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:43.503868 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:43.503868 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:21:43.503868 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-654cc90c-b7ed-42f8-b12c-b63d467df24b tempest-ServerAddressesTestJSON-1583594650 tempest-ServerAddressesTestJSON-1583594650-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:43.503868 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:21:43.503868 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-654cc90c-b7ed-42f8-b12c-b63d467df24b tempest-ServerAddressesTestJSON-1583594650 tempest-ServerAddressesTestJSON-1583594650-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.308494 Aug 22 17:21:43.503868 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 849/1698] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:21:41 2022] POST /compute/v2.1/servers => generated 214 bytes in 2310 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:21:52.292962 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=14 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:21:52.305216 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7249dbd2-03be-4f8e-8940-e22582085ebc tempest-ServersTestMultiNic-1440453221 tempest-ServersTestMultiNic-1440453221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-427019974", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "d0a71241-5ca6-4200-98c1-e4f0fef7b9a7"}, {"uuid": "3a803a80-34bc-4fbd-97c5-d770b42f6b04"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:21:52.473497 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-7249dbd2-03be-4f8e-8940-e22582085ebc tempest-ServersTestMultiNic-1440453221 tempest-ServersTestMultiNic-1440453221-project] validate_networks() for [('d0a71241-5ca6-4200-98c1-e4f0fef7b9a7', None, None, None, None, None), ('3a803a80-34bc-4fbd-97c5-d770b42f6b04', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-7249dbd2-03be-4f8e-8940-e22582085ebc tempest-ServersTestMultiNic-1440453221 tempest-ServersTestMultiNic-1440453221-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-89a9ed98-d223-4af2-a855-95756402520d) Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:53.312031 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:53.316169 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:53.316169 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:53.316169 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:53.316169 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:53.316169 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:53.316169 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:53.316169 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:53.316169 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:53.316169 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:53.316169 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:53.316169 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:53.316169 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:53.316169 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:53.316169 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:53.316169 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-89a9ed98-d223-4af2-a855-95756402520d) Aug 22 17:21:53.316169 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:53.320010 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-7249dbd2-03be-4f8e-8940-e22582085ebc tempest-ServersTestMultiNic-1440453221 tempest-ServersTestMultiNic-1440453221-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:53.320010 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7249dbd2-03be-4f8e-8940-e22582085ebc tempest-ServersTestMultiNic-1440453221 tempest-ServersTestMultiNic-1440453221-project] Request method failure captured: Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 254 Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7sUdBMzah0UhZt5_LCEFtIgbJP58OxBLnwY3H18O8HCpqVyQgvaEJyIwtarPxnaA0Nin8kLoa3mFMuVRyxv6Vw9ZaJe00S6fcu-PlHySEOoyFoNRzexrmmA7PXT95cZIGi8PPvVLrJud8hLOaqXTOCWk4fxf3KcUepItc3F8nLf32A Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 996c9fcb6e04474cba9c6926b8c77d9f Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServersTestMultiNic-1440453221 Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/996c9fcb6e04474cba9c6926b8c77d9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_996c9fcb6e04474cba9c6926b8c77d9f", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/996c9fcb6e04474cba9c6926b8c77d9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/996c9fcb6e04474cba9c6926b8c77d9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServersTestMultiNic-1440453221 Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 996c9fcb6e04474cba9c6926b8c77d9f Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServersTestMultiNic-1440453221 Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServersTestMultiNic-1440453221-project Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 11269aaa0436403cb2da59911c671314 Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServersTestMultiNic-1440453221-project Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-ServersTestMultiNic-server-427019974", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "d0a71241-5ca6-4200-98c1-e4f0fef7b9a7"}, {"uuid": "3a803a80-34bc-4fbd-97c5-d770b42f6b04"}]}} Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-ServersTestMultiNic-server-427019974', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'd0a71241-5ca6-4200-98c1-e4f0fef7b9a7'}, {'uuid': '3a803a80-34bc-4fbd-97c5-d770b42f6b04'}]}}} Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:21:53.321635 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-89a9ed98-d223-4af2-a855-95756402520d) Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:21:53.326577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:21:53.332129 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:53.332129 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:53.332129 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:53.332129 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:21:53.332129 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:53.332129 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:21:53.332129 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:21:53.332129 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:21:53.332129 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:21:53.332129 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:21:53.332129 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:53.332129 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:53.332129 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:21:53.344100 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7249dbd2-03be-4f8e-8940-e22582085ebc tempest-ServersTestMultiNic-1440453221 tempest-ServersTestMultiNic-1440453221-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:21:53.344100 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:21:53.354759 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7249dbd2-03be-4f8e-8940-e22582085ebc tempest-ServersTestMultiNic-1440453221 tempest-ServersTestMultiNic-1440453221-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.062495 Aug 22 17:21:53.357818 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 850/1699] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:21:52 2022] POST /compute/v2.1/servers => generated 214 bytes in 1068 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:22:00.253210 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:22:01.007282 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fe89f0fc-fa05-4fa6-a6c2-7e6bf00fa363 tempest-InstanceActionsV221TestJSON-70048022 tempest-InstanceActionsV221TestJSON-70048022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-111150647", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "7236c43f-4d4b-4d59-a19d-0db71a5ad212"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:22:01.134204 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-fe89f0fc-fa05-4fa6-a6c2-7e6bf00fa363 tempest-InstanceActionsV221TestJSON-70048022 tempest-InstanceActionsV221TestJSON-70048022-project] validate_networks() for [('7236c43f-4d4b-4d59-a19d-0db71a5ad212', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-fe89f0fc-fa05-4fa6-a6c2-7e6bf00fa363 tempest-InstanceActionsV221TestJSON-70048022 tempest-InstanceActionsV221TestJSON-70048022-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-57735849-8cf3-457b-b85e-a5a6c859671c) Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:02.427607 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-57735849-8cf3-457b-b85e-a5a6c859671c) Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-fe89f0fc-fa05-4fa6-a6c2-7e6bf00fa363 tempest-InstanceActionsV221TestJSON-70048022 tempest-InstanceActionsV221TestJSON-70048022-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fe89f0fc-fa05-4fa6-a6c2-7e6bf00fa363 tempest-InstanceActionsV221TestJSON-70048022 tempest-InstanceActionsV221TestJSON-70048022-project] Request method failure captured: Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 212 Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7s3O4dUzazKpsEX1M4UrmrxhZY0LVc8QR6fgWVbNMl6ssR5fsM1SyLu0vwXZHTjYce6Mh69KNrsEM5qy--bgDSqg-85lfi_f69taRGiQe4g66sLTxACudUvbwttmI09IZ9_fYAf7zDyhkGrj0RAaCkxrz98kXdhfOWzHYHBRSB9_Eg Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-Openstack-Nova-Api-Version: 2.21 Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 84233887eb254d618f287d5c063ca0eb Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-InstanceActionsV221TestJSON-70048022 Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/84233887eb254d618f287d5c063ca0eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_84233887eb254d618f287d5c063ca0eb", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/84233887eb254d618f287d5c063ca0eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/84233887eb254d618f287d5c063ca0eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-InstanceActionsV221TestJSON-70048022 Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 84233887eb254d618f287d5c063ca0eb Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-70048022 Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-InstanceActionsV221TestJSON-70048022-project Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: d5de2c5cfa624f7ba48cf13d3d75ed0b Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-InstanceActionsV221TestJSON-70048022-project Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-111150647", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "7236c43f-4d4b-4d59-a19d-0db71a5ad212"}]}} Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:02.433143 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-InstanceActionsV221TestJSON-server-111150647', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '7236c43f-4d4b-4d59-a19d-0db71a5ad212'}]}}} Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:02.438218 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-57735849-8cf3-457b-b85e-a5a6c859671c) Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fe89f0fc-fa05-4fa6-a6c2-7e6bf00fa363 tempest-InstanceActionsV221TestJSON-70048022 tempest-InstanceActionsV221TestJSON-70048022-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fe89f0fc-fa05-4fa6-a6c2-7e6bf00fa363 tempest-InstanceActionsV221TestJSON-70048022 tempest-InstanceActionsV221TestJSON-70048022-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.21 time: 2.175306 Aug 22 17:22:02.446291 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 850/1700] 10.222.0.96 () {62 vars in 1188 bytes} [Mon Aug 22 17:22:00 2022] POST /compute/v2.1/servers => generated 214 bytes in 2177 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Aug 22 17:22:21.144519 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:22:21.260493 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:22:22.313989 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f3aeedca-2628-4179-a68b-1d5389c35887 tempest-ServerPasswordTestJSON-1948214096 tempest-ServerPasswordTestJSON-1948214096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-670328622", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "2bcd80ec-c333-46af-90e6-c44cd5799e57"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:22:22.359644 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ba2a3bdd-3095-449f-a7cd-a9c6cc44a699 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1662518454", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "a030562b-ae65-489e-9dce-6909cf1340ba"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:22:22.391182 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-f3aeedca-2628-4179-a68b-1d5389c35887 tempest-ServerPasswordTestJSON-1948214096 tempest-ServerPasswordTestJSON-1948214096-project] validate_networks() for [('2bcd80ec-c333-46af-90e6-c44cd5799e57', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:22:22.450286 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-ba2a3bdd-3095-449f-a7cd-a9c6cc44a699 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] validate_networks() for [('a030562b-ae65-489e-9dce-6909cf1340ba', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-f3aeedca-2628-4179-a68b-1d5389c35887 tempest-ServerPasswordTestJSON-1948214096 tempest-ServerPasswordTestJSON-1948214096-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a0673751-0d13-4b94-8b6e-ef0f2f71fb16) Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:23.536961 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:23.541430 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:23.541430 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:23.541430 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:23.541430 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:23.541430 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:23.541430 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:23.541430 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:23.541430 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:23.541430 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:23.541430 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:23.541430 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:23.541430 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:23.541430 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:23.541430 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:23.541430 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a0673751-0d13-4b94-8b6e-ef0f2f71fb16) Aug 22 17:22:23.541430 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:23.547535 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-f3aeedca-2628-4179-a68b-1d5389c35887 tempest-ServerPasswordTestJSON-1948214096 tempest-ServerPasswordTestJSON-1948214096-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:23.547535 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-ba2a3bdd-3095-449f-a7cd-a9c6cc44a699 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-46a5ae9f-df19-426f-a009-548ff3056392) Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:23.547938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-46a5ae9f-df19-426f-a009-548ff3056392) Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-ba2a3bdd-3095-449f-a7cd-a9c6cc44a699 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ba2a3bdd-3095-449f-a7cd-a9c6cc44a699 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Request method failure captured: Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 185 Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7tMVZVKvNoR9zrCTinMbfT0Lzux-6G_R4YgMSEpzuxPzM6cCEkqJ8A6FzNzl7VQPAWo4RwzEY1L3p8HigcDwI_KLDNiTPRbPP4XGT_t1po6b1xfPhaujiOOtTi7NrlCRvRr2jboYYLR2IoIdscdrOda-cBjOC22AYR3sLXkBZgbNdw Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 1a80188fe99742d39d9dbb725576b4b5 Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersTestJSON-1025222992 Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_1a80188fe99742d39d9dbb725576b4b5", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersTestJSON-1025222992 Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 1a80188fe99742d39d9dbb725576b4b5 Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersTestJSON-1025222992 Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersTestJSON-1025222992-project Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 55a5dbd5bfce4e8da7446ca4e7388dcd Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersTestJSON-1025222992-project Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-\u20a1-1662518454", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "a030562b-ae65-489e-9dce-6909cf1340ba"}]}} Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-₡-1662518454', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'a030562b-ae65-489e-9dce-6909cf1340ba'}]}}} Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:22:23.553995 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:23.558469 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-46a5ae9f-df19-426f-a009-548ff3056392) Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ba2a3bdd-3095-449f-a7cd-a9c6cc44a699 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ba2a3bdd-3095-449f-a7cd-a9c6cc44a699 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.298718 Aug 22 17:22:23.563185 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 851/1701] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:22:21 2022] POST /compute/v2.1/servers => generated 214 bytes in 2303 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f3aeedca-2628-4179-a68b-1d5389c35887 tempest-ServerPasswordTestJSON-1948214096 tempest-ServerPasswordTestJSON-1948214096-project] Request method failure captured: Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 207 Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7tMGL-y9NOJvEWKdjjXnh1Goz_w4LANLiAp27WUUd4GUZmfkhOG_D-4M1zbSw6wxTVI4rx5aB1J7wBPR5ebRMJxZYkiojLldoJqfirU9_1dL7IwL21KNTXyMIVzm9_heq_-XI_MiF-nRiM64smDw6Oc7Te8rAP6Cm6WSyD3egTEXBs Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 046ac0eb8eeb4b9984f97a3902b9a594 Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServerPasswordTestJSON-1948214096 Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/046ac0eb8eeb4b9984f97a3902b9a594"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_046ac0eb8eeb4b9984f97a3902b9a594", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/046ac0eb8eeb4b9984f97a3902b9a594"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/046ac0eb8eeb4b9984f97a3902b9a594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServerPasswordTestJSON-1948214096 Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 046ac0eb8eeb4b9984f97a3902b9a594 Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1948214096 Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServerPasswordTestJSON-1948214096-project Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: c385b60557dd40819b55e4073f281cad Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServerPasswordTestJSON-1948214096-project Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-ServerPasswordTestJSON-server-670328622", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "2bcd80ec-c333-46af-90e6-c44cd5799e57"}]}} Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-ServerPasswordTestJSON-server-670328622', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '2bcd80ec-c333-46af-90e6-c44cd5799e57'}]}}} Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:23.574165 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a0673751-0d13-4b94-8b6e-ef0f2f71fb16) Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:22:23.580565 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:22:23.592392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:23.592392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:23.592392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:23.592392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:23.592392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:23.592392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:23.592392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:23.592392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:23.592392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:22:23.592392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:22:23.592392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:23.592392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:23.592392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:23.592392 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f3aeedca-2628-4179-a68b-1d5389c35887 tempest-ServerPasswordTestJSON-1948214096 tempest-ServerPasswordTestJSON-1948214096-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:23.592392 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:22:23.592392 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f3aeedca-2628-4179-a68b-1d5389c35887 tempest-ServerPasswordTestJSON-1948214096 tempest-ServerPasswordTestJSON-1948214096-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.422021 Aug 22 17:22:23.592392 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 851/1702] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:22:21 2022] POST /compute/v2.1/servers => generated 214 bytes in 2427 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:22:24.546624 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c2bc00ea-b659-420f-a9c1-038a21a5deda tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-971107169", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:22:24.690989 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-c2bc00ea-b659-420f-a9c1-038a21a5deda tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] validate_networks() for [('a030562b-ae65-489e-9dce-6909cf1340ba', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-c2bc00ea-b659-420f-a9c1-038a21a5deda tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0c1fb4dd-44d6-4deb-82be-d67dbb83c6f7) Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:25.555436 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0c1fb4dd-44d6-4deb-82be-d67dbb83c6f7) Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-c2bc00ea-b659-420f-a9c1-038a21a5deda tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c2bc00ea-b659-420f-a9c1-038a21a5deda tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Request method failure captured: Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 229 Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7tMVZVKvNoR9zrCTinMbfT0Lzux-6G_R4YgMSEpzuxPzM6cCEkqJ8A6FzNzl7VQPAWo4RwzEY1L3p8HigcDwI_KLDNiTPRbPP4XGT_t1po6b1xfPhaujiOOtTi7NrlCRvRr2jboYYLR2IoIdscdrOda-cBjOC22AYR3sLXkBZgbNdw Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 1a80188fe99742d39d9dbb725576b4b5 Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersTestJSON-1025222992 Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_1a80188fe99742d39d9dbb725576b4b5", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersTestJSON-1025222992 Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 1a80188fe99742d39d9dbb725576b4b5 Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersTestJSON-1025222992 Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersTestJSON-1025222992-project Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 55a5dbd5bfce4e8da7446ca4e7388dcd Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersTestJSON-1025222992-project Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ServersTestJSON-server-971107169", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "testpassword", "networks": [{"uuid": "a030562b-ae65-489e-9dce-6909cf1340ba"}]}} Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-971107169', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'adminPass': 'testpassword', 'networks': [{'uuid': 'a030562b-ae65-489e-9dce-6909cf1340ba'}]}}} Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:22:25.561479 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:25.569233 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0c1fb4dd-44d6-4deb-82be-d67dbb83c6f7) Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c2bc00ea-b659-420f-a9c1-038a21a5deda tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:22:25.577249 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c2bc00ea-b659-420f-a9c1-038a21a5deda tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.024019 Aug 22 17:22:25.587469 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 852/1703] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:22:24 2022] POST /compute/v2.1/servers => generated 214 bytes in 1044 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:22:26.011929 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-08803484-aae9-4550-bc1a-307260a3ff3a tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-747193369", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "a030562b-ae65-489e-9dce-6909cf1340ba"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:22:26.140997 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-08803484-aae9-4550-bc1a-307260a3ff3a tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] validate_networks() for [('a030562b-ae65-489e-9dce-6909cf1340ba', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-08803484-aae9-4550-bc1a-307260a3ff3a tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-72b0da65-70fc-448a-9f40-09a70e9c131b) Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:27.544936 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:27.549069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:27.549069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:27.549069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:27.549069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:27.549069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:27.549069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:27.549069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:27.549069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:27.549069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:27.549069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:27.549069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:27.549069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:27.549069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:27.549069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:27.549069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-72b0da65-70fc-448a-9f40-09a70e9c131b) Aug 22 17:22:27.549069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:27.549069 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-08803484-aae9-4550-bc1a-307260a3ff3a tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:27.549069 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-08803484-aae9-4550-bc1a-307260a3ff3a tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Request method failure captured: Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 230 Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7tMVZVKvNoR9zrCTinMbfT0Lzux-6G_R4YgMSEpzuxPzM6cCEkqJ8A6FzNzl7VQPAWo4RwzEY1L3p8HigcDwI_KLDNiTPRbPP4XGT_t1po6b1xfPhaujiOOtTi7NrlCRvRr2jboYYLR2IoIdscdrOda-cBjOC22AYR3sLXkBZgbNdw Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 1a80188fe99742d39d9dbb725576b4b5 Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServersTestJSON-1025222992 Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_1a80188fe99742d39d9dbb725576b4b5", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServersTestJSON-1025222992 Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 1a80188fe99742d39d9dbb725576b4b5 Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServersTestJSON-1025222992 Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServersTestJSON-1025222992-project Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 55a5dbd5bfce4e8da7446ca4e7388dcd Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServersTestJSON-1025222992-project Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-ServersTestJSON-server-747193369", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "a030562b-ae65-489e-9dce-6909cf1340ba"}]}} Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-747193369', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'a030562b-ae65-489e-9dce-6909cf1340ba'}]}}} Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:27.551271 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-72b0da65-70fc-448a-9f40-09a70e9c131b) Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:22:27.555934 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:22:27.563712 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:27.563712 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:27.563712 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:27.563712 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:27.563712 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:27.563712 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:27.563712 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:27.563712 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:27.563712 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:22:27.563712 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:22:27.563712 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:27.563712 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:27.563712 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:27.563712 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-08803484-aae9-4550-bc1a-307260a3ff3a tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:27.563712 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:22:27.568495 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-08803484-aae9-4550-bc1a-307260a3ff3a tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.555207 Aug 22 17:22:27.569415 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 852/1704] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:22:26 2022] POST /compute/v2.1/servers => generated 214 bytes in 1565 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:22:27.584910 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c76dcbfe-0d98-4637-bd16-7cee7e0dcfef tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Action: 'create', calling method: .version_select at 0x7f800924b670>, body: {"keypair": {"name": "tempest-key-248662822", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFu9b6D7xuKaGtGF7MC/gafprY9uJ64nXdW90NTQKxMlG/oSV5MnCSe5dnomPg/IDpDXv1Pj6a7G75eazIQl7UQMWypzK2b9BFOoXcWTE+r1ePhw021SupTCUKdWY5nqug=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:22:27.624072 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-c76dcbfe-0d98-4637-bd16-7cee7e0dcfef tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Getting quotas for project 1a80188fe99742d39d9dbb725576b4b5. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:22:27.662618 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-c76dcbfe-0d98-4637-bd16-7cee7e0dcfef tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Getting quotas for user 55a5dbd5bfce4e8da7446ca4e7388dcd and project 1a80188fe99742d39d9dbb725576b4b5. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:22:27.821468 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c76dcbfe-0d98-4637-bd16-7cee7e0dcfef tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.241152 Aug 22 17:22:27.833037 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 853/1705] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:22:27 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:22:27.837120 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8c64db0f-df76-4143-bc46-dab3d0c28eef tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Calling method '.version_select at 0x7f8009524b80>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:27.843734 n-d-854030-1 devstack@n-api.service[123016]: WARNING oslo_db.sqlalchemy.utils [None req-8c64db0f-df76-4143-bc46-dab3d0c28eef tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 22 17:22:27.862262 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8c64db0f-df76-4143-bc46-dab3d0c28eef tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] 10.222.0.96 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.029312 Aug 22 17:22:27.863137 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 853/1706] 10.222.0.96 () {58 vars in 1137 bytes} [Mon Aug 22 17:22:27 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:22:28.610800 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c349dcc2-97fb-4021-9db5-4e1612518485 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1551393038", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "key_name": "tempest-key-248662822", "networks": [{"uuid": "a030562b-ae65-489e-9dce-6909cf1340ba"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:22:28.704440 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-c349dcc2-97fb-4021-9db5-4e1612518485 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] validate_networks() for [('a030562b-ae65-489e-9dce-6909cf1340ba', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-c349dcc2-97fb-4021-9db5-4e1612518485 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-42bb4b0c-aaae-4b00-9791-1c31abcf226f) Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:29.187003 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-42bb4b0c-aaae-4b00-9791-1c31abcf226f) Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-c349dcc2-97fb-4021-9db5-4e1612518485 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c349dcc2-97fb-4021-9db5-4e1612518485 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Request method failure captured: Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 238 Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7tMVZVKvNoR9zrCTinMbfT0Lzux-6G_R4YgMSEpzuxPzM6cCEkqJ8A6FzNzl7VQPAWo4RwzEY1L3p8HigcDwI_KLDNiTPRbPP4XGT_t1po6b1xfPhaujiOOtTi7NrlCRvRr2jboYYLR2IoIdscdrOda-cBjOC22AYR3sLXkBZgbNdw Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 1a80188fe99742d39d9dbb725576b4b5 Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersTestJSON-1025222992 Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_1a80188fe99742d39d9dbb725576b4b5", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersTestJSON-1025222992 Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 1a80188fe99742d39d9dbb725576b4b5 Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersTestJSON-1025222992 Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersTestJSON-1025222992-project Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 55a5dbd5bfce4e8da7446ca4e7388dcd Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersTestJSON-1025222992-project Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ServersTestJSON-server-1551393038", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "key_name": "tempest-key-248662822", "networks": [{"uuid": "a030562b-ae65-489e-9dce-6909cf1340ba"}]}} Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-1551393038', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'key_name': 'tempest-key-248662822', 'networks': [{'uuid': 'a030562b-ae65-489e-9dce-6909cf1340ba'}]}}} Aug 22 17:22:29.193578 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:29.205745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-42bb4b0c-aaae-4b00-9791-1c31abcf226f) Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c349dcc2-97fb-4021-9db5-4e1612518485 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c349dcc2-97fb-4021-9db5-4e1612518485 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.584465 Aug 22 17:22:29.214048 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 854/1707] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:22:28 2022] POST /compute/v2.1/servers => generated 214 bytes in 586 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:22:29.216518 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0b8e4f11-3eaa-47ab-92f8-71b412890ecb tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Calling method '.version_select at 0x7f8009558160>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:29.372048 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0b8e4f11-3eaa-47ab-92f8-71b412890ecb tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-key-248662822" status: 202 len: 0 microversion: 2.1 time: 0.175282 Aug 22 17:22:29.373350 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 854/1708] 10.222.0.96 () {58 vars in 1206 bytes} [Mon Aug 22 17:22:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-248662822 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:22:29.780276 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2d942c0f-1f90-4bb8-bf2b-d3b93d8c7204 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-626335522", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "a030562b-ae65-489e-9dce-6909cf1340ba"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:22:29.884489 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-2d942c0f-1f90-4bb8-bf2b-d3b93d8c7204 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] validate_networks() for [('a030562b-ae65-489e-9dce-6909cf1340ba', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-2d942c0f-1f90-4bb8-bf2b-d3b93d8c7204 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1063aa49-cb04-4735-be64-5fb0ac0ab954) Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:30.425171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1063aa49-cb04-4735-be64-5fb0ac0ab954) Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-2d942c0f-1f90-4bb8-bf2b-d3b93d8c7204 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2d942c0f-1f90-4bb8-bf2b-d3b93d8c7204 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Request method failure captured: Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 200 Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7tMVZVKvNoR9zrCTinMbfT0Lzux-6G_R4YgMSEpzuxPzM6cCEkqJ8A6FzNzl7VQPAWo4RwzEY1L3p8HigcDwI_KLDNiTPRbPP4XGT_t1po6b1xfPhaujiOOtTi7NrlCRvRr2jboYYLR2IoIdscdrOda-cBjOC22AYR3sLXkBZgbNdw Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 1a80188fe99742d39d9dbb725576b4b5 Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersTestJSON-1025222992 Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_1a80188fe99742d39d9dbb725576b4b5", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersTestJSON-1025222992 Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 1a80188fe99742d39d9dbb725576b4b5 Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersTestJSON-1025222992 Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersTestJSON-1025222992-project Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 55a5dbd5bfce4e8da7446ca4e7388dcd Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersTestJSON-1025222992-project Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ServersTestJSON-server-626335522", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "a030562b-ae65-489e-9dce-6909cf1340ba"}]}} Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-626335522', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'a030562b-ae65-489e-9dce-6909cf1340ba'}]}}} Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:22:30.428510 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:30.433717 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1063aa49-cb04-4735-be64-5fb0ac0ab954) Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2d942c0f-1f90-4bb8-bf2b-d3b93d8c7204 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2d942c0f-1f90-4bb8-bf2b-d3b93d8c7204 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.654958 Aug 22 17:22:30.450091 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 855/1709] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:22:29 2022] POST /compute/v2.1/servers => generated 214 bytes in 670 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:22:30.942013 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3acddd54-92aa-49e4-bf80-3361b94821a7 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1895368235", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "a030562b-ae65-489e-9dce-6909cf1340ba"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:22:31.024946 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-3acddd54-92aa-49e4-bf80-3361b94821a7 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] validate_networks() for [('a030562b-ae65-489e-9dce-6909cf1340ba', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:22:31.165600 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-22570aa7-e77f-4960-9d3a-b928f539c009 tempest-InstanceActionsNegativeTestJSON-347287592 tempest-InstanceActionsNegativeTestJSON-347287592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1556416345", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "e29854b7-d2c9-4891-b400-983f3e0e042f"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:22:31.276222 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-22570aa7-e77f-4960-9d3a-b928f539c009 tempest-InstanceActionsNegativeTestJSON-347287592 tempest-InstanceActionsNegativeTestJSON-347287592-project] validate_networks() for [('e29854b7-d2c9-4891-b400-983f3e0e042f', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-3acddd54-92aa-49e4-bf80-3361b94821a7 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0d95434e-a8a7-4a60-9d89-02500cba44bc) Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:31.840048 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0d95434e-a8a7-4a60-9d89-02500cba44bc) Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-3acddd54-92aa-49e4-bf80-3361b94821a7 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3acddd54-92aa-49e4-bf80-3361b94821a7 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Request method failure captured: Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 201 Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7tMVZVKvNoR9zrCTinMbfT0Lzux-6G_R4YgMSEpzuxPzM6cCEkqJ8A6FzNzl7VQPAWo4RwzEY1L3p8HigcDwI_KLDNiTPRbPP4XGT_t1po6b1xfPhaujiOOtTi7NrlCRvRr2jboYYLR2IoIdscdrOda-cBjOC22AYR3sLXkBZgbNdw Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 1a80188fe99742d39d9dbb725576b4b5 Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersTestJSON-1025222992 Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_1a80188fe99742d39d9dbb725576b4b5", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersTestJSON-1025222992 Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 1a80188fe99742d39d9dbb725576b4b5 Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersTestJSON-1025222992 Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersTestJSON-1025222992-project Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 55a5dbd5bfce4e8da7446ca4e7388dcd Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersTestJSON-1025222992-project Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ServersTestJSON-server-1895368235", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "a030562b-ae65-489e-9dce-6909cf1340ba"}]}} Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-1895368235', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'a030562b-ae65-489e-9dce-6909cf1340ba'}]}}} Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:22:31.844801 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:31.854899 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0d95434e-a8a7-4a60-9d89-02500cba44bc) Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3acddd54-92aa-49e4-bf80-3361b94821a7 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3acddd54-92aa-49e4-bf80-3361b94821a7 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.920394 Aug 22 17:22:31.868182 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 856/1710] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:22:30 2022] POST /compute/v2.1/servers => generated 214 bytes in 922 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:22:32.455273 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2ce345c5-1969-470f-8e1b-80026a9b43c9 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-586842260", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "a030562b-ae65-489e-9dce-6909cf1340ba"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-22570aa7-e77f-4960-9d3a-b928f539c009 tempest-InstanceActionsNegativeTestJSON-347287592 tempest-InstanceActionsNegativeTestJSON-347287592-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f486c063-208d-4fc8-a3c8-9e2785067500) Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:32.487247 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f486c063-208d-4fc8-a3c8-9e2785067500) Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-22570aa7-e77f-4960-9d3a-b928f539c009 tempest-InstanceActionsNegativeTestJSON-347287592 tempest-InstanceActionsNegativeTestJSON-347287592-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-22570aa7-e77f-4960-9d3a-b928f539c009 tempest-InstanceActionsNegativeTestJSON-347287592 tempest-InstanceActionsNegativeTestJSON-347287592-project] Request method failure captured: Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 217 Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7tWF2UECUTuhBaIwYAS7atFWOD7m9hfeOkaOHegDdLzxXCaXxz-RBOD4uWARxq2hyQkBr06mpH31u5kp8vOWVWgLRwbXY8wd0OJG0pNMINJWvuy6hdBsZhZxgqLhcaEailE1T90mrjpONIEaJtsfzW3LGJA8bkkBk6EfgrMudFjmsQ Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 957f59fc730c42fba0dc0c2ff564da7c Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-347287592 Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/957f59fc730c42fba0dc0c2ff564da7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_957f59fc730c42fba0dc0c2ff564da7c", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/957f59fc730c42fba0dc0c2ff564da7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/957f59fc730c42fba0dc0c2ff564da7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-347287592 Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 957f59fc730c42fba0dc0c2ff564da7c Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-347287592 Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-InstanceActionsNegativeTestJSON-347287592-project Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 73691f34439540088890cc48a6eb44c7 Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-347287592-project Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1556416345", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "e29854b7-d2c9-4891-b400-983f3e0e042f"}]}} Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:32.491927 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-InstanceActionsNegativeTestJSON-server-1556416345', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'e29854b7-d2c9-4891-b400-983f3e0e042f'}]}}} Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:32.505966 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f486c063-208d-4fc8-a3c8-9e2785067500) Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-22570aa7-e77f-4960-9d3a-b928f539c009 tempest-InstanceActionsNegativeTestJSON-347287592 tempest-InstanceActionsNegativeTestJSON-347287592-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-22570aa7-e77f-4960-9d3a-b928f539c009 tempest-InstanceActionsNegativeTestJSON-347287592 tempest-InstanceActionsNegativeTestJSON-347287592-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.963152 Aug 22 17:22:32.510731 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 855/1711] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:22:30 2022] POST /compute/v2.1/servers => generated 214 bytes in 1965 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:22:32.629047 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-2ce345c5-1969-470f-8e1b-80026a9b43c9 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] validate_networks() for [('a030562b-ae65-489e-9dce-6909cf1340ba', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-2ce345c5-1969-470f-8e1b-80026a9b43c9 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2ea6e9c2-6db7-4e82-8cc5-fb859631f41e) Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:33.235664 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2ea6e9c2-6db7-4e82-8cc5-fb859631f41e) Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-2ce345c5-1969-470f-8e1b-80026a9b43c9 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2ce345c5-1969-470f-8e1b-80026a9b43c9 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Request method failure captured: Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 200 Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7tMVZVKvNoR9zrCTinMbfT0Lzux-6G_R4YgMSEpzuxPzM6cCEkqJ8A6FzNzl7VQPAWo4RwzEY1L3p8HigcDwI_KLDNiTPRbPP4XGT_t1po6b1xfPhaujiOOtTi7NrlCRvRr2jboYYLR2IoIdscdrOda-cBjOC22AYR3sLXkBZgbNdw Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 1a80188fe99742d39d9dbb725576b4b5 Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersTestJSON-1025222992 Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_1a80188fe99742d39d9dbb725576b4b5", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/1a80188fe99742d39d9dbb725576b4b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersTestJSON-1025222992 Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 1a80188fe99742d39d9dbb725576b4b5 Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersTestJSON-1025222992 Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersTestJSON-1025222992-project Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 55a5dbd5bfce4e8da7446ca4e7388dcd Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersTestJSON-1025222992-project Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ServersTestJSON-server-586842260", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "a030562b-ae65-489e-9dce-6909cf1340ba"}]}} Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-586842260', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'a030562b-ae65-489e-9dce-6909cf1340ba'}]}}} Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:22:33.239452 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:33.250050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2ea6e9c2-6db7-4e82-8cc5-fb859631f41e) Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2ce345c5-1969-470f-8e1b-80026a9b43c9 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2ce345c5-1969-470f-8e1b-80026a9b43c9 tempest-ServersTestJSON-1025222992 tempest-ServersTestJSON-1025222992-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.791690 Aug 22 17:22:33.261249 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 857/1712] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:22:32 2022] POST /compute/v2.1/servers => generated 214 bytes in 800 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 22 17:22:36.967503 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e907fdf4-df4a-444b-ab12-2b85913218c9 tempest-PortsAdminExtendedAttrsTestJSON-782227400 tempest-PortsAdminExtendedAttrsTestJSON-782227400-project-admin] Calling method '.version_select at 0x7f8009e7bca0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:36.969000 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:22:36.969000 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:22:36.970772 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e907fdf4-df4a-444b-ab12-2b85913218c9 tempest-PortsAdminExtendedAttrsTestJSON-782227400 tempest-PortsAdminExtendedAttrsTestJSON-782227400-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:22:36.971573 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e907fdf4-df4a-444b-ab12-2b85913218c9 tempest-PortsAdminExtendedAttrsTestJSON-782227400 tempest-PortsAdminExtendedAttrsTestJSON-782227400-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:22:36.972363 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e907fdf4-df4a-444b-ab12-2b85913218c9 tempest-PortsAdminExtendedAttrsTestJSON-782227400 tempest-PortsAdminExtendedAttrsTestJSON-782227400-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:22:37.030240 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e907fdf4-df4a-444b-ab12-2b85913218c9 tempest-PortsAdminExtendedAttrsTestJSON-782227400 tempest-PortsAdminExtendedAttrsTestJSON-782227400-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:22:37.030759 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e907fdf4-df4a-444b-ab12-2b85913218c9 tempest-PortsAdminExtendedAttrsTestJSON-782227400 tempest-PortsAdminExtendedAttrsTestJSON-782227400-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:22:37.031205 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e907fdf4-df4a-444b-ab12-2b85913218c9 tempest-PortsAdminExtendedAttrsTestJSON-782227400 tempest-PortsAdminExtendedAttrsTestJSON-782227400-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:22:37.044665 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e907fdf4-df4a-444b-ab12-2b85913218c9 tempest-PortsAdminExtendedAttrsTestJSON-782227400 tempest-PortsAdminExtendedAttrsTestJSON-782227400-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:22:37.045763 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e907fdf4-df4a-444b-ab12-2b85913218c9 tempest-PortsAdminExtendedAttrsTestJSON-782227400 tempest-PortsAdminExtendedAttrsTestJSON-782227400-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:22:37.046415 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e907fdf4-df4a-444b-ab12-2b85913218c9 tempest-PortsAdminExtendedAttrsTestJSON-782227400 tempest-PortsAdminExtendedAttrsTestJSON-782227400-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:22:37.055426 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e907fdf4-df4a-444b-ab12-2b85913218c9 tempest-PortsAdminExtendedAttrsTestJSON-782227400 tempest-PortsAdminExtendedAttrsTestJSON-782227400-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.594176 Aug 22 17:22:37.056736 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 856/1713] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:22:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:22:42.976542 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:22:42.977656 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:22:42.982534 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-69a6e15a-a58e-4f2a-80e0-f8cce23ced1b tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] Calling method '.version_select at 0x7f80092603a0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:43.150875 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-69a6e15a-a58e-4f2a-80e0-f8cce23ced1b tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/d25cf73f-8872-42cf-83ea-bdf35d2a0cc9" status: 200 len: 351 microversion: 2.1 time: 0.174314 Aug 22 17:22:43.153236 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 858/1714] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:22:42 2022] GET /compute/v2.1/os-volumes/d25cf73f-8872-42cf-83ea-bdf35d2a0cc9 => generated 351 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:22:46.750021 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d8350679-9acb-4461-a72a-aed879218f6a tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] Calling method '.version_select at 0x7f8009eb6dc0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:46.962913 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d8350679-9acb-4461-a72a-aed879218f6a tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/9dd4d74a-b0cf-4afa-969b-dc786be71670" status: 200 len: 351 microversion: 2.1 time: 0.220072 Aug 22 17:22:46.964036 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 857/1715] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:22:46 2022] GET /compute/v2.1/os-volumes/9dd4d74a-b0cf-4afa-969b-dc786be71670 => generated 351 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:22:47.322448 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-49edd49d-b91e-4d5b-99a1-6a3fe859180c tempest-ServerRescueNegativeTestJSON-1993846564 tempest-ServerRescueNegativeTestJSON-1993846564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-344728283", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:22:47.530121 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-49edd49d-b91e-4d5b-99a1-6a3fe859180c tempest-ServerRescueNegativeTestJSON-1993846564 tempest-ServerRescueNegativeTestJSON-1993846564-project] validate_networks() for [('84ba1239-68cd-4d7e-9616-6a68a4eceb7f', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-49edd49d-b91e-4d5b-99a1-6a3fe859180c tempest-ServerRescueNegativeTestJSON-1993846564 tempest-ServerRescueNegativeTestJSON-1993846564-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9236593d-7b4c-4c24-b2f7-63c0267da84d) Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:48.792517 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9236593d-7b4c-4c24-b2f7-63c0267da84d) Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-49edd49d-b91e-4d5b-99a1-6a3fe859180c tempest-ServerRescueNegativeTestJSON-1993846564 tempest-ServerRescueNegativeTestJSON-1993846564-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-49edd49d-b91e-4d5b-99a1-6a3fe859180c tempest-ServerRescueNegativeTestJSON-1993846564 tempest-ServerRescueNegativeTestJSON-1993846564-project] Request method failure captured: Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 245 Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7tmha3WMkg8MEvH70fe7qvr6JhAfvaX6CnPdGwoLwm8JdBPNGwCEF-_4sVqqzAjFZmzk-7rAc4S1VYPbg3r0lEggc812q10ae5ZJ_M2Gr6tZcz3HKiTsEawfMCnxh4QfcL8sNtrV3EnDK2qUT1-ZHFHS3zXrKAUPzUiW5_OvfChdIk Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 6b03b469a1a34890940278e3718c226e Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1993846564 Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/6b03b469a1a34890940278e3718c226e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_6b03b469a1a34890940278e3718c226e", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/6b03b469a1a34890940278e3718c226e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/6b03b469a1a34890940278e3718c226e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1993846564 Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 6b03b469a1a34890940278e3718c226e Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1993846564 Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServerRescueNegativeTestJSON-1993846564-project Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 7599f8b4006540648b92560a980dc2cd Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1993846564-project Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-344728283", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "V0=@C2xTIBfrznq", "networks": [{"uuid": "84ba1239-68cd-4d7e-9616-6a68a4eceb7f"}]}} Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:48.805240 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ServerRescueNegativeTestJSON-server-344728283', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'adminPass': 'V0=@C2xTIBfrznq', 'networks': [{'uuid': '84ba1239-68cd-4d7e-9616-6a68a4eceb7f'}]}}} Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:48.815244 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9236593d-7b4c-4c24-b2f7-63c0267da84d) Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-49edd49d-b91e-4d5b-99a1-6a3fe859180c tempest-ServerRescueNegativeTestJSON-1993846564 tempest-ServerRescueNegativeTestJSON-1993846564-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-49edd49d-b91e-4d5b-99a1-6a3fe859180c tempest-ServerRescueNegativeTestJSON-1993846564 tempest-ServerRescueNegativeTestJSON-1993846564-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.948050 Aug 22 17:22:48.829177 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 859/1716] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:22:46 2022] POST /compute/v2.1/servers => generated 214 bytes in 1954 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:22:49.799980 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:22:49.800946 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=6 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:22:50.497702 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7edc5e8c-15c9-4f23-b764-eec85dac0161 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1281472631", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "04128683-7f55-4d11-9f50-9969d3a0763b"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:22:50.654023 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-7edc5e8c-15c9-4f23-b764-eec85dac0161 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] validate_networks() for [('04128683-7f55-4d11-9f50-9969d3a0763b', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-7edc5e8c-15c9-4f23-b764-eec85dac0161 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9a5338fe-d78e-4632-8723-685a2c3b3d7a) Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:51.651069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9a5338fe-d78e-4632-8723-685a2c3b3d7a) Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-7edc5e8c-15c9-4f23-b764-eec85dac0161 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7edc5e8c-15c9-4f23-b764-eec85dac0161 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] Request method failure captured: Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 210 Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7tpkZrsJjM6-Fp231ITlrlCRnn_DxgATbrwHFJ_hz09WOx0xWe0xdDt-quAIx_Kj76YPtotaayTDLHn4GvdkwCHkj1h9X_nN3oF8y6hTXlES5eCW7LEhijKpK590YOT9VJ_xeNzDAndWUG3mIe3ajSHnoBvqy76vMwU4CyYpFLJFBo Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 455343567a0d4a83a490b6b72f5d57e6 Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServerDiskConfigTestJSON-758594752 Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/455343567a0d4a83a490b6b72f5d57e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_455343567a0d4a83a490b6b72f5d57e6", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/455343567a0d4a83a490b6b72f5d57e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/455343567a0d4a83a490b6b72f5d57e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServerDiskConfigTestJSON-758594752 Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 455343567a0d4a83a490b6b72f5d57e6 Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-758594752 Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServerDiskConfigTestJSON-758594752-project Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 3988a822a1d14222b46a3524e8c6f337 Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServerDiskConfigTestJSON-758594752-project Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1281472631", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "04128683-7f55-4d11-9f50-9969d3a0763b"}]}} Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:22:51.655592 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-1281472631', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '04128683-7f55-4d11-9f50-9969d3a0763b'}]}}} Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:51.664149 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9a5338fe-d78e-4632-8723-685a2c3b3d7a) Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7edc5e8c-15c9-4f23-b764-eec85dac0161 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7edc5e8c-15c9-4f23-b764-eec85dac0161 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.846791 Aug 22 17:22:51.673886 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 858/1717] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:22:49 2022] POST /compute/v2.1/servers => generated 214 bytes in 1848 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:22:51.934832 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ec3daf4b-16b3-475a-9e9a-545b4fad3396 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1242629607", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "04128683-7f55-4d11-9f50-9969d3a0763b"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:22:52.016175 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-735bc4ac-8e13-4b6d-b5f6-d62ec56ac7df tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] Calling method '.version_select at 0x7f800a0ff940>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:52.081337 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-ec3daf4b-16b3-475a-9e9a-545b4fad3396 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] validate_networks() for [('04128683-7f55-4d11-9f50-9969d3a0763b', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:22:52.142911 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-735bc4ac-8e13-4b6d-b5f6-d62ec56ac7df tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/1aa89449-b067-4b74-9e1a-72cf582b0b06" status: 200 len: 350 microversion: 2.1 time: 0.121750 Aug 22 17:22:52.142911 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 859/1718] 10.222.0.96 () {58 vars in 1245 bytes} [Mon Aug 22 17:22:52 2022] GET /compute/v2.1/os-volumes/1aa89449-b067-4b74-9e1a-72cf582b0b06 => generated 350 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:22:52.147949 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d00b1857-9345-493a-9d53-037e38b5e2ad tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] Calling method '.version_select at 0x7f800971c3a0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:52.361893 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d00b1857-9345-493a-9d53-037e38b5e2ad tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] 10.222.0.96 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.218947 Aug 22 17:22:52.363111 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 860/1719] 10.222.0.96 () {58 vars in 1134 bytes} [Mon Aug 22 17:22:52 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:22:52.394028 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-36bba0b0-e598-48a9-88c3-e3fad321a655 tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] Calling method '.version_select at 0x7f80096fbe50>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:52.599616 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-36bba0b0-e598-48a9-88c3-e3fad321a655 tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] 10.222.0.96 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.223749 Aug 22 17:22:52.600465 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 861/1720] 10.222.0.96 () {58 vars in 1149 bytes} [Mon Aug 22 17:22:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:22:52.616719 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b7122af0-f6c9-4baf-8a5f-64efe6fc939e tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] Calling method '.version_select at 0x7f8009be8280>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:52.858617 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b7122af0-f6c9-4baf-8a5f-64efe6fc939e tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] 10.222.0.96 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.246059 Aug 22 17:22:52.859264 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 862/1721] 10.222.0.96 () {58 vars in 1134 bytes} [Mon Aug 22 17:22:52 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:22:52.873891 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9507a0db-3d04-4902-8a02-9780cede409f tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] Calling method '.version_select at 0x7f80099ca310>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:53.095149 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9507a0db-3d04-4902-8a02-9780cede409f tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] 10.222.0.96 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.226049 Aug 22 17:22:53.098266 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 863/1722] 10.222.0.96 () {58 vars in 1167 bytes} [Mon Aug 22 17:22:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:22:53.111554 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0ee5b8ec-6790-432e-8c3d-9e00e9fde870 tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] Calling method '.version_select at 0x7f800a60e040>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-ec3daf4b-16b3-475a-9e9a-545b4fad3396 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ea5b1985-451d-4f3f-87d1-8451b4f957f9) Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:53.304616 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:53.310504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:53.310504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:53.310504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:53.310504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:53.310504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:53.310504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:53.310504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:53.310504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:53.310504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:53.310504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:53.310504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:53.310504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:53.310504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:53.310504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:53.310504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:53.310504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ea5b1985-451d-4f3f-87d1-8451b4f957f9) Aug 22 17:22:53.310504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:53.313251 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-ec3daf4b-16b3-475a-9e9a-545b4fad3396 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:53.313251 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ec3daf4b-16b3-475a-9e9a-545b4fad3396 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] Request method failure captured: Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 210 Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7tpkZrsJjM6-Fp231ITlrlCRnn_DxgATbrwHFJ_hz09WOx0xWe0xdDt-quAIx_Kj76YPtotaayTDLHn4GvdkwCHkj1h9X_nN3oF8y6hTXlES5eCW7LEhijKpK590YOT9VJ_xeNzDAndWUG3mIe3ajSHnoBvqy76vMwU4CyYpFLJFBo Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 455343567a0d4a83a490b6b72f5d57e6 Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServerDiskConfigTestJSON-758594752 Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/455343567a0d4a83a490b6b72f5d57e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_455343567a0d4a83a490b6b72f5d57e6", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/455343567a0d4a83a490b6b72f5d57e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/455343567a0d4a83a490b6b72f5d57e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServerDiskConfigTestJSON-758594752 Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 455343567a0d4a83a490b6b72f5d57e6 Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-758594752 Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServerDiskConfigTestJSON-758594752-project Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 3988a822a1d14222b46a3524e8c6f337 Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServerDiskConfigTestJSON-758594752-project Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1242629607", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "04128683-7f55-4d11-9f50-9969d3a0763b"}]}} Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-1242629607', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '04128683-7f55-4d11-9f50-9969d3a0763b'}]}}} Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:53.316639 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ea5b1985-451d-4f3f-87d1-8451b4f957f9) Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:22:53.321181 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:22:53.333300 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:53.333300 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:53.333300 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:53.333300 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:53.333300 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:53.333300 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:53.333300 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:53.333300 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:53.333300 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:22:53.333300 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:22:53.333300 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:53.333300 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:53.333300 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:22:53.333300 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ec3daf4b-16b3-475a-9e9a-545b4fad3396 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:53.333300 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:22:53.333300 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ec3daf4b-16b3-475a-9e9a-545b4fad3396 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.395270 Aug 22 17:22:53.333300 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 860/1723] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:22:51 2022] POST /compute/v2.1/servers => generated 214 bytes in 1397 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:22:53.334352 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0ee5b8ec-6790-432e-8c3d-9e00e9fde870 tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.217697 Aug 22 17:22:53.334352 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 864/1724] 10.222.0.96 () {58 vars in 1170 bytes} [Mon Aug 22 17:22:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:22:53.348626 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b561dec8-0dc7-4bdc-b937-ce98ee49d52b tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] Calling method '.version_select at 0x7f800a075af0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:53.466816 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b561dec8-0dc7-4bdc-b937-ce98ee49d52b tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.122143 Aug 22 17:22:53.467685 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 865/1725] 10.222.0.96 () {58 vars in 1155 bytes} [Mon Aug 22 17:22:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:22:53.487805 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-492a083a-2ba9-4415-86e2-63176fdd29a2 tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] Calling method '.version_select at 0x7f8009a2faf0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:53.665219 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-492a083a-2ba9-4415-86e2-63176fdd29a2 tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.181375 Aug 22 17:22:53.666299 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 866/1726] 10.222.0.96 () {58 vars in 1188 bytes} [Mon Aug 22 17:22:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:22:53.692592 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ddbd37af-9af5-44b8-94a0-f7e873ff10cf tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] Calling method '.version_select at 0x7f8009470c10>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:53.925461 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ddbd37af-9af5-44b8-94a0-f7e873ff10cf tempest-VolumesTestJSON-265164538 tempest-VolumesTestJSON-265164538-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.237507 Aug 22 17:22:53.927608 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 867/1727] 10.222.0.96 () {58 vars in 1155 bytes} [Mon Aug 22 17:22:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:22:53.944817 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1ad71de4-a09f-4a66-8c2f-1caa3ca2fd49 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-304687775", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "04128683-7f55-4d11-9f50-9969d3a0763b"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:22:53.963169 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-05de7cc7-859a-408e-832f-36b9e54e79eb tempest-ExtensionsTest-589821680 tempest-ExtensionsTest-589821680-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:53.965427 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-05de7cc7-859a-408e-832f-36b9e54e79eb tempest-ExtensionsTest-589821680 tempest-ExtensionsTest-589821680-project] 10.222.0.96 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.640103 Aug 22 17:22:53.966313 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 861/1728] 10.222.0.96 () {58 vars in 1170 bytes} [Mon Aug 22 17:22:53 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:22:53.978146 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e66ad427-6cd6-47b4-b242-0faf9bff749a tempest-ExtensionsTest-589821680 tempest-ExtensionsTest-589821680-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:53.985628 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e66ad427-6cd6-47b4-b242-0faf9bff749a tempest-ExtensionsTest-589821680 tempest-ExtensionsTest-589821680-project] 10.222.0.96 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.013048 Aug 22 17:22:53.987799 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 862/1729] 10.222.0.96 () {58 vars in 1134 bytes} [Mon Aug 22 17:22:53 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:22:54.090134 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-1ad71de4-a09f-4a66-8c2f-1caa3ca2fd49 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] validate_networks() for [('04128683-7f55-4d11-9f50-9969d3a0763b', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:22:54.245036 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-331664ed-2b22-4cc6-bc68-946cd7f2f9e6 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-833968466", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": "none"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:22:54.390984 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-331664ed-2b22-4cc6-bc68-946cd7f2f9e6 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:22:54.392618 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-331664ed-2b22-4cc6-bc68-946cd7f2f9e6 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:22:54.393426 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-331664ed-2b22-4cc6-bc68-946cd7f2f9e6 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:22:54.394062 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-331664ed-2b22-4cc6-bc68-946cd7f2f9e6 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:22:54.394718 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-331664ed-2b22-4cc6-bc68-946cd7f2f9e6 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:22:54.406620 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-331664ed-2b22-4cc6-bc68-946cd7f2f9e6 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:22:54.407124 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-331664ed-2b22-4cc6-bc68-946cd7f2f9e6 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:22:54.407812 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-331664ed-2b22-4cc6-bc68-946cd7f2f9e6 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:22:54.408804 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-331664ed-2b22-4cc6-bc68-946cd7f2f9e6 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:22:54.409546 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-331664ed-2b22-4cc6-bc68-946cd7f2f9e6 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:22:54.410236 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-331664ed-2b22-4cc6-bc68-946cd7f2f9e6 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:22:54.435295 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-331664ed-2b22-4cc6-bc68-946cd7f2f9e6 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Getting quotas for project 51269acf039f4159b25d0c76703234b6. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:22:54.440677 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-331664ed-2b22-4cc6-bc68-946cd7f2f9e6 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Getting quotas for user 906cb1e237b64a1482ae7136591cc3c8 and project 51269acf039f4159b25d0c76703234b6. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:22:54.456111 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-331664ed-2b22-4cc6-bc68-946cd7f2f9e6 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Going to run 1 instances... {{(pid=123015) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:22:54.458611 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-331664ed-2b22-4cc6-bc68-946cd7f2f9e6 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:22:54.606601 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-331664ed-2b22-4cc6-bc68-946cd7f2f9e6 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.497179 Aug 22 17:22:54.616171 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 863/1730] 10.222.0.96 () {62 vars in 1188 bytes} [Mon Aug 22 17:22:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 22 17:22:54.623166 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-82029d17-cdf3-44e0-99b5-01ec10044a87 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:54.640327 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-82029d17-cdf3-44e0-99b5-01ec10044a87 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-1ad71de4-a09f-4a66-8c2f-1caa3ca2fd49 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8edf2cd9-5e08-4eec-b3e6-df2745185951) Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:54.749511 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:54.753752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:54.753752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:54.753752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:54.753752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:54.753752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:54.753752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:54.753752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:54.753752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:54.753752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:54.753752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:54.753752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:54.753752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:54.753752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:54.753752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:54.753752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:54.753752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8edf2cd9-5e08-4eec-b3e6-df2745185951) Aug 22 17:22:54.753752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:54.753752 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-1ad71de4-a09f-4a66-8c2f-1caa3ca2fd49 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:54.753752 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1ad71de4-a09f-4a66-8c2f-1caa3ca2fd49 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] Request method failure captured: Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 209 Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7tpkZrsJjM6-Fp231ITlrlCRnn_DxgATbrwHFJ_hz09WOx0xWe0xdDt-quAIx_Kj76YPtotaayTDLHn4GvdkwCHkj1h9X_nN3oF8y6hTXlES5eCW7LEhijKpK590YOT9VJ_xeNzDAndWUG3mIe3ajSHnoBvqy76vMwU4CyYpFLJFBo Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 455343567a0d4a83a490b6b72f5d57e6 Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServerDiskConfigTestJSON-758594752 Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/455343567a0d4a83a490b6b72f5d57e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_455343567a0d4a83a490b6b72f5d57e6", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/455343567a0d4a83a490b6b72f5d57e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/455343567a0d4a83a490b6b72f5d57e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServerDiskConfigTestJSON-758594752 Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 455343567a0d4a83a490b6b72f5d57e6 Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-758594752 Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServerDiskConfigTestJSON-758594752-project Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 3988a822a1d14222b46a3524e8c6f337 Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServerDiskConfigTestJSON-758594752-project Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-304687775", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "04128683-7f55-4d11-9f50-9969d3a0763b"}]}} Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-304687775', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '04128683-7f55-4d11-9f50-9969d3a0763b'}]}}} Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:22:54.756240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8edf2cd9-5e08-4eec-b3e6-df2745185951) Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:22:54.762477 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:22:54.772549 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:54.772549 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:54.772549 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:54.772549 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:22:54.772549 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:54.772549 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:22:54.772549 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:22:54.772549 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:22:54.772549 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:22:54.772549 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:22:54.772549 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:54.772549 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:54.772549 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:22:54.772549 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1ad71de4-a09f-4a66-8c2f-1caa3ca2fd49 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:22:54.772549 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:22:54.772549 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1ad71de4-a09f-4a66-8c2f-1caa3ca2fd49 tempest-ServerDiskConfigTestJSON-758594752 tempest-ServerDiskConfigTestJSON-758594752-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.829739 Aug 22 17:22:54.772549 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 868/1731] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:22:53 2022] POST /compute/v2.1/servers => generated 214 bytes in 832 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:22:54.804072 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-82029d17-cdf3-44e0-99b5-01ec10044a87 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:22:54.819032 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-82029d17-cdf3-44e0-99b5-01ec10044a87 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:22:54.820557 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-82029d17-cdf3-44e0-99b5-01ec10044a87 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:22:54.821752 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-82029d17-cdf3-44e0-99b5-01ec10044a87 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1277 microversion: 2.54 time: 0.204436 Aug 22 17:22:54.839636 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 864/1732] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:22:54 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1277 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:22:55.854917 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-76e60fd6-a092-4fe5-8ff7-d6b8562fe254 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:55.856008 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-76e60fd6-a092-4fe5-8ff7-d6b8562fe254 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:22:56.204723 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-76e60fd6-a092-4fe5-8ff7-d6b8562fe254 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:22:56.221741 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-76e60fd6-a092-4fe5-8ff7-d6b8562fe254 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:22:56.223460 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-76e60fd6-a092-4fe5-8ff7-d6b8562fe254 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:22:56.224740 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-76e60fd6-a092-4fe5-8ff7-d6b8562fe254 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1277 microversion: 2.54 time: 0.374975 Aug 22 17:22:56.241115 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 869/1733] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:22:55 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1277 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:22:57.253113 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f94c26c8-b5b4-42fd-b367-b1c9fbb68891 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:57.258390 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f94c26c8-b5b4-42fd-b367-b1c9fbb68891 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:22:57.487387 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f94c26c8-b5b4-42fd-b367-b1c9fbb68891 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:22:57.510208 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f94c26c8-b5b4-42fd-b367-b1c9fbb68891 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:22:57.517285 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f94c26c8-b5b4-42fd-b367-b1c9fbb68891 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:22:57.522527 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f94c26c8-b5b4-42fd-b367-b1c9fbb68891 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1277 microversion: 2.54 time: 0.269903 Aug 22 17:22:57.523436 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 865/1734] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:22:57 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1277 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:22:58.560775 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-901f3e4d-4b65-4e55-92e0-d759a76b217f tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:58.561663 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-901f3e4d-4b65-4e55-92e0-d759a76b217f tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:22:58.743048 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-901f3e4d-4b65-4e55-92e0-d759a76b217f tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:22:58.757194 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-901f3e4d-4b65-4e55-92e0-d759a76b217f tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:22:58.758994 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-901f3e4d-4b65-4e55-92e0-d759a76b217f tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:22:58.760341 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-901f3e4d-4b65-4e55-92e0-d759a76b217f tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1277 microversion: 2.54 time: 0.210852 Aug 22 17:22:58.761462 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 870/1735] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:22:58 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1277 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:22:59.788265 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-277ef1db-2dba-4aa1-b911-727214575ec4 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:22:59.789107 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-277ef1db-2dba-4aa1-b911-727214575ec4 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:22:59.851892 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-277ef1db-2dba-4aa1-b911-727214575ec4 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:22:59.861747 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-277ef1db-2dba-4aa1-b911-727214575ec4 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:22:59.863770 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-277ef1db-2dba-4aa1-b911-727214575ec4 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:22:59.865280 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-277ef1db-2dba-4aa1-b911-727214575ec4 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1277 microversion: 2.54 time: 0.082120 Aug 22 17:22:59.866099 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 866/1736] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:22:59 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1277 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:00.897500 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8f714f03-4b68-4b62-b43b-f085da0a60d9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:00.898788 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-8f714f03-4b68-4b62-b43b-f085da0a60d9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:00.934160 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8f714f03-4b68-4b62-b43b-f085da0a60d9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:00.936606 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8f714f03-4b68-4b62-b43b-f085da0a60d9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:00.939386 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8f714f03-4b68-4b62-b43b-f085da0a60d9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:00.940902 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8f714f03-4b68-4b62-b43b-f085da0a60d9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:00.948158 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8f714f03-4b68-4b62-b43b-f085da0a60d9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:00.950078 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8f714f03-4b68-4b62-b43b-f085da0a60d9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:01.544955 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-8f714f03-4b68-4b62-b43b-f085da0a60d9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:01.569541 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-8f714f03-4b68-4b62-b43b-f085da0a60d9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:01.570500 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-8f714f03-4b68-4b62-b43b-f085da0a60d9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:01.572724 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8f714f03-4b68-4b62-b43b-f085da0a60d9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1329 microversion: 2.54 time: 0.681673 Aug 22 17:23:01.574994 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 871/1737] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:00 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1329 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:02.603809 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a4ce1f89-6110-4e93-a94f-36f5e52ee5b7 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:02.604715 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a4ce1f89-6110-4e93-a94f-36f5e52ee5b7 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:02.622266 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a4ce1f89-6110-4e93-a94f-36f5e52ee5b7 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:02.624298 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a4ce1f89-6110-4e93-a94f-36f5e52ee5b7 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:02.625479 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a4ce1f89-6110-4e93-a94f-36f5e52ee5b7 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:02.626778 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a4ce1f89-6110-4e93-a94f-36f5e52ee5b7 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:02.628640 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a4ce1f89-6110-4e93-a94f-36f5e52ee5b7 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:02.629592 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a4ce1f89-6110-4e93-a94f-36f5e52ee5b7 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:02.784131 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a4ce1f89-6110-4e93-a94f-36f5e52ee5b7 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:02.795174 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a4ce1f89-6110-4e93-a94f-36f5e52ee5b7 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:02.797009 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a4ce1f89-6110-4e93-a94f-36f5e52ee5b7 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:02.802724 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a4ce1f89-6110-4e93-a94f-36f5e52ee5b7 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1335 microversion: 2.54 time: 0.203188 Aug 22 17:23:02.803469 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 867/1738] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:02 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1335 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:03.829148 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-578f8cc2-3d56-4556-8345-11b5a92696ec tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:03.829775 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-578f8cc2-3d56-4556-8345-11b5a92696ec tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:03.853432 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-578f8cc2-3d56-4556-8345-11b5a92696ec tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:03.853971 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-578f8cc2-3d56-4556-8345-11b5a92696ec tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:03.855639 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-578f8cc2-3d56-4556-8345-11b5a92696ec tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:03.856497 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-578f8cc2-3d56-4556-8345-11b5a92696ec tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:03.858804 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-578f8cc2-3d56-4556-8345-11b5a92696ec tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:03.859254 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-578f8cc2-3d56-4556-8345-11b5a92696ec tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:04.098672 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-578f8cc2-3d56-4556-8345-11b5a92696ec tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:04.114698 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-578f8cc2-3d56-4556-8345-11b5a92696ec tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:04.116347 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-578f8cc2-3d56-4556-8345-11b5a92696ec tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:04.119397 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-578f8cc2-3d56-4556-8345-11b5a92696ec tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1335 microversion: 2.54 time: 0.295079 Aug 22 17:23:04.140148 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 872/1739] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:03 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1335 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:05.152802 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ff5741ff-b68c-4848-bd05-28e6f1b738fb tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:05.155006 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ff5741ff-b68c-4848-bd05-28e6f1b738fb tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:05.168601 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:23:05.175404 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ff5741ff-b68c-4848-bd05-28e6f1b738fb tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:05.176809 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ff5741ff-b68c-4848-bd05-28e6f1b738fb tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:05.204526 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ff5741ff-b68c-4848-bd05-28e6f1b738fb tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:05.205340 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ff5741ff-b68c-4848-bd05-28e6f1b738fb tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:05.205832 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ff5741ff-b68c-4848-bd05-28e6f1b738fb tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:05.206329 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ff5741ff-b68c-4848-bd05-28e6f1b738fb tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:05.423814 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ff5741ff-b68c-4848-bd05-28e6f1b738fb tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:05.463517 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ff5741ff-b68c-4848-bd05-28e6f1b738fb tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:05.469039 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ff5741ff-b68c-4848-bd05-28e6f1b738fb tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:05.471468 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ff5741ff-b68c-4848-bd05-28e6f1b738fb tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1335 microversion: 2.54 time: 0.328021 Aug 22 17:23:05.479763 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 868/1740] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:05 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1335 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:05.613463 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:23:05.614667 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:23:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:23:06.503533 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-27514cc3-ef0f-4c40-b755-673d82d76963 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:06.504198 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-27514cc3-ef0f-4c40-b755-673d82d76963 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:06.519131 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-27514cc3-ef0f-4c40-b755-673d82d76963 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:06.520881 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-27514cc3-ef0f-4c40-b755-673d82d76963 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:06.521381 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-27514cc3-ef0f-4c40-b755-673d82d76963 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:06.523745 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-27514cc3-ef0f-4c40-b755-673d82d76963 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:06.524243 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-27514cc3-ef0f-4c40-b755-673d82d76963 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:06.524683 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-27514cc3-ef0f-4c40-b755-673d82d76963 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:06.623685 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-27514cc3-ef0f-4c40-b755-673d82d76963 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:06.659417 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-27514cc3-ef0f-4c40-b755-673d82d76963 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:06.663048 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-27514cc3-ef0f-4c40-b755-673d82d76963 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:06.666365 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-27514cc3-ef0f-4c40-b755-673d82d76963 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1335 microversion: 2.54 time: 0.167898 Aug 22 17:23:06.666947 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 873/1741] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:06 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1335 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:07.695324 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e9999384-7586-43c5-ad9e-45d071adbbda tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:07.695861 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-e9999384-7586-43c5-ad9e-45d071adbbda tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:07.706332 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e9999384-7586-43c5-ad9e-45d071adbbda tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:07.706836 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e9999384-7586-43c5-ad9e-45d071adbbda tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:07.709024 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e9999384-7586-43c5-ad9e-45d071adbbda tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:07.718486 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e9999384-7586-43c5-ad9e-45d071adbbda tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:07.718967 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e9999384-7586-43c5-ad9e-45d071adbbda tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:07.719421 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e9999384-7586-43c5-ad9e-45d071adbbda tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:08.202710 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e9999384-7586-43c5-ad9e-45d071adbbda tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:08.211893 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e9999384-7586-43c5-ad9e-45d071adbbda tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:08.216349 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e9999384-7586-43c5-ad9e-45d071adbbda tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:08.217576 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e9999384-7586-43c5-ad9e-45d071adbbda tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1335 microversion: 2.54 time: 0.527861 Aug 22 17:23:08.219610 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 869/1742] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:07 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1335 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:09.248596 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ff1c4da6-08f5-4e97-866a-e9e8909e927b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:09.249891 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-ff1c4da6-08f5-4e97-866a-e9e8909e927b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:09.262017 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:23:09.264402 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ff1c4da6-08f5-4e97-866a-e9e8909e927b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:09.265862 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ff1c4da6-08f5-4e97-866a-e9e8909e927b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:09.267892 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ff1c4da6-08f5-4e97-866a-e9e8909e927b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:09.267892 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ff1c4da6-08f5-4e97-866a-e9e8909e927b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:09.268797 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ff1c4da6-08f5-4e97-866a-e9e8909e927b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:09.269610 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ff1c4da6-08f5-4e97-866a-e9e8909e927b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:09.485027 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ff1c4da6-08f5-4e97-866a-e9e8909e927b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:09.503937 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ff1c4da6-08f5-4e97-866a-e9e8909e927b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:09.505606 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ff1c4da6-08f5-4e97-866a-e9e8909e927b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:09.506976 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ff1c4da6-08f5-4e97-866a-e9e8909e927b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1356 microversion: 2.54 time: 0.264483 Aug 22 17:23:09.526450 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 874/1743] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:09 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1356 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:23:09.559527 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0e8a7bbf-6220-4157-8153-f1fc1a06dabc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Action: 'create', calling method: .version_select at 0x7f8009260310>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1029611689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXVEpZwbxQfuc3gAeDtFS6WwcYPOpg/nj0YiUXqWWoQWZtBg/vuQWkW/riEoqcd1KpkFIX1uPlTW9R7uvclNS2RVCYU+0ePPUZcJWa13nb15Zt/Ab12o9fr4mMUHRM/jQ=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:23:09.595096 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-0e8a7bbf-6220-4157-8153-f1fc1a06dabc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Getting quotas for project 51269acf039f4159b25d0c76703234b6. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:23:09.612272 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-0e8a7bbf-6220-4157-8153-f1fc1a06dabc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Getting quotas for user 906cb1e237b64a1482ae7136591cc3c8 and project 51269acf039f4159b25d0c76703234b6. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:23:09.778845 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0e8a7bbf-6220-4157-8153-f1fc1a06dabc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.224521 Aug 22 17:23:09.792171 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1029611689", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:23:09.794436 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 870/1744] 10.222.0.96 () {62 vars in 1200 bytes} [Mon Aug 22 17:23:09 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 241 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 22 17:23:09.795985 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:09.817174 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:09.817755 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:09.818211 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:09.819001 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:09.819465 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:09.825035 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:10.008644 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:23:10.009391 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:23:10.010041 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:23:10.010634 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:23:10.011880 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:23:10.551623 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:10.583947 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:10.584478 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:10.584933 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:10.600578 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:10.602582 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:10.608480 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:10.689109 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-799f60f3-0924-41cc-99f9-8de65b77dee9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "POST /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53/action" status: 202 len: 1139 microversion: 2.54 time: 0.898807 Aug 22 17:23:10.697394 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 875/1745] 10.222.0.96 () {62 vars in 1320 bytes} [Mon Aug 22 17:23:09 2022] POST /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53/action => generated 1139 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 22 17:23:10.724253 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3b6b6e9b-7552-4add-a6b6-32cda4dcc7fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:10.725466 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-3b6b6e9b-7552-4add-a6b6-32cda4dcc7fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:10.733342 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3b6b6e9b-7552-4add-a6b6-32cda4dcc7fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:10.734232 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3b6b6e9b-7552-4add-a6b6-32cda4dcc7fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:10.734925 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3b6b6e9b-7552-4add-a6b6-32cda4dcc7fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:10.735912 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3b6b6e9b-7552-4add-a6b6-32cda4dcc7fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:10.736690 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3b6b6e9b-7552-4add-a6b6-32cda4dcc7fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:10.737367 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-3b6b6e9b-7552-4add-a6b6-32cda4dcc7fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:10.907157 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-3b6b6e9b-7552-4add-a6b6-32cda4dcc7fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:10.920037 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-3b6b6e9b-7552-4add-a6b6-32cda4dcc7fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:10.920037 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-3b6b6e9b-7552-4add-a6b6-32cda4dcc7fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:10.920037 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3b6b6e9b-7552-4add-a6b6-32cda4dcc7fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.200476 Aug 22 17:23:10.920420 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 871/1746] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:10 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:11.948083 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-06a0fdcc-bf4a-42a1-b4b5-89ead99d87b9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:11.949491 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-06a0fdcc-bf4a-42a1-b4b5-89ead99d87b9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:11.964110 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-06a0fdcc-bf4a-42a1-b4b5-89ead99d87b9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:11.965528 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-06a0fdcc-bf4a-42a1-b4b5-89ead99d87b9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:11.966063 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-06a0fdcc-bf4a-42a1-b4b5-89ead99d87b9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:11.966854 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-06a0fdcc-bf4a-42a1-b4b5-89ead99d87b9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:11.967405 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-06a0fdcc-bf4a-42a1-b4b5-89ead99d87b9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:11.970289 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-06a0fdcc-bf4a-42a1-b4b5-89ead99d87b9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:12.363198 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-06a0fdcc-bf4a-42a1-b4b5-89ead99d87b9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:12.392493 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-06a0fdcc-bf4a-42a1-b4b5-89ead99d87b9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:12.396751 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-06a0fdcc-bf4a-42a1-b4b5-89ead99d87b9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:12.400268 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-06a0fdcc-bf4a-42a1-b4b5-89ead99d87b9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.460684 Aug 22 17:23:12.402709 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 872/1747] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:11 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:12.492229 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-13b3f371-6b2e-4f13-93b4-bfacb62ff928 tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-696163217", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:23:12.498612 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-13b3f371-6b2e-4f13-93b4-bfacb62ff928 tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] HTTP exception thrown: min_count must be <= max_count Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-13b3f371-6b2e-4f13-93b4-bfacb62ff928 tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] Request method failure captured: Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 183 Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7t_wMxxZeaoLV6DZrrdUflsdibkQHZ7EvM2XHZLuMq5yKUzB5feBW5daChxVR6oJxn38YZGZ05X_kc2iEmAR_ilLsajGVvIlk74HNz7WU61FQCxNiCt4H0ZDjKRnINhuK2apTPkCKhKW_mzE20KjjTWE23LTAeLLUGZecidu6MsXao Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: c997ecd6868246c2bced39bff2d809aa Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-726594062 Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c997ecd6868246c2bced39bff2d809aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_c997ecd6868246c2bced39bff2d809aa", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c997ecd6868246c2bced39bff2d809aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/c997ecd6868246c2bced39bff2d809aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-726594062 Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: c997ecd6868246c2bced39bff2d809aa Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-726594062 Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-MultipleCreateNegativeTestJSON-726594062-project Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 64e02ac28f26417da1e849b1069d770c Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-726594062-project Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-696163217", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: exception: min_count must be <= max_count Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-696163217', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 22 17:23:12.505415 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:12.514220 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-13b3f371-6b2e-4f13-93b4-bfacb62ff928 tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] Returning 400 to user: min_count must be <= max_count {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:23:12.514961 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-13b3f371-6b2e-4f13-93b4-bfacb62ff928 tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.576765 Aug 22 17:23:12.520037 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 876/1748] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:23:11 2022] POST /compute/v2.1/servers => generated 74 bytes in 582 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 22 17:23:12.835086 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1e2537bc-8ee8-46f3-a8dc-ad549af4bd7f tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-85206999", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "max_count": 0}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1e2537bc-8ee8-46f3-a8dc-ad549af4bd7f tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] Request method failure captured: Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 166 Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7t_wMxxZeaoLV6DZrrdUflsdibkQHZ7EvM2XHZLuMq5yKUzB5feBW5daChxVR6oJxn38YZGZ05X_kc2iEmAR_ilLsajGVvIlk74HNz7WU61FQCxNiCt4H0ZDjKRnINhuK2apTPkCKhKW_mzE20KjjTWE23LTAeLLUGZecidu6MsXao Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: c997ecd6868246c2bced39bff2d809aa Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-726594062 Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c997ecd6868246c2bced39bff2d809aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_c997ecd6868246c2bced39bff2d809aa", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c997ecd6868246c2bced39bff2d809aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/c997ecd6868246c2bced39bff2d809aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-726594062 Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: c997ecd6868246c2bced39bff2d809aa Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-726594062 Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-MultipleCreateNegativeTestJSON-726594062-project Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 64e02ac28f26417da1e849b1069d770c Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-726594062-project Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-85206999", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "max_count": 0}} Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-85206999', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'max_count': 0}}} Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 0 Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:23:12.849219 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:23:12.860587 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:23:12.860587 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:23:12.860587 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:23:12.860587 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:23:12.860587 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 22 17:23:12.860587 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:12.860587 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:12.860587 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:12.860587 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:12.860587 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:12.860587 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:12.860587 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:23:12.860587 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:23:12.860587 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 22 17:23:12.860587 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:12.860587 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1e2537bc-8ee8-46f3-a8dc-ad549af4bd7f tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:23:12.860587 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1e2537bc-8ee8-46f3-a8dc-ad549af4bd7f tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021398 Aug 22 17:23:12.860587 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 873/1749] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:23:12 2022] POST /compute/v2.1/servers => generated 130 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:23:13.142936 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fa775f37-c8ee-4dbd-b10a-9fd4c596de51 tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1685375382", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "max_count": 2.5}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fa775f37-c8ee-4dbd-b10a-9fd4c596de51 tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] Request method failure captured: Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 170 Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7t_wMxxZeaoLV6DZrrdUflsdibkQHZ7EvM2XHZLuMq5yKUzB5feBW5daChxVR6oJxn38YZGZ05X_kc2iEmAR_ilLsajGVvIlk74HNz7WU61FQCxNiCt4H0ZDjKRnINhuK2apTPkCKhKW_mzE20KjjTWE23LTAeLLUGZecidu6MsXao Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: c997ecd6868246c2bced39bff2d809aa Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-726594062 Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c997ecd6868246c2bced39bff2d809aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_c997ecd6868246c2bced39bff2d809aa", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c997ecd6868246c2bced39bff2d809aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/c997ecd6868246c2bced39bff2d809aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-726594062 Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: c997ecd6868246c2bced39bff2d809aa Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-726594062 Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-MultipleCreateNegativeTestJSON-726594062-project Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 64e02ac28f26417da1e849b1069d770c Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-726594062-project Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1685375382", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "max_count": 2.5}} Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1685375382', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'max_count': 2.5}}} Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 2.5 Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:23:13.150611 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:23:13.155597 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:23:13.155597 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:23:13.155597 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:23:13.155597 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:23:13.155597 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 22 17:23:13.155597 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.155597 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:13.155597 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.155597 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:13.155597 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:13.155597 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:13.155597 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:23:13.155597 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:23:13.155597 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 22 17:23:13.155597 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.158855 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fa775f37-c8ee-4dbd-b10a-9fd4c596de51 tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:23:13.164057 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fa775f37-c8ee-4dbd-b10a-9fd4c596de51 tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.021341 Aug 22 17:23:13.164057 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 874/1750] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:23:13 2022] POST /compute/v2.1/servers => generated 139 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:23:13.369391 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-115341d3-694e-4f68-b7dc-e386f146ebfd tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Action: 'create', calling method: .version_select at 0x7f8009a6e310>, body: {"keypair": {"name": "tempest-keypair-544922006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAjqEcCYFqHr6XBJJqLnUhPsGU2WQM80zwn56rg2WfHa8aYPzud3RqkRCwhtlEh95iF/JoLRURqHyExoLn40+BECxBjzyDgFsSOY1zYAR/xZV495w/L/MMFlA6OWZPSEA=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:23:13.419422 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-71c8ccf1-e6df-490c-b6e4-a821a41d72b4 tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1731257062", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "min_count": 0}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:23:13.425054 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-115341d3-694e-4f68-b7dc-e386f146ebfd tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Getting quotas for project ae69e693812e49ab8bc2ee3100268bce. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-71c8ccf1-e6df-490c-b6e4-a821a41d72b4 tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] Request method failure captured: Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 168 Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7t_wMxxZeaoLV6DZrrdUflsdibkQHZ7EvM2XHZLuMq5yKUzB5feBW5daChxVR6oJxn38YZGZ05X_kc2iEmAR_ilLsajGVvIlk74HNz7WU61FQCxNiCt4H0ZDjKRnINhuK2apTPkCKhKW_mzE20KjjTWE23LTAeLLUGZecidu6MsXao Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: c997ecd6868246c2bced39bff2d809aa Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-726594062 Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c997ecd6868246c2bced39bff2d809aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_c997ecd6868246c2bced39bff2d809aa", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c997ecd6868246c2bced39bff2d809aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/c997ecd6868246c2bced39bff2d809aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-726594062 Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: c997ecd6868246c2bced39bff2d809aa Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-726594062 Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-MultipleCreateNegativeTestJSON-726594062-project Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 64e02ac28f26417da1e849b1069d770c Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-726594062-project Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1731257062", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "min_count": 0}} Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1731257062', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'min_count': 0}}} Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi 0 Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:23:13.428738 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:23:13.435567 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:23:13.435567 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:23:13.435567 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:23:13.435567 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:23:13.435567 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 22 17:23:13.435567 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.435567 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:13.435567 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.435567 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:13.435567 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:13.435567 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:13.435567 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:23:13.435567 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:23:13.435567 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 22 17:23:13.435567 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.442673 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-71c8ccf1-e6df-490c-b6e4-a821a41d72b4 tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:23:13.445535 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-71c8ccf1-e6df-490c-b6e4-a821a41d72b4 tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.040295 Aug 22 17:23:13.446429 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-115341d3-694e-4f68-b7dc-e386f146ebfd tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Getting quotas for user e171587086bc4d938fe5fb146f8ac48e and project ae69e693812e49ab8bc2ee3100268bce. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:23:13.449775 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 875/1751] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:23:13 2022] POST /compute/v2.1/servers => generated 130 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:23:13.462806 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1993a9fd-6111-4fec-ac20-e5875abbbfd9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:13.470240 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-1993a9fd-6111-4fec-ac20-e5875abbbfd9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:13.483245 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1993a9fd-6111-4fec-ac20-e5875abbbfd9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:13.492574 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1993a9fd-6111-4fec-ac20-e5875abbbfd9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:13.493773 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1993a9fd-6111-4fec-ac20-e5875abbbfd9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:13.497134 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1993a9fd-6111-4fec-ac20-e5875abbbfd9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:13.501048 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1993a9fd-6111-4fec-ac20-e5875abbbfd9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:13.501048 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1993a9fd-6111-4fec-ac20-e5875abbbfd9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:13.617365 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-115341d3-694e-4f68-b7dc-e386f146ebfd tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.593749 Aug 22 17:23:13.617984 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 877/1752] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:23:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:23:13.729693 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f4653cbf-e529-4ce4-bbf4-64f9bf5b46da tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1891387520", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "min_count": 2.5}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f4653cbf-e529-4ce4-bbf4-64f9bf5b46da tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] Request method failure captured: Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 170 Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7t_wMxxZeaoLV6DZrrdUflsdibkQHZ7EvM2XHZLuMq5yKUzB5feBW5daChxVR6oJxn38YZGZ05X_kc2iEmAR_ilLsajGVvIlk74HNz7WU61FQCxNiCt4H0ZDjKRnINhuK2apTPkCKhKW_mzE20KjjTWE23LTAeLLUGZecidu6MsXao Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: c997ecd6868246c2bced39bff2d809aa Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-726594062 Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c997ecd6868246c2bced39bff2d809aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_c997ecd6868246c2bced39bff2d809aa", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/c997ecd6868246c2bced39bff2d809aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/c997ecd6868246c2bced39bff2d809aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-726594062 Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: c997ecd6868246c2bced39bff2d809aa Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-726594062 Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-MultipleCreateNegativeTestJSON-726594062-project Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 64e02ac28f26417da1e849b1069d770c Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-726594062-project Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1891387520", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "min_count": 2.5}} Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1891387520', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'min_count': 2.5}}} Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi 2.5 Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:23:13.734927 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:23:13.739006 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:23:13.739006 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:23:13.739006 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:23:13.739006 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:23:13.739006 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 22 17:23:13.739006 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.739006 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:13.739006 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.739006 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:13.739006 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:13.739006 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:13.739006 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:23:13.739006 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:23:13.739006 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 22 17:23:13.739006 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:13.743747 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f4653cbf-e529-4ce4-bbf4-64f9bf5b46da tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:23:13.744914 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f4653cbf-e529-4ce4-bbf4-64f9bf5b46da tempest-MultipleCreateNegativeTestJSON-726594062 tempest-MultipleCreateNegativeTestJSON-726594062-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.019830 Aug 22 17:23:13.756215 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 878/1753] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:23:13 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:23:13.769366 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1993a9fd-6111-4fec-ac20-e5875abbbfd9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:13.784389 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1993a9fd-6111-4fec-ac20-e5875abbbfd9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:13.794260 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1993a9fd-6111-4fec-ac20-e5875abbbfd9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:13.800672 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1993a9fd-6111-4fec-ac20-e5875abbbfd9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.348922 Aug 22 17:23:13.810091 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 876/1754] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:13 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:14.826041 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-86baad8d-e215-4f7e-879d-1816246ce2e8 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:14.827136 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-86baad8d-e215-4f7e-879d-1816246ce2e8 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:14.844588 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86baad8d-e215-4f7e-879d-1816246ce2e8 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:14.846470 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86baad8d-e215-4f7e-879d-1816246ce2e8 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:14.846932 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86baad8d-e215-4f7e-879d-1816246ce2e8 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:14.847681 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86baad8d-e215-4f7e-879d-1816246ce2e8 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:14.850828 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86baad8d-e215-4f7e-879d-1816246ce2e8 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:14.851843 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-86baad8d-e215-4f7e-879d-1816246ce2e8 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:15.055505 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-86baad8d-e215-4f7e-879d-1816246ce2e8 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:15.071831 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-86baad8d-e215-4f7e-879d-1816246ce2e8 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:15.074354 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-86baad8d-e215-4f7e-879d-1816246ce2e8 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:15.076854 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-86baad8d-e215-4f7e-879d-1816246ce2e8 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.256341 Aug 22 17:23:15.090293 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 879/1755] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:14 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:23:16.106076 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-dbf8efae-99ce-40b8-9af0-76a96109be75 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:16.114757 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-dbf8efae-99ce-40b8-9af0-76a96109be75 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:16.133421 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dbf8efae-99ce-40b8-9af0-76a96109be75 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:16.135230 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dbf8efae-99ce-40b8-9af0-76a96109be75 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:16.137653 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dbf8efae-99ce-40b8-9af0-76a96109be75 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:16.145695 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dbf8efae-99ce-40b8-9af0-76a96109be75 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:16.152890 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dbf8efae-99ce-40b8-9af0-76a96109be75 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:16.152890 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dbf8efae-99ce-40b8-9af0-76a96109be75 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:16.424143 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-dbf8efae-99ce-40b8-9af0-76a96109be75 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:16.461611 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-dbf8efae-99ce-40b8-9af0-76a96109be75 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:16.481487 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-dbf8efae-99ce-40b8-9af0-76a96109be75 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:16.489545 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-dbf8efae-99ce-40b8-9af0-76a96109be75 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.385079 Aug 22 17:23:16.494612 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 877/1756] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:16 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:17.516168 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-62f32f07-499a-4c7e-abb6-29f372e12108 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:17.517908 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-62f32f07-499a-4c7e-abb6-29f372e12108 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:17.523813 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-62f32f07-499a-4c7e-abb6-29f372e12108 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:17.524245 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-62f32f07-499a-4c7e-abb6-29f372e12108 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:17.524688 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-62f32f07-499a-4c7e-abb6-29f372e12108 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:17.543091 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-62f32f07-499a-4c7e-abb6-29f372e12108 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:17.543604 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-62f32f07-499a-4c7e-abb6-29f372e12108 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:17.544053 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-62f32f07-499a-4c7e-abb6-29f372e12108 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:17.776147 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-62f32f07-499a-4c7e-abb6-29f372e12108 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:17.791860 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-62f32f07-499a-4c7e-abb6-29f372e12108 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:17.802002 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-62f32f07-499a-4c7e-abb6-29f372e12108 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:17.803956 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-62f32f07-499a-4c7e-abb6-29f372e12108 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.292094 Aug 22 17:23:17.821504 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 880/1757] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:17 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:17.970491 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3e3377a6-097b-42cd-b1a9-238aa5a61722 tempest-ServerTagsTestJSON-1207311007 tempest-ServerTagsTestJSON-1207311007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1972688581", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "6961b32f-d2fd-48b3-a3e0-df06e8f10e78"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:23:17.985884 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:23:18.060618 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-3e3377a6-097b-42cd-b1a9-238aa5a61722 tempest-ServerTagsTestJSON-1207311007 tempest-ServerTagsTestJSON-1207311007-project] validate_networks() for [('6961b32f-d2fd-48b3-a3e0-df06e8f10e78', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-3e3377a6-097b-42cd-b1a9-238aa5a61722 tempest-ServerTagsTestJSON-1207311007 tempest-ServerTagsTestJSON-1207311007-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-13b04455-fab8-4a1b-ab2e-fc89cf330497) Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:23:18.475018 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:23:18.480197 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:23:18.480197 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:23:18.480197 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:23:18.480197 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:23:18.480197 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:23:18.480197 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:23:18.480197 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:23:18.480197 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:23:18.480197 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:23:18.480197 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:23:18.480197 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:23:18.480197 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:23:18.480197 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:23:18.480197 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:23:18.480197 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-13b04455-fab8-4a1b-ab2e-fc89cf330497) Aug 22 17:23:18.480197 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:18.487331 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-3e3377a6-097b-42cd-b1a9-238aa5a61722 tempest-ServerTagsTestJSON-1207311007 tempest-ServerTagsTestJSON-1207311007-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:18.487331 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3e3377a6-097b-42cd-b1a9-238aa5a61722 tempest-ServerTagsTestJSON-1207311007 tempest-ServerTagsTestJSON-1207311007-project] Request method failure captured: Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 204 Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7uFW9xAY7WC0faPC0NFoOBXN-Ubaoo633EyGCAwdWfgJDWc6r64Fs1YvxfB0fDF9X2z58-THUT1BiPrYCmyM021KHH5lH7yQminc0aFMPxISZZPenPmG-0ifKZKoO1w-SexgcipJmpr_wlQFpHPpaVUHTDQS38uhYjiw5-izrRwe4Y Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-Openstack-Nova-Api-Version: 2.26 Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 73ec6d0ab9c141108d184ffaaa883561 Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServerTagsTestJSON-1207311007 Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/73ec6d0ab9c141108d184ffaaa883561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_73ec6d0ab9c141108d184ffaaa883561", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/73ec6d0ab9c141108d184ffaaa883561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/73ec6d0ab9c141108d184ffaaa883561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServerTagsTestJSON-1207311007 Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 73ec6d0ab9c141108d184ffaaa883561 Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServerTagsTestJSON-1207311007 Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServerTagsTestJSON-1207311007-project Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: e921c2926f9c49229e095eb03d554a50 Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServerTagsTestJSON-1207311007-project Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ServerTagsTestJSON-server-1972688581", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "6961b32f-d2fd-48b3-a3e0-df06e8f10e78"}]}} Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ServerTagsTestJSON-server-1972688581', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '6961b32f-d2fd-48b3-a3e0-df06e8f10e78'}]}}} Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:23:18.495029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-13b04455-fab8-4a1b-ab2e-fc89cf330497) Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:23:18.500460 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:23:18.505053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:18.505053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:18.505053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:18.505053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:18.505053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:18.505053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:18.505053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:18.505053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:18.505053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:23:18.505053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:23:18.505053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:18.505053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:18.505053 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:18.508532 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3e3377a6-097b-42cd-b1a9-238aa5a61722 tempest-ServerTagsTestJSON-1207311007 tempest-ServerTagsTestJSON-1207311007-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:18.508532 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:23:18.511359 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3e3377a6-097b-42cd-b1a9-238aa5a61722 tempest-ServerTagsTestJSON-1207311007 tempest-ServerTagsTestJSON-1207311007-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.26 time: 0.794842 Aug 22 17:23:18.516523 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 878/1758] 10.222.0.96 () {62 vars in 1188 bytes} [Mon Aug 22 17:23:17 2022] POST /compute/v2.1/servers => generated 214 bytes in 799 msecs (HTTP/1.1 500) 9 headers in 393 bytes (2 switches on core 0) Aug 22 17:23:18.844777 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7cd0de84-3a25-4812-b6a0-528a9cb32f6c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:18.847367 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-7cd0de84-3a25-4812-b6a0-528a9cb32f6c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:18.868724 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7cd0de84-3a25-4812-b6a0-528a9cb32f6c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:18.869827 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7cd0de84-3a25-4812-b6a0-528a9cb32f6c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:18.870596 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7cd0de84-3a25-4812-b6a0-528a9cb32f6c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:18.872632 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7cd0de84-3a25-4812-b6a0-528a9cb32f6c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:18.875847 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7cd0de84-3a25-4812-b6a0-528a9cb32f6c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:18.877619 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7cd0de84-3a25-4812-b6a0-528a9cb32f6c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:19.117273 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-7cd0de84-3a25-4812-b6a0-528a9cb32f6c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:19.190643 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-7cd0de84-3a25-4812-b6a0-528a9cb32f6c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:19.200743 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-7cd0de84-3a25-4812-b6a0-528a9cb32f6c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:19.213219 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7cd0de84-3a25-4812-b6a0-528a9cb32f6c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.380744 Aug 22 17:23:19.216682 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 881/1759] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:18 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:20.258638 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=16 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:23:20.265190 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-18d393ed-b0f8-485b-930f-c9582b243391 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:20.265807 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-18d393ed-b0f8-485b-930f-c9582b243391 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:20.280094 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18d393ed-b0f8-485b-930f-c9582b243391 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:20.281247 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18d393ed-b0f8-485b-930f-c9582b243391 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:20.281877 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18d393ed-b0f8-485b-930f-c9582b243391 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:20.283535 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18d393ed-b0f8-485b-930f-c9582b243391 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:20.284151 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18d393ed-b0f8-485b-930f-c9582b243391 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:20.285004 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-18d393ed-b0f8-485b-930f-c9582b243391 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:20.399945 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-18d393ed-b0f8-485b-930f-c9582b243391 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:20.419665 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-18d393ed-b0f8-485b-930f-c9582b243391 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:20.421957 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-18d393ed-b0f8-485b-930f-c9582b243391 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:20.424300 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-18d393ed-b0f8-485b-930f-c9582b243391 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.166379 Aug 22 17:23:20.437142 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 879/1760] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:20 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:20.500951 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-27b234dc-b1fe-478c-8e11-30b824c0990c tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1117972279", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9720896f-9490-4d1a-b699-2c176fb4b050"}], "security_groups": [{"name": "tempest-securitygroup--815323840"}], "key_name": "tempest-keypair-544922006", "user_data": "}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:23:21.399998 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-27b234dc-b1fe-478c-8e11-30b824c0990c tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] validate_networks() for [('9720896f-9490-4d1a-b699-2c176fb4b050', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:23:21.448676 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b42203fa-d51b-4017-b6ec-0ca145cc74fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:21.449359 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b42203fa-d51b-4017-b6ec-0ca145cc74fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:21.463500 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b42203fa-d51b-4017-b6ec-0ca145cc74fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:21.471307 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b42203fa-d51b-4017-b6ec-0ca145cc74fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:21.471307 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b42203fa-d51b-4017-b6ec-0ca145cc74fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:21.471307 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b42203fa-d51b-4017-b6ec-0ca145cc74fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:21.472646 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b42203fa-d51b-4017-b6ec-0ca145cc74fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:21.473209 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b42203fa-d51b-4017-b6ec-0ca145cc74fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:21.688095 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b42203fa-d51b-4017-b6ec-0ca145cc74fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:21.701348 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b42203fa-d51b-4017-b6ec-0ca145cc74fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:21.702888 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b42203fa-d51b-4017-b6ec-0ca145cc74fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:21.713108 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b42203fa-d51b-4017-b6ec-0ca145cc74fa tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.267907 Aug 22 17:23:21.716865 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 880/1761] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:21 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:22.311575 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-27b234dc-b1fe-478c-8e11-30b824c0990c tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a08473f2-5ba0-4e33-9b83-0cfb2318c46b) Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:23:22.360514 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a08473f2-5ba0-4e33-9b83-0cfb2318c46b) Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-27b234dc-b1fe-478c-8e11-30b824c0990c tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-27b234dc-b1fe-478c-8e11-30b824c0990c tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Request method failure captured: Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 488 Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7uAk6m06fSD_XxA_T188N1Yo4KxQFmywStYP3pOFoVtqPupELykklFHOf2UImeq0dE3yh7TmdxNF_R4GDmAtBhJn6-uJ0872nVPrWiVoMpKdaWvp9VaE_khDWorUeLA2FkgVK1vMaF347eZsY5Mvp-_d260NxnZ0sJOp7R4Sb-38nk Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: ae69e693812e49ab8bc2ee3100268bce Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-AttachVolumeNegativeTest-271013766 Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ae69e693812e49ab8bc2ee3100268bce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_ae69e693812e49ab8bc2ee3100268bce", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ae69e693812e49ab8bc2ee3100268bce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/ae69e693812e49ab8bc2ee3100268bce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-AttachVolumeNegativeTest-271013766 Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: ae69e693812e49ab8bc2ee3100268bce Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-271013766 Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-AttachVolumeNegativeTest-271013766-project Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: e171587086bc4d938fe5fb146f8ac48e Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-AttachVolumeNegativeTest-271013766-project Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1117972279", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "9720896f-9490-4d1a-b699-2c176fb4b050"}], "security_groups": [{"name": "tempest-securitygroup--815323840"}], "key_name": "tempest-keypair-544922006", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:22.364639 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeNegativeTest-server-1117972279', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '9720896f-9490-4d1a-b699-2c176fb4b050'}], 'security_groups': [{'name': 'tempest-securitygroup--815323840'}], 'key_name': 'tempest-keypair-544922006', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:23:22.369130 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a08473f2-5ba0-4e33-9b83-0cfb2318c46b) Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-27b234dc-b1fe-478c-8e11-30b824c0990c tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-27b234dc-b1fe-478c-8e11-30b824c0990c tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.868665 Aug 22 17:23:22.377344 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 882/1762] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:23:20 2022] POST /compute/v2.1/servers => generated 214 bytes in 1873 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:23:22.380549 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e0fa0a08-bfd9-4236-8ddf-d70ac96dccac tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Calling method '.version_select at 0x7f80092a2ee0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:22.476983 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e0fa0a08-bfd9-4236-8ddf-d70ac96dccac tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-544922006" status: 202 len: 0 microversion: 2.1 time: 0.104637 Aug 22 17:23:22.484245 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 881/1763] 10.222.0.96 () {58 vars in 1218 bytes} [Mon Aug 22 17:23:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-544922006 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:23:22.743007 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7315d399-8cf9-4fa3-a1c2-4d8fc314f352 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:22.743814 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-7315d399-8cf9-4fa3-a1c2-4d8fc314f352 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:22.754426 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7315d399-8cf9-4fa3-a1c2-4d8fc314f352 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:22.754985 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7315d399-8cf9-4fa3-a1c2-4d8fc314f352 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:22.755435 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7315d399-8cf9-4fa3-a1c2-4d8fc314f352 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:22.756651 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7315d399-8cf9-4fa3-a1c2-4d8fc314f352 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:22.757398 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7315d399-8cf9-4fa3-a1c2-4d8fc314f352 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:22.757994 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7315d399-8cf9-4fa3-a1c2-4d8fc314f352 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:22.884541 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-7315d399-8cf9-4fa3-a1c2-4d8fc314f352 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:22.895699 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-7315d399-8cf9-4fa3-a1c2-4d8fc314f352 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:22.897264 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-7315d399-8cf9-4fa3-a1c2-4d8fc314f352 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:22.898659 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7315d399-8cf9-4fa3-a1c2-4d8fc314f352 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.160333 Aug 22 17:23:22.899238 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 883/1764] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:22 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:23.924278 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f20acbfd-c06f-40fc-b8da-122cea05bddc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:23.925174 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f20acbfd-c06f-40fc-b8da-122cea05bddc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:23.939262 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f20acbfd-c06f-40fc-b8da-122cea05bddc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:23.939954 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f20acbfd-c06f-40fc-b8da-122cea05bddc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:23.940510 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f20acbfd-c06f-40fc-b8da-122cea05bddc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:23.941743 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f20acbfd-c06f-40fc-b8da-122cea05bddc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:23.941882 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f20acbfd-c06f-40fc-b8da-122cea05bddc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:23.942380 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f20acbfd-c06f-40fc-b8da-122cea05bddc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:23.988922 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=57 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:23:24.115942 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f20acbfd-c06f-40fc-b8da-122cea05bddc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:24.130050 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f20acbfd-c06f-40fc-b8da-122cea05bddc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:24.132571 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f20acbfd-c06f-40fc-b8da-122cea05bddc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:24.137498 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f20acbfd-c06f-40fc-b8da-122cea05bddc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.216763 Aug 22 17:23:24.142009 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 882/1765] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:23 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:24.214911 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a7ebd874-f43b-4e46-a3a5-4829957fc6d6 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Action: 'create', calling method: .version_select at 0x7f8009a0c160>, body: {"keypair": {"name": "tempest-keypair-1177589004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJl/JYxxwRwKuy7SJ4Sd+dINC5czf1zxo6POmJEDFRryFU2uNFZX5LPDSYeo3lxeKoMmqhrY3MJJkMsWw6pSHKWcR0pf0ajZiWwSNecd1B3ZKITQmKrF8NTi0pQhnfQiHA=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:23:24.227316 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:23:24.263493 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-a7ebd874-f43b-4e46-a3a5-4829957fc6d6 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Getting quotas for project ae69e693812e49ab8bc2ee3100268bce. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:23:24.273578 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-a7ebd874-f43b-4e46-a3a5-4829957fc6d6 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Getting quotas for user e171587086bc4d938fe5fb146f8ac48e and project ae69e693812e49ab8bc2ee3100268bce. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:23:24.385671 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a7ebd874-f43b-4e46-a3a5-4829957fc6d6 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.174577 Aug 22 17:23:24.387216 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 884/1766] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:23:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:23:25.160367 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a7df3950-1975-4f08-8142-891ecd732c69 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:25.160983 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a7df3950-1975-4f08-8142-891ecd732c69 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:25.171122 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a7df3950-1975-4f08-8142-891ecd732c69 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:25.173774 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a7df3950-1975-4f08-8142-891ecd732c69 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:25.174224 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a7df3950-1975-4f08-8142-891ecd732c69 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:25.174958 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a7df3950-1975-4f08-8142-891ecd732c69 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:25.177129 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a7df3950-1975-4f08-8142-891ecd732c69 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:25.177641 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a7df3950-1975-4f08-8142-891ecd732c69 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:25.783765 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a7df3950-1975-4f08-8142-891ecd732c69 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:25.793890 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a7df3950-1975-4f08-8142-891ecd732c69 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:25.795415 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a7df3950-1975-4f08-8142-891ecd732c69 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:25.802803 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a7df3950-1975-4f08-8142-891ecd732c69 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.640774 Aug 22 17:23:25.805278 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 883/1767] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:25 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:26.831691 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-88de801f-efdb-419a-aff0-48a0df928f97 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:26.832300 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-88de801f-efdb-419a-aff0-48a0df928f97 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:26.844423 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-88de801f-efdb-419a-aff0-48a0df928f97 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:26.844927 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-88de801f-efdb-419a-aff0-48a0df928f97 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:26.847159 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-88de801f-efdb-419a-aff0-48a0df928f97 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:26.848163 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-88de801f-efdb-419a-aff0-48a0df928f97 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:26.850560 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-88de801f-efdb-419a-aff0-48a0df928f97 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:26.851253 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-88de801f-efdb-419a-aff0-48a0df928f97 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:27.035007 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-88de801f-efdb-419a-aff0-48a0df928f97 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:27.047951 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-88de801f-efdb-419a-aff0-48a0df928f97 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:27.049563 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-88de801f-efdb-419a-aff0-48a0df928f97 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:27.050790 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-88de801f-efdb-419a-aff0-48a0df928f97 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.223952 Aug 22 17:23:27.051366 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 885/1768] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:26 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:28.075489 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2b4c36e8-06cd-4a58-b158-6b626e25742e tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:28.076878 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-2b4c36e8-06cd-4a58-b158-6b626e25742e tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:28.084308 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2b4c36e8-06cd-4a58-b158-6b626e25742e tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:28.085213 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2b4c36e8-06cd-4a58-b158-6b626e25742e tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:28.091183 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2b4c36e8-06cd-4a58-b158-6b626e25742e tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:28.091183 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2b4c36e8-06cd-4a58-b158-6b626e25742e tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:28.091183 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2b4c36e8-06cd-4a58-b158-6b626e25742e tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:28.091183 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2b4c36e8-06cd-4a58-b158-6b626e25742e tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:28.230253 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-2b4c36e8-06cd-4a58-b158-6b626e25742e tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:28.251620 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-2b4c36e8-06cd-4a58-b158-6b626e25742e tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:28.253937 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-2b4c36e8-06cd-4a58-b158-6b626e25742e tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:28.260530 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2b4c36e8-06cd-4a58-b158-6b626e25742e tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.189550 Aug 22 17:23:28.262918 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 884/1769] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:28 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:29.289404 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e5b94787-8c2b-4c72-ad42-51c73109cf70 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:29.290630 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e5b94787-8c2b-4c72-ad42-51c73109cf70 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:29.305791 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5b94787-8c2b-4c72-ad42-51c73109cf70 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:29.306632 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5b94787-8c2b-4c72-ad42-51c73109cf70 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:29.307151 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5b94787-8c2b-4c72-ad42-51c73109cf70 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:29.309655 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5b94787-8c2b-4c72-ad42-51c73109cf70 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:29.310834 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5b94787-8c2b-4c72-ad42-51c73109cf70 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:29.311927 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e5b94787-8c2b-4c72-ad42-51c73109cf70 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:29.422269 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e5b94787-8c2b-4c72-ad42-51c73109cf70 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:29.440014 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e5b94787-8c2b-4c72-ad42-51c73109cf70 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:29.441930 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e5b94787-8c2b-4c72-ad42-51c73109cf70 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:29.443373 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e5b94787-8c2b-4c72-ad42-51c73109cf70 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.160838 Aug 22 17:23:29.444061 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 886/1770] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:29 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:30.481191 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6a40a438-39bb-4710-91bc-55f42728d26b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:30.486040 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-6a40a438-39bb-4710-91bc-55f42728d26b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:30.513409 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2b072e73-1e98-4e8e-9d4d-55215dd52ad9 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1128714544", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9720896f-9490-4d1a-b699-2c176fb4b050"}], "security_groups": [{"name": "tempest-securitygroup--1913905755"}], "key_name": "tempest-keypair-1177589004", "user_data": "}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:23:30.515363 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6a40a438-39bb-4710-91bc-55f42728d26b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:30.516552 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6a40a438-39bb-4710-91bc-55f42728d26b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:30.517214 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6a40a438-39bb-4710-91bc-55f42728d26b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:30.520483 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6a40a438-39bb-4710-91bc-55f42728d26b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:30.521207 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6a40a438-39bb-4710-91bc-55f42728d26b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:30.541010 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6a40a438-39bb-4710-91bc-55f42728d26b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:30.726672 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6a40a438-39bb-4710-91bc-55f42728d26b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:30.740867 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6a40a438-39bb-4710-91bc-55f42728d26b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:30.752871 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6a40a438-39bb-4710-91bc-55f42728d26b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:30.754376 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6a40a438-39bb-4710-91bc-55f42728d26b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.278495 Aug 22 17:23:30.774136 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 885/1771] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:30 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:30.880923 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-2b072e73-1e98-4e8e-9d4d-55215dd52ad9 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] validate_networks() for [('9720896f-9490-4d1a-b699-2c176fb4b050', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-2b072e73-1e98-4e8e-9d4d-55215dd52ad9 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-95cad5e4-08d8-44a5-b43c-458d50a9bcfe) Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:23:31.525758 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-95cad5e4-08d8-44a5-b43c-458d50a9bcfe) Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-2b072e73-1e98-4e8e-9d4d-55215dd52ad9 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2b072e73-1e98-4e8e-9d4d-55215dd52ad9 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Request method failure captured: Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 490 Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7uAk6m06fSD_XxA_T188N1Yo4KxQFmywStYP3pOFoVtqPupELykklFHOf2UImeq0dE3yh7TmdxNF_R4GDmAtBhJn6-uJ0872nVPrWiVoMpKdaWvp9VaE_khDWorUeLA2FkgVK1vMaF347eZsY5Mvp-_d260NxnZ0sJOp7R4Sb-38nk Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: ae69e693812e49ab8bc2ee3100268bce Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-AttachVolumeNegativeTest-271013766 Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ae69e693812e49ab8bc2ee3100268bce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_ae69e693812e49ab8bc2ee3100268bce", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ae69e693812e49ab8bc2ee3100268bce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/ae69e693812e49ab8bc2ee3100268bce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-AttachVolumeNegativeTest-271013766 Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: ae69e693812e49ab8bc2ee3100268bce Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-271013766 Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-AttachVolumeNegativeTest-271013766-project Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: e171587086bc4d938fe5fb146f8ac48e Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-AttachVolumeNegativeTest-271013766-project Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1128714544", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "9720896f-9490-4d1a-b699-2c176fb4b050"}], "security_groups": [{"name": "tempest-securitygroup--1913905755"}], "key_name": "tempest-keypair-1177589004", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:31.531048 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeNegativeTest-server-1128714544', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '9720896f-9490-4d1a-b699-2c176fb4b050'}], 'security_groups': [{'name': 'tempest-securitygroup--1913905755'}], 'key_name': 'tempest-keypair-1177589004', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:23:31.536143 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-95cad5e4-08d8-44a5-b43c-458d50a9bcfe) Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2b072e73-1e98-4e8e-9d4d-55215dd52ad9 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2b072e73-1e98-4e8e-9d4d-55215dd52ad9 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.024181 Aug 22 17:23:31.545450 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 887/1772] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:23:30 2022] POST /compute/v2.1/servers => generated 214 bytes in 1033 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:23:31.549157 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-dc25fb48-6e50-482f-b9f6-1a6d1af95946 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Calling method '.version_select at 0x7f80096e0280>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:31.715648 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-dc25fb48-6e50-482f-b9f6-1a6d1af95946 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1177589004" status: 202 len: 0 microversion: 2.1 time: 0.179842 Aug 22 17:23:31.720094 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 886/1773] 10.222.0.96 () {58 vars in 1221 bytes} [Mon Aug 22 17:23:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1177589004 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:23:31.792391 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4d50db57-d262-4bed-a6cc-73e90dbd17bc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:31.793183 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-4d50db57-d262-4bed-a6cc-73e90dbd17bc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:31.822938 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4d50db57-d262-4bed-a6cc-73e90dbd17bc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:31.826025 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4d50db57-d262-4bed-a6cc-73e90dbd17bc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:31.826025 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4d50db57-d262-4bed-a6cc-73e90dbd17bc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:31.830115 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4d50db57-d262-4bed-a6cc-73e90dbd17bc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:31.832018 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4d50db57-d262-4bed-a6cc-73e90dbd17bc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:31.833434 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4d50db57-d262-4bed-a6cc-73e90dbd17bc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:31.852686 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:23:32.017939 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-4d50db57-d262-4bed-a6cc-73e90dbd17bc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:32.031739 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-4d50db57-d262-4bed-a6cc-73e90dbd17bc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:32.040316 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-4d50db57-d262-4bed-a6cc-73e90dbd17bc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:32.047409 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4d50db57-d262-4bed-a6cc-73e90dbd17bc tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.266303 Aug 22 17:23:32.049057 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 888/1774] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:31 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:33.084357 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f23b8772-8dd8-4ca7-94d7-051b8fbdcdf1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:33.085843 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f23b8772-8dd8-4ca7-94d7-051b8fbdcdf1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:33.102676 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f23b8772-8dd8-4ca7-94d7-051b8fbdcdf1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:33.103762 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f23b8772-8dd8-4ca7-94d7-051b8fbdcdf1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:33.104553 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f23b8772-8dd8-4ca7-94d7-051b8fbdcdf1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:33.105877 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f23b8772-8dd8-4ca7-94d7-051b8fbdcdf1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:33.106516 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f23b8772-8dd8-4ca7-94d7-051b8fbdcdf1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:33.107236 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f23b8772-8dd8-4ca7-94d7-051b8fbdcdf1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:33.212739 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f23b8772-8dd8-4ca7-94d7-051b8fbdcdf1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:33.227904 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f23b8772-8dd8-4ca7-94d7-051b8fbdcdf1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:33.234468 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f23b8772-8dd8-4ca7-94d7-051b8fbdcdf1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:33.237746 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f23b8772-8dd8-4ca7-94d7-051b8fbdcdf1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.157929 Aug 22 17:23:33.239284 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 887/1775] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:33 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:34.266772 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c8074b9b-00ad-4d02-8c31-857e94963b21 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:34.267410 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-c8074b9b-00ad-4d02-8c31-857e94963b21 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:34.285926 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c8074b9b-00ad-4d02-8c31-857e94963b21 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:34.285926 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c8074b9b-00ad-4d02-8c31-857e94963b21 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:34.288644 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c8074b9b-00ad-4d02-8c31-857e94963b21 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:34.290493 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c8074b9b-00ad-4d02-8c31-857e94963b21 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:34.291009 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c8074b9b-00ad-4d02-8c31-857e94963b21 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:34.291646 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c8074b9b-00ad-4d02-8c31-857e94963b21 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:34.509263 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c8074b9b-00ad-4d02-8c31-857e94963b21 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:34.537019 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c8074b9b-00ad-4d02-8c31-857e94963b21 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:34.544070 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c8074b9b-00ad-4d02-8c31-857e94963b21 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:34.546326 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c8074b9b-00ad-4d02-8c31-857e94963b21 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.283678 Aug 22 17:23:34.548673 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 888/1776] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:34 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:34.582315 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-663b6a67-5f89-4116-b90f-0621818144c3 tempest-ServerMetadataNegativeTestJSON-930739158 tempest-ServerMetadataNegativeTestJSON-930739158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2105524603", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "fdf2a245-7f03-49c9-88bc-03aae0acd5f9"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:23:34.687634 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-663b6a67-5f89-4116-b90f-0621818144c3 tempest-ServerMetadataNegativeTestJSON-930739158 tempest-ServerMetadataNegativeTestJSON-930739158-project] validate_networks() for [('fdf2a245-7f03-49c9-88bc-03aae0acd5f9', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:23:35.127055 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8b0d4218-4869-474a-8ed5-b180d7707f54 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Action: 'create', calling method: .version_select at 0x7f8009260550>, body: {"keypair": {"name": "tempest-keypair-823923299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4AXgS6WQN+ts2rULMQ9ueJvpdnfc4+OOrnRodnmQqe/DcF9HLJ3G3wEt8PxjosGRwSnEdt6pZvjPiJDUbouekGd5kXjO7gF2sz2N/6U8yeU5y2iV4d/SdD3KgnazVTsw=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:23:35.141736 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-8b0d4218-4869-474a-8ed5-b180d7707f54 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Getting quotas for project ae69e693812e49ab8bc2ee3100268bce. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:23:35.149260 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-8b0d4218-4869-474a-8ed5-b180d7707f54 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Getting quotas for user e171587086bc4d938fe5fb146f8ac48e and project ae69e693812e49ab8bc2ee3100268bce. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:23:35.265236 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8b0d4218-4869-474a-8ed5-b180d7707f54 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.141984 Aug 22 17:23:35.265236 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 889/1777] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:23:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-663b6a67-5f89-4116-b90f-0621818144c3 tempest-ServerMetadataNegativeTestJSON-930739158 tempest-ServerMetadataNegativeTestJSON-930739158-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a61747c4-6e94-41ae-8385-17e1cd719f36) Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:23:35.402623 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a61747c4-6e94-41ae-8385-17e1cd719f36) Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-663b6a67-5f89-4116-b90f-0621818144c3 tempest-ServerMetadataNegativeTestJSON-930739158 tempest-ServerMetadataNegativeTestJSON-930739158-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-663b6a67-5f89-4116-b90f-0621818144c3 tempest-ServerMetadataNegativeTestJSON-930739158 tempest-ServerMetadataNegativeTestJSON-930739158-project] Request method failure captured: Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 232 Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7uVNX3DfYCohP7vJd78p6E9_AjXc8tqNW9HJjriiCesbBUEFJbQ_cDmWsfDB0kRA3OfdXN8P1XwKo3zUSKyRW9gccsm6kz3sayyn6EdaN6CAjuatD6a3_0x-Kdy0ueT3cbcaOoB--RgsgL6NOFnK9NkvneY7KT8xf4SD3iOwBbnyNI Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 7e1964c1cc1a46dc9868985851c535d0 Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-930739158 Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7e1964c1cc1a46dc9868985851c535d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7e1964c1cc1a46dc9868985851c535d0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7e1964c1cc1a46dc9868985851c535d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7e1964c1cc1a46dc9868985851c535d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-930739158 Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 7e1964c1cc1a46dc9868985851c535d0 Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-930739158 Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServerMetadataNegativeTestJSON-930739158-project Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: fb5c115729da49c0a4e3e96d1426ab6b Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-930739158-project Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2105524603", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "fdf2a245-7f03-49c9-88bc-03aae0acd5f9"}]}} Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:35.412431 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2105524603', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'metadata': {}, 'networks': [{'uuid': 'fdf2a245-7f03-49c9-88bc-03aae0acd5f9'}]}}} Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:23:35.420651 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a61747c4-6e94-41ae-8385-17e1cd719f36) Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-663b6a67-5f89-4116-b90f-0621818144c3 tempest-ServerMetadataNegativeTestJSON-930739158 tempest-ServerMetadataNegativeTestJSON-930739158-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-663b6a67-5f89-4116-b90f-0621818144c3 tempest-ServerMetadataNegativeTestJSON-930739158 tempest-ServerMetadataNegativeTestJSON-930739158-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.364049 Aug 22 17:23:35.435061 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 889/1778] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:23:34 2022] POST /compute/v2.1/servers => generated 214 bytes in 1368 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:23:35.577301 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a7f5b563-3c90-43f2-90b3-d164a49a15c9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:35.578234 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a7f5b563-3c90-43f2-90b3-d164a49a15c9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:35.595869 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a7f5b563-3c90-43f2-90b3-d164a49a15c9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:35.596469 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a7f5b563-3c90-43f2-90b3-d164a49a15c9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:35.597481 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a7f5b563-3c90-43f2-90b3-d164a49a15c9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:35.598636 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a7f5b563-3c90-43f2-90b3-d164a49a15c9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:35.602574 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a7f5b563-3c90-43f2-90b3-d164a49a15c9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:35.603136 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a7f5b563-3c90-43f2-90b3-d164a49a15c9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:35.714643 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a7f5b563-3c90-43f2-90b3-d164a49a15c9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:35.726639 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a7f5b563-3c90-43f2-90b3-d164a49a15c9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:35.726639 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a7f5b563-3c90-43f2-90b3-d164a49a15c9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:35.733550 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a7f5b563-3c90-43f2-90b3-d164a49a15c9 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.162286 Aug 22 17:23:35.734273 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 890/1779] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:35 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:36.760916 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-efe1440e-f283-41db-a783-ac70939c8473 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:36.762887 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-efe1440e-f283-41db-a783-ac70939c8473 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:36.779756 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-efe1440e-f283-41db-a783-ac70939c8473 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:36.789072 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-efe1440e-f283-41db-a783-ac70939c8473 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:36.789072 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-efe1440e-f283-41db-a783-ac70939c8473 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:36.789072 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-efe1440e-f283-41db-a783-ac70939c8473 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:36.789072 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-efe1440e-f283-41db-a783-ac70939c8473 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:36.789072 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-efe1440e-f283-41db-a783-ac70939c8473 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:36.849408 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:23:37.080820 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-efe1440e-f283-41db-a783-ac70939c8473 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:37.094327 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-efe1440e-f283-41db-a783-ac70939c8473 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:37.098964 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-efe1440e-f283-41db-a783-ac70939c8473 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:37.103110 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-efe1440e-f283-41db-a783-ac70939c8473 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.347970 Aug 22 17:23:37.108165 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 890/1780] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:36 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:38.129449 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9b3c1699-9591-4cfe-b1b6-d39e0c613437 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:38.130756 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9b3c1699-9591-4cfe-b1b6-d39e0c613437 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:38.142855 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b3c1699-9591-4cfe-b1b6-d39e0c613437 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:38.143672 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b3c1699-9591-4cfe-b1b6-d39e0c613437 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:38.144284 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b3c1699-9591-4cfe-b1b6-d39e0c613437 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:38.147091 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b3c1699-9591-4cfe-b1b6-d39e0c613437 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:38.149350 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b3c1699-9591-4cfe-b1b6-d39e0c613437 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:38.149350 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b3c1699-9591-4cfe-b1b6-d39e0c613437 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:38.415013 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9b3c1699-9591-4cfe-b1b6-d39e0c613437 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:38.434864 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9b3c1699-9591-4cfe-b1b6-d39e0c613437 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:38.436782 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9b3c1699-9591-4cfe-b1b6-d39e0c613437 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:38.438142 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9b3c1699-9591-4cfe-b1b6-d39e0c613437 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.313430 Aug 22 17:23:38.438723 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 891/1781] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:38 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:39.467188 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a4da619c-ea58-4bb2-8c8c-be94b6805ef3 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:39.467807 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-a4da619c-ea58-4bb2-8c8c-be94b6805ef3 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:39.481913 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a4da619c-ea58-4bb2-8c8c-be94b6805ef3 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:39.483907 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a4da619c-ea58-4bb2-8c8c-be94b6805ef3 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:39.484646 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a4da619c-ea58-4bb2-8c8c-be94b6805ef3 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:39.488079 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a4da619c-ea58-4bb2-8c8c-be94b6805ef3 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:39.488823 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a4da619c-ea58-4bb2-8c8c-be94b6805ef3 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:39.489470 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a4da619c-ea58-4bb2-8c8c-be94b6805ef3 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:39.667723 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a4da619c-ea58-4bb2-8c8c-be94b6805ef3 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:39.679353 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a4da619c-ea58-4bb2-8c8c-be94b6805ef3 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:39.688343 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a4da619c-ea58-4bb2-8c8c-be94b6805ef3 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:39.690399 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a4da619c-ea58-4bb2-8c8c-be94b6805ef3 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.231020 Aug 22 17:23:39.692404 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 891/1782] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:39 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:40.722089 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1a5a704c-a2f3-4120-a603-7ba873184bac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:40.722764 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-1a5a704c-a2f3-4120-a603-7ba873184bac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:40.737775 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1a5a704c-a2f3-4120-a603-7ba873184bac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:40.740215 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1a5a704c-a2f3-4120-a603-7ba873184bac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:40.740215 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1a5a704c-a2f3-4120-a603-7ba873184bac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:40.740854 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1a5a704c-a2f3-4120-a603-7ba873184bac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:40.741421 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1a5a704c-a2f3-4120-a603-7ba873184bac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:40.743683 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1a5a704c-a2f3-4120-a603-7ba873184bac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:41.031081 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1a5a704c-a2f3-4120-a603-7ba873184bac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:41.047417 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1a5a704c-a2f3-4120-a603-7ba873184bac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:41.059510 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1a5a704c-a2f3-4120-a603-7ba873184bac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:41.065183 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1a5a704c-a2f3-4120-a603-7ba873184bac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.348921 Aug 22 17:23:41.090324 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 892/1783] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:40 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:42.103717 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-00178935-c77c-4a4f-8ce6-854b6b44fdaf tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:42.104326 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-00178935-c77c-4a4f-8ce6-854b6b44fdaf tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:42.150578 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-00178935-c77c-4a4f-8ce6-854b6b44fdaf tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:42.152130 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-00178935-c77c-4a4f-8ce6-854b6b44fdaf tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:42.153828 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-00178935-c77c-4a4f-8ce6-854b6b44fdaf tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:42.159013 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-00178935-c77c-4a4f-8ce6-854b6b44fdaf tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:42.160402 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-00178935-c77c-4a4f-8ce6-854b6b44fdaf tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:42.161578 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-00178935-c77c-4a4f-8ce6-854b6b44fdaf tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:42.320144 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-00178935-c77c-4a4f-8ce6-854b6b44fdaf tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:42.333209 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-00178935-c77c-4a4f-8ce6-854b6b44fdaf tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:42.339006 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-00178935-c77c-4a4f-8ce6-854b6b44fdaf tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:42.345217 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-00178935-c77c-4a4f-8ce6-854b6b44fdaf tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.247472 Aug 22 17:23:42.346842 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 892/1784] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:42 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:43.368008 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a70812ef-eb12-401f-8ee9-efcf4ab5f294 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:43.372296 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a70812ef-eb12-401f-8ee9-efcf4ab5f294 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:43.385829 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a70812ef-eb12-401f-8ee9-efcf4ab5f294 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:43.386322 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a70812ef-eb12-401f-8ee9-efcf4ab5f294 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:43.386791 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a70812ef-eb12-401f-8ee9-efcf4ab5f294 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:43.387514 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a70812ef-eb12-401f-8ee9-efcf4ab5f294 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:43.387973 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a70812ef-eb12-401f-8ee9-efcf4ab5f294 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:43.388395 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a70812ef-eb12-401f-8ee9-efcf4ab5f294 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:43.854918 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a70812ef-eb12-401f-8ee9-efcf4ab5f294 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:43.863723 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a70812ef-eb12-401f-8ee9-efcf4ab5f294 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:43.865734 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a70812ef-eb12-401f-8ee9-efcf4ab5f294 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:43.867253 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a70812ef-eb12-401f-8ee9-efcf4ab5f294 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1408 microversion: 2.54 time: 0.503160 Aug 22 17:23:43.884538 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 893/1785] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:43 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1408 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:44.283459 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-57f59817-bc65-47b0-8511-93720b5fb152 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-520994150", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9720896f-9490-4d1a-b699-2c176fb4b050"}], "security_groups": [{"name": "tempest-securitygroup--911452493"}], "key_name": "tempest-keypair-823923299", "user_data": "}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:23:44.892413 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0bc42ca6-b011-4a4c-86d9-c424f7c791f1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:44.893128 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0bc42ca6-b011-4a4c-86d9-c424f7c791f1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:44.903928 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0bc42ca6-b011-4a4c-86d9-c424f7c791f1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:44.905884 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0bc42ca6-b011-4a4c-86d9-c424f7c791f1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:44.906693 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0bc42ca6-b011-4a4c-86d9-c424f7c791f1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:44.910043 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0bc42ca6-b011-4a4c-86d9-c424f7c791f1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:44.910749 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0bc42ca6-b011-4a4c-86d9-c424f7c791f1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:44.911358 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0bc42ca6-b011-4a4c-86d9-c424f7c791f1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:44.911553 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-57f59817-bc65-47b0-8511-93720b5fb152 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] validate_networks() for [('9720896f-9490-4d1a-b699-2c176fb4b050', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:23:45.054997 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0bc42ca6-b011-4a4c-86d9-c424f7c791f1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:45.067735 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0bc42ca6-b011-4a4c-86d9-c424f7c791f1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:45.074008 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0bc42ca6-b011-4a4c-86d9-c424f7c791f1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:45.079862 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0bc42ca6-b011-4a4c-86d9-c424f7c791f1 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1414 microversion: 2.54 time: 0.191926 Aug 22 17:23:45.084142 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 894/1786] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:44 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1414 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-57f59817-bc65-47b0-8511-93720b5fb152 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9aefd7b3-da2b-41db-b6fe-1aa19b411506) Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:23:45.681199 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9aefd7b3-da2b-41db-b6fe-1aa19b411506) Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-57f59817-bc65-47b0-8511-93720b5fb152 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-57f59817-bc65-47b0-8511-93720b5fb152 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Request method failure captured: Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 487 Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7uAk6m06fSD_XxA_T188N1Yo4KxQFmywStYP3pOFoVtqPupELykklFHOf2UImeq0dE3yh7TmdxNF_R4GDmAtBhJn6-uJ0872nVPrWiVoMpKdaWvp9VaE_khDWorUeLA2FkgVK1vMaF347eZsY5Mvp-_d260NxnZ0sJOp7R4Sb-38nk Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: ae69e693812e49ab8bc2ee3100268bce Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-AttachVolumeNegativeTest-271013766 Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ae69e693812e49ab8bc2ee3100268bce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_ae69e693812e49ab8bc2ee3100268bce", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ae69e693812e49ab8bc2ee3100268bce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/ae69e693812e49ab8bc2ee3100268bce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-AttachVolumeNegativeTest-271013766 Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: ae69e693812e49ab8bc2ee3100268bce Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-271013766 Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-AttachVolumeNegativeTest-271013766-project Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: e171587086bc4d938fe5fb146f8ac48e Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-AttachVolumeNegativeTest-271013766-project Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-520994150", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "9720896f-9490-4d1a-b699-2c176fb4b050"}], "security_groups": [{"name": "tempest-securitygroup--911452493"}], "key_name": "tempest-keypair-823923299", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:45.692652 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeNegativeTest-server-520994150', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '9720896f-9490-4d1a-b699-2c176fb4b050'}], 'security_groups': [{'name': 'tempest-securitygroup--911452493'}], 'key_name': 'tempest-keypair-823923299', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:23:45.700928 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9aefd7b3-da2b-41db-b6fe-1aa19b411506) Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-57f59817-bc65-47b0-8511-93720b5fb152 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-57f59817-bc65-47b0-8511-93720b5fb152 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.408144 Aug 22 17:23:45.712402 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 893/1787] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:23:44 2022] POST /compute/v2.1/servers => generated 214 bytes in 1409 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:23:45.720573 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-433705cb-4599-4355-a2fb-b60711fb3bf3 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] Calling method '.version_select at 0x7f800924bc10>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:45.720573 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:23:45.835286 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-433705cb-4599-4355-a2fb-b60711fb3bf3 tempest-AttachVolumeNegativeTest-271013766 tempest-AttachVolumeNegativeTest-271013766-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-823923299" status: 202 len: 0 microversion: 2.1 time: 0.143131 Aug 22 17:23:45.836037 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 895/1788] 10.222.0.96 () {58 vars in 1218 bytes} [Mon Aug 22 17:23:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-823923299 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:23:46.113583 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1f6deae4-1549-4dc6-a57e-2e9c0cd8e742 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:46.114503 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-1f6deae4-1549-4dc6-a57e-2e9c0cd8e742 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:46.121857 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1f6deae4-1549-4dc6-a57e-2e9c0cd8e742 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:46.122364 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1f6deae4-1549-4dc6-a57e-2e9c0cd8e742 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:46.122873 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1f6deae4-1549-4dc6-a57e-2e9c0cd8e742 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:46.123615 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1f6deae4-1549-4dc6-a57e-2e9c0cd8e742 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:46.124096 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1f6deae4-1549-4dc6-a57e-2e9c0cd8e742 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:46.124681 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1f6deae4-1549-4dc6-a57e-2e9c0cd8e742 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:46.212162 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-1f6deae4-1549-4dc6-a57e-2e9c0cd8e742 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:46.233559 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-1f6deae4-1549-4dc6-a57e-2e9c0cd8e742 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:46.235285 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-1f6deae4-1549-4dc6-a57e-2e9c0cd8e742 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:46.236553 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1f6deae4-1549-4dc6-a57e-2e9c0cd8e742 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1414 microversion: 2.54 time: 0.127249 Aug 22 17:23:46.237194 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 894/1789] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:46 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1414 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:47.261923 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ac33617c-dcc1-4a0c-a65a-0b88d535179a tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:47.262551 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ac33617c-dcc1-4a0c-a65a-0b88d535179a tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:47.273302 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ac33617c-dcc1-4a0c-a65a-0b88d535179a tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:47.273302 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ac33617c-dcc1-4a0c-a65a-0b88d535179a tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:47.273302 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ac33617c-dcc1-4a0c-a65a-0b88d535179a tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:47.273749 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ac33617c-dcc1-4a0c-a65a-0b88d535179a tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:47.274204 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ac33617c-dcc1-4a0c-a65a-0b88d535179a tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:47.285259 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ac33617c-dcc1-4a0c-a65a-0b88d535179a tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:47.454239 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ac33617c-dcc1-4a0c-a65a-0b88d535179a tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:47.464872 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ac33617c-dcc1-4a0c-a65a-0b88d535179a tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:47.479062 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ac33617c-dcc1-4a0c-a65a-0b88d535179a tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:47.485044 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ac33617c-dcc1-4a0c-a65a-0b88d535179a tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1414 microversion: 2.54 time: 0.227476 Aug 22 17:23:47.486395 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 896/1790] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:47 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1414 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:48.168927 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fa39314a-de06-4d05-b16a-4dba7502f7cd tempest-ServersNegativeTestJSON-2102333601 tempest-ServersNegativeTestJSON-2102333601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-714857223", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "415e26ff-1f5d-410f-b354-3851632f7944"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:23:48.294756 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-fa39314a-de06-4d05-b16a-4dba7502f7cd tempest-ServersNegativeTestJSON-2102333601 tempest-ServersNegativeTestJSON-2102333601-project] validate_networks() for [('415e26ff-1f5d-410f-b354-3851632f7944', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:23:48.517969 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-92a78486-53ca-47b4-8b43-b923924fbeac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:48.518600 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-92a78486-53ca-47b4-8b43-b923924fbeac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:48.534270 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-92a78486-53ca-47b4-8b43-b923924fbeac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:48.534804 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-92a78486-53ca-47b4-8b43-b923924fbeac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:48.535256 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-92a78486-53ca-47b4-8b43-b923924fbeac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:48.539061 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-92a78486-53ca-47b4-8b43-b923924fbeac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:48.539061 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-92a78486-53ca-47b4-8b43-b923924fbeac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:48.539061 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-92a78486-53ca-47b4-8b43-b923924fbeac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:48.695499 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-92a78486-53ca-47b4-8b43-b923924fbeac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:48.709118 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-92a78486-53ca-47b4-8b43-b923924fbeac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:48.724182 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-92a78486-53ca-47b4-8b43-b923924fbeac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:48.725465 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-92a78486-53ca-47b4-8b43-b923924fbeac tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1414 microversion: 2.54 time: 0.211661 Aug 22 17:23:48.726067 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 897/1791] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:48 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1414 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-fa39314a-de06-4d05-b16a-4dba7502f7cd tempest-ServersNegativeTestJSON-2102333601 tempest-ServersNegativeTestJSON-2102333601-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6b59a0d7-9cb6-4634-ab64-e322646b65bd) Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:23:49.421646 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6b59a0d7-9cb6-4634-ab64-e322646b65bd) Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-fa39314a-de06-4d05-b16a-4dba7502f7cd tempest-ServersNegativeTestJSON-2102333601 tempest-ServersNegativeTestJSON-2102333601-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fa39314a-de06-4d05-b16a-4dba7502f7cd tempest-ServersNegativeTestJSON-2102333601 tempest-ServersNegativeTestJSON-2102333601-project] Request method failure captured: Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 208 Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7ujd6VUn3y2Q8GSSWCg6tA6IYql8yPrfPSqnKlNz8R1OXaDmu82CT-9JwQaZ4ITPA2Cp1rS37eCvr7r1nRx-S3TtKMdUPCjS6jDLs4g8fueZAgYtxVJcIWdP4pLn8kBM0bpr3T7Ju9-QECFhq-nf2n8KFFyOG71yZC-kvsCR_vQvRM Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 4d216fe4f1214b00b9bd7c2eb5c724c0 Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServersNegativeTestJSON-2102333601 Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4d216fe4f1214b00b9bd7c2eb5c724c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_4d216fe4f1214b00b9bd7c2eb5c724c0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4d216fe4f1214b00b9bd7c2eb5c724c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/4d216fe4f1214b00b9bd7c2eb5c724c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServersNegativeTestJSON-2102333601 Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 4d216fe4f1214b00b9bd7c2eb5c724c0 Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2102333601 Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServersNegativeTestJSON-2102333601-project Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: b0ff1b64a18c40698f582a559ee7a011 Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServersNegativeTestJSON-2102333601-project Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-714857223", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "415e26ff-1f5d-410f-b354-3851632f7944"}]}} Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:23:49.427856 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-714857223', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '415e26ff-1f5d-410f-b354-3851632f7944'}]}}} Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:23:49.437357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6b59a0d7-9cb6-4634-ab64-e322646b65bd) Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fa39314a-de06-4d05-b16a-4dba7502f7cd tempest-ServersNegativeTestJSON-2102333601 tempest-ServersNegativeTestJSON-2102333601-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-fa39314a-de06-4d05-b16a-4dba7502f7cd tempest-ServersNegativeTestJSON-2102333601 tempest-ServersNegativeTestJSON-2102333601-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.653647 Aug 22 17:23:49.452164 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 895/1792] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:23:47 2022] POST /compute/v2.1/servers => generated 214 bytes in 1667 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:23:49.753770 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9f766130-c0a9-4602-a75d-f53a85700f60 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:49.755026 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9f766130-c0a9-4602-a75d-f53a85700f60 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:49.768967 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9f766130-c0a9-4602-a75d-f53a85700f60 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:49.769837 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9f766130-c0a9-4602-a75d-f53a85700f60 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:49.771661 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9f766130-c0a9-4602-a75d-f53a85700f60 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:49.774107 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9f766130-c0a9-4602-a75d-f53a85700f60 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:49.775856 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9f766130-c0a9-4602-a75d-f53a85700f60 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:49.779802 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9f766130-c0a9-4602-a75d-f53a85700f60 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:49.926595 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9f766130-c0a9-4602-a75d-f53a85700f60 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:49.944901 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9f766130-c0a9-4602-a75d-f53a85700f60 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:49.946776 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9f766130-c0a9-4602-a75d-f53a85700f60 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:49.948322 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9f766130-c0a9-4602-a75d-f53a85700f60 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1399 microversion: 2.54 time: 0.199837 Aug 22 17:23:49.954382 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 898/1793] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:49 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1399 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:49.977695 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-dbe16ce8-920b-4967-82e3-7e6eb153acf3 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '.version_select at 0x7f8009eba820>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:50.121346 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-dbe16ce8-920b-4967-82e3-7e6eb153acf3 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1029611689" status: 204 len: 0 microversion: 2.54 time: 0.146570 Aug 22 17:23:50.126532 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 896/1794] 10.222.0.96 () {60 vars in 1319 bytes} [Mon Aug 22 17:23:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1029611689 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 17:23:50.143247 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fd8958b6-e349-4b27-b581-c8880db7fa2c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:50.143751 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-fd8958b6-e349-4b27-b581-c8880db7fa2c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:50.154859 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd8958b6-e349-4b27-b581-c8880db7fa2c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:50.157740 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd8958b6-e349-4b27-b581-c8880db7fa2c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:50.157740 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd8958b6-e349-4b27-b581-c8880db7fa2c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:50.157740 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd8958b6-e349-4b27-b581-c8880db7fa2c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:50.158302 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd8958b6-e349-4b27-b581-c8880db7fa2c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:50.158901 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd8958b6-e349-4b27-b581-c8880db7fa2c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:50.230102 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-fd8958b6-e349-4b27-b581-c8880db7fa2c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Going to try to terminate instance {{(pid=123015) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:23:50.656160 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fd8958b6-e349-4b27-b581-c8880db7fa2c tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "DELETE /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 204 len: 0 microversion: 2.54 time: 0.518331 Aug 22 17:23:50.657120 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 899/1795] 10.222.0.96 () {60 vars in 1280 bytes} [Mon Aug 22 17:23:50 2022] DELETE /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 17:23:50.665680 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-90652c7b-8311-4e10-b738-63af10520448 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:50.666308 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-90652c7b-8311-4e10-b738-63af10520448 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:50.683282 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90652c7b-8311-4e10-b738-63af10520448 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:50.684021 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90652c7b-8311-4e10-b738-63af10520448 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:50.689193 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90652c7b-8311-4e10-b738-63af10520448 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:50.690059 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90652c7b-8311-4e10-b738-63af10520448 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:50.690547 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90652c7b-8311-4e10-b738-63af10520448 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:50.693222 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-90652c7b-8311-4e10-b738-63af10520448 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:50.971006 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-90652c7b-8311-4e10-b738-63af10520448 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:50.990736 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-90652c7b-8311-4e10-b738-63af10520448 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:50.992842 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-90652c7b-8311-4e10-b738-63af10520448 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:50.999711 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-90652c7b-8311-4e10-b738-63af10520448 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1405 microversion: 2.54 time: 0.338522 Aug 22 17:23:51.007713 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 897/1796] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:50 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1405 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:51.782470 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8c2f5762-67cd-47d7-b9a2-60d1c6e27047 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1765594877", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": "none"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:23:51.813467 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=3,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:23:51.896431 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-8c2f5762-67cd-47d7-b9a2-60d1c6e27047 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:23:51.897697 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-8c2f5762-67cd-47d7-b9a2-60d1c6e27047 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:23:51.900767 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-8c2f5762-67cd-47d7-b9a2-60d1c6e27047 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:23:51.903651 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-8c2f5762-67cd-47d7-b9a2-60d1c6e27047 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:23:51.906290 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-8c2f5762-67cd-47d7-b9a2-60d1c6e27047 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:23:51.934601 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8c2f5762-67cd-47d7-b9a2-60d1c6e27047 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:51.941710 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8c2f5762-67cd-47d7-b9a2-60d1c6e27047 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:51.942718 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8c2f5762-67cd-47d7-b9a2-60d1c6e27047 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:51.944137 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8c2f5762-67cd-47d7-b9a2-60d1c6e27047 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:51.951481 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8c2f5762-67cd-47d7-b9a2-60d1c6e27047 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:51.951481 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8c2f5762-67cd-47d7-b9a2-60d1c6e27047 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:51.975033 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:23:51.999844 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-8c2f5762-67cd-47d7-b9a2-60d1c6e27047 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Getting quotas for project 8a23c9cfe83549e89a722585a71ca6b0. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:23:52.008940 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-8c2f5762-67cd-47d7-b9a2-60d1c6e27047 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Getting quotas for user fc398f9195a74edd84c259ec48b7a618 and project 8a23c9cfe83549e89a722585a71ca6b0. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:23:52.032540 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8c2f5762-67cd-47d7-b9a2-60d1c6e27047 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Going to run 1 instances... {{(pid=123015) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:23:52.033425 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-abdd5f7f-b1ef-49ac-a9fb-64495884ee9b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:52.034161 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-abdd5f7f-b1ef-49ac-a9fb-64495884ee9b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:52.035247 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8c2f5762-67cd-47d7-b9a2-60d1c6e27047 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: 6a1e0af4-8a41-4381-9c98-974ebc9bfa89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:23:52.049860 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-abdd5f7f-b1ef-49ac-a9fb-64495884ee9b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:52.050490 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-abdd5f7f-b1ef-49ac-a9fb-64495884ee9b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:52.051225 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-abdd5f7f-b1ef-49ac-a9fb-64495884ee9b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:52.053815 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-abdd5f7f-b1ef-49ac-a9fb-64495884ee9b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:52.054383 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-abdd5f7f-b1ef-49ac-a9fb-64495884ee9b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:52.056158 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-abdd5f7f-b1ef-49ac-a9fb-64495884ee9b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:52.211435 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-abdd5f7f-b1ef-49ac-a9fb-64495884ee9b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:52.225749 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-abdd5f7f-b1ef-49ac-a9fb-64495884ee9b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:52.227653 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-abdd5f7f-b1ef-49ac-a9fb-64495884ee9b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:52.229069 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-abdd5f7f-b1ef-49ac-a9fb-64495884ee9b tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1405 microversion: 2.54 time: 0.201319 Aug 22 17:23:52.247795 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 898/1797] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:52 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:23:52.278168 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8c2f5762-67cd-47d7-b9a2-60d1c6e27047 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.805151 Aug 22 17:23:52.278809 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 900/1798] 10.222.0.96 () {62 vars in 1188 bytes} [Mon Aug 22 17:23:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 22 17:23:52.291240 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-cd83bf0b-0d56-4837-9160-65dc33d94106 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:52.292576 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-cd83bf0b-0d56-4837-9160-65dc33d94106 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: 6a1e0af4-8a41-4381-9c98-974ebc9bfa89] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:52.561922 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-cd83bf0b-0d56-4837-9160-65dc33d94106 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:52.575059 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-cd83bf0b-0d56-4837-9160-65dc33d94106 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:52.595159 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-cd83bf0b-0d56-4837-9160-65dc33d94106 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:52.611541 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-cd83bf0b-0d56-4837-9160-65dc33d94106 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/6a1e0af4-8a41-4381-9c98-974ebc9bfa89" status: 200 len: 1278 microversion: 2.47 time: 0.324604 Aug 22 17:23:52.614480 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 899/1799] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:52 2022] GET /compute/v2.1/servers/6a1e0af4-8a41-4381-9c98-974ebc9bfa89 => generated 1278 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:53.031764 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fad678ff-905d-4197-b589-29a8fd2daec4 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-661426903", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": "none"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:23:53.127347 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-fad678ff-905d-4197-b589-29a8fd2daec4 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:23:53.128521 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-fad678ff-905d-4197-b589-29a8fd2daec4 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:23:53.129854 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-fad678ff-905d-4197-b589-29a8fd2daec4 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:23:53.130909 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-fad678ff-905d-4197-b589-29a8fd2daec4 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:23:53.134084 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-fad678ff-905d-4197-b589-29a8fd2daec4 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:23:53.153818 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fad678ff-905d-4197-b589-29a8fd2daec4 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:53.159187 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fad678ff-905d-4197-b589-29a8fd2daec4 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:53.160398 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fad678ff-905d-4197-b589-29a8fd2daec4 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:53.161786 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fad678ff-905d-4197-b589-29a8fd2daec4 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:53.164923 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fad678ff-905d-4197-b589-29a8fd2daec4 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:53.165630 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fad678ff-905d-4197-b589-29a8fd2daec4 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:53.205394 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-fad678ff-905d-4197-b589-29a8fd2daec4 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Getting quotas for project 8a23c9cfe83549e89a722585a71ca6b0. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:23:53.225398 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-fad678ff-905d-4197-b589-29a8fd2daec4 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Getting quotas for user fc398f9195a74edd84c259ec48b7a618 and project 8a23c9cfe83549e89a722585a71ca6b0. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:23:53.259354 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f0d2f319-3f48-45ee-b80c-e2bab0e26a4d tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:53.259354 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-f0d2f319-3f48-45ee-b80c-e2bab0e26a4d tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:53.261916 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-fad678ff-905d-4197-b589-29a8fd2daec4 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Going to run 1 instances... {{(pid=123015) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:23:53.264715 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-fad678ff-905d-4197-b589-29a8fd2daec4 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:23:53.266624 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f0d2f319-3f48-45ee-b80c-e2bab0e26a4d tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:53.267318 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f0d2f319-3f48-45ee-b80c-e2bab0e26a4d tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:53.269023 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f0d2f319-3f48-45ee-b80c-e2bab0e26a4d tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:53.271142 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f0d2f319-3f48-45ee-b80c-e2bab0e26a4d tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:53.272203 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f0d2f319-3f48-45ee-b80c-e2bab0e26a4d tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:53.273613 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f0d2f319-3f48-45ee-b80c-e2bab0e26a4d tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:53.484406 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fad678ff-905d-4197-b589-29a8fd2daec4 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.458365 Aug 22 17:23:53.500522 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 901/1800] 10.222.0.96 () {62 vars in 1188 bytes} [Mon Aug 22 17:23:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 473 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 22 17:23:53.516825 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fa47c2df-83a7-475f-a9da-6746369ae80d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:23:53.523995 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-fa47c2df-83a7-475f-a9da-6746369ae80d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:53.590029 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-f0d2f319-3f48-45ee-b80c-e2bab0e26a4d tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:53.606867 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-f0d2f319-3f48-45ee-b80c-e2bab0e26a4d tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:53.609436 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-f0d2f319-3f48-45ee-b80c-e2bab0e26a4d tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:53.619157 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f0d2f319-3f48-45ee-b80c-e2bab0e26a4d tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1405 microversion: 2.54 time: 0.364915 Aug 22 17:23:53.623291 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 900/1801] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:53 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1405 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:53.672127 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fa47c2df-83a7-475f-a9da-6746369ae80d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "PUT /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 991 microversion: 2.47 time: 0.157269 Aug 22 17:23:53.672127 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 902/1802] 10.222.0.96 () {62 vars in 1297 bytes} [Mon Aug 22 17:23:53 2022] PUT /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 991 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:23:53.700813 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a89c9e08-bb46-4aa6-b4a0-9a29336f8246 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:53.701860 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-a89c9e08-bb46-4aa6-b4a0-9a29336f8246 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:54.254220 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a89c9e08-bb46-4aa6-b4a0-9a29336f8246 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:54.266472 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a89c9e08-bb46-4aa6-b4a0-9a29336f8246 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:54.269116 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a89c9e08-bb46-4aa6-b4a0-9a29336f8246 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:54.273695 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a89c9e08-bb46-4aa6-b4a0-9a29336f8246 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1277 microversion: 2.47 time: 0.575457 Aug 22 17:23:54.274948 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 901/1803] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:53 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1277 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:54.663280 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-62156d74-17f0-4c6b-8852-89a409254271 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:54.664626 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-62156d74-17f0-4c6b-8852-89a409254271 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:54.675992 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-62156d74-17f0-4c6b-8852-89a409254271 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:54.677511 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-62156d74-17f0-4c6b-8852-89a409254271 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:54.679001 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-62156d74-17f0-4c6b-8852-89a409254271 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:54.679918 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-62156d74-17f0-4c6b-8852-89a409254271 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:54.680558 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-62156d74-17f0-4c6b-8852-89a409254271 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:54.681287 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-62156d74-17f0-4c6b-8852-89a409254271 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:54.783991 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-62156d74-17f0-4c6b-8852-89a409254271 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:54.784925 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-62156d74-17f0-4c6b-8852-89a409254271 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:54.787478 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-62156d74-17f0-4c6b-8852-89a409254271 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:54.789523 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-62156d74-17f0-4c6b-8852-89a409254271 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lazy-loading 'fault' on Instance uuid c767b0bd-99e7-437c-9e5c-3299f40c5b53 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:23:54.883882 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-62156d74-17f0-4c6b-8852-89a409254271 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:54.905341 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-62156d74-17f0-4c6b-8852-89a409254271 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:54.909542 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-62156d74-17f0-4c6b-8852-89a409254271 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '906cb1e237b64a1482ae7136591cc3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51269acf039f4159b25d0c76703234b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:54.917968 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-62156d74-17f0-4c6b-8852-89a409254271 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 200 len: 1410 microversion: 2.54 time: 0.257112 Aug 22 17:23:54.923654 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 903/1804] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:54 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 1410 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:55.305155 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-abee7de6-ab5b-4131-bc7a-0282d85f8ac9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:55.327773 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-abee7de6-ab5b-4131-bc7a-0282d85f8ac9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:55.374325 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-abee7de6-ab5b-4131-bc7a-0282d85f8ac9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:55.377437 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-abee7de6-ab5b-4131-bc7a-0282d85f8ac9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:55.384758 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-abee7de6-ab5b-4131-bc7a-0282d85f8ac9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:55.386818 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-abee7de6-ab5b-4131-bc7a-0282d85f8ac9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:55.397278 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-abee7de6-ab5b-4131-bc7a-0282d85f8ac9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:55.400117 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-abee7de6-ab5b-4131-bc7a-0282d85f8ac9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:55.643765 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-abee7de6-ab5b-4131-bc7a-0282d85f8ac9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:55.658241 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-abee7de6-ab5b-4131-bc7a-0282d85f8ac9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:55.669431 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-abee7de6-ab5b-4131-bc7a-0282d85f8ac9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:55.673934 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-abee7de6-ab5b-4131-bc7a-0282d85f8ac9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1281 microversion: 2.47 time: 0.374286 Aug 22 17:23:55.680252 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 902/1805] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:55 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1281 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:55.954443 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4ddda221-10c3-4125-9dd0-c17fcdce3d31 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:55.954443 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-4ddda221-10c3-4125-9dd0-c17fcdce3d31 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] [instance: c767b0bd-99e7-437c-9e5c-3299f40c5b53] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:55.965368 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4ddda221-10c3-4125-9dd0-c17fcdce3d31 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:55.965861 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4ddda221-10c3-4125-9dd0-c17fcdce3d31 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:55.966507 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4ddda221-10c3-4125-9dd0-c17fcdce3d31 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:55.967400 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4ddda221-10c3-4125-9dd0-c17fcdce3d31 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:55.968021 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4ddda221-10c3-4125-9dd0-c17fcdce3d31 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:55.968611 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4ddda221-10c3-4125-9dd0-c17fcdce3d31 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:55.998851 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-4ddda221-10c3-4125-9dd0-c17fcdce3d31 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] HTTP exception thrown: Instance c767b0bd-99e7-437c-9e5c-3299f40c5b53 could not be found. Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4ddda221-10c3-4125-9dd0-c17fcdce3d31 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Request method failure captured: Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 HTTP/1.1 Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7ttFc5_wGHdZA8lyluPQx_VnJISQt8MDck7vXV4Iz1QWf_1qlJauncpVdJfYu7t7_eHF-Uy2ck6gqVl3rpFNlgMdyNCJIhLhSiIdcY73S_0NXVLBuJ_GO4yAxdmaeCu4sC56FJ2fqI9y1xuSBEcGIwowslEu165iI7d0FfG5jUb2vw Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-Openstack-Nova-Api-Version: 2.54 Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 51269acf039f4159b25d0c76703234b6 Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServerShowV254Test-1558854302 Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/51269acf039f4159b25d0c76703234b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_51269acf039f4159b25d0c76703234b6", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/51269acf039f4159b25d0c76703234b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/51269acf039f4159b25d0c76703234b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServerShowV254Test-1558854302 Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 51269acf039f4159b25d0c76703234b6 Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServerShowV254Test-1558854302 Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServerShowV254Test-1558854302-project Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 906cb1e237b64a1482ae7136591cc3c8 Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServerShowV254Test-1558854302-project Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance c767b0bd-99e7-437c-9e5c-3299f40c5b53 could not be found. Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': 'c767b0bd-99e7-437c-9e5c-3299f40c5b53'} Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c767b0bd-99e7-437c-9e5c-3299f40c5b53 could not be found. Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c767b0bd-99e7-437c-9e5c-3299f40c5b53 could not be found. Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:23:56.000580 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:56.004790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:23:56.004790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:23:56.004790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:23:56.004790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:23:56.004790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:23:56.004790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c767b0bd-99e7-437c-9e5c-3299f40c5b53 could not be found. Aug 22 17:23:56.004790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:23:56.006530 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4ddda221-10c3-4125-9dd0-c17fcdce3d31 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] Returning 404 to user: Instance c767b0bd-99e7-437c-9e5c-3299f40c5b53 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:23:56.009570 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-4ddda221-10c3-4125-9dd0-c17fcdce3d31 tempest-ServerShowV254Test-1558854302 tempest-ServerShowV254Test-1558854302-project] 10.222.0.96 "GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53" status: 404 len: 111 microversion: 2.54 time: 0.062310 Aug 22 17:23:56.010542 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 904/1806] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:55 2022] GET /compute/v2.1/servers/c767b0bd-99e7-437c-9e5c-3299f40c5b53 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:23:56.707752 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-45447b54-00e7-4d6b-bfe0-56ba8627a800 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:56.708508 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-45447b54-00e7-4d6b-bfe0-56ba8627a800 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:56.718056 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45447b54-00e7-4d6b-bfe0-56ba8627a800 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:56.720809 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45447b54-00e7-4d6b-bfe0-56ba8627a800 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:56.720809 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45447b54-00e7-4d6b-bfe0-56ba8627a800 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:56.720809 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45447b54-00e7-4d6b-bfe0-56ba8627a800 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:56.720809 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45447b54-00e7-4d6b-bfe0-56ba8627a800 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:56.721850 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45447b54-00e7-4d6b-bfe0-56ba8627a800 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:56.882069 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-45447b54-00e7-4d6b-bfe0-56ba8627a800 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:56.891602 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-45447b54-00e7-4d6b-bfe0-56ba8627a800 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:56.893936 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-45447b54-00e7-4d6b-bfe0-56ba8627a800 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:56.895512 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-45447b54-00e7-4d6b-bfe0-56ba8627a800 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1329 microversion: 2.47 time: 0.195018 Aug 22 17:23:56.896634 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 903/1807] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:56 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1329 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:23:57.926772 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-081c246a-d182-4574-b98b-eb0a3a871f17 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:57.927552 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-081c246a-d182-4574-b98b-eb0a3a871f17 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:57.948734 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-081c246a-d182-4574-b98b-eb0a3a871f17 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:57.950903 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-081c246a-d182-4574-b98b-eb0a3a871f17 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:57.953113 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-081c246a-d182-4574-b98b-eb0a3a871f17 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:57.954854 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-081c246a-d182-4574-b98b-eb0a3a871f17 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:57.956283 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-081c246a-d182-4574-b98b-eb0a3a871f17 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:57.956788 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-081c246a-d182-4574-b98b-eb0a3a871f17 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:58.084629 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-081c246a-d182-4574-b98b-eb0a3a871f17 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:58.098620 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-081c246a-d182-4574-b98b-eb0a3a871f17 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:58.100230 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-081c246a-d182-4574-b98b-eb0a3a871f17 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:58.106791 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-081c246a-d182-4574-b98b-eb0a3a871f17 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1337 microversion: 2.47 time: 0.185547 Aug 22 17:23:58.106791 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 905/1808] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:57 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1337 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:23:59.128839 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-3e0fa5ae-8675-425b-b588-0aad30e33337 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:23:59.129991 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-3e0fa5ae-8675-425b-b588-0aad30e33337 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:23:59.132537 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:23:59.146961 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3e0fa5ae-8675-425b-b588-0aad30e33337 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:59.148890 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3e0fa5ae-8675-425b-b588-0aad30e33337 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:59.148890 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3e0fa5ae-8675-425b-b588-0aad30e33337 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:59.149640 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3e0fa5ae-8675-425b-b588-0aad30e33337 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:23:59.150925 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3e0fa5ae-8675-425b-b588-0aad30e33337 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:23:59.154403 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3e0fa5ae-8675-425b-b588-0aad30e33337 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:23:59.274220 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-3e0fa5ae-8675-425b-b588-0aad30e33337 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:59.284301 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-3e0fa5ae-8675-425b-b588-0aad30e33337 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:59.286080 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-3e0fa5ae-8675-425b-b588-0aad30e33337 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:23:59.287389 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-3e0fa5ae-8675-425b-b588-0aad30e33337 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1335 microversion: 2.47 time: 0.163823 Aug 22 17:23:59.288141 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 904/1809] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:23:59 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1335 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:00.319509 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0b99b7cd-87d5-4515-a17f-23514700d83a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:00.320210 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0b99b7cd-87d5-4515-a17f-23514700d83a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:00.332429 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b99b7cd-87d5-4515-a17f-23514700d83a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:00.333643 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b99b7cd-87d5-4515-a17f-23514700d83a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:00.340642 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b99b7cd-87d5-4515-a17f-23514700d83a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:00.342189 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b99b7cd-87d5-4515-a17f-23514700d83a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:00.344768 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b99b7cd-87d5-4515-a17f-23514700d83a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:00.346389 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0b99b7cd-87d5-4515-a17f-23514700d83a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:00.481140 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0b99b7cd-87d5-4515-a17f-23514700d83a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:00.497390 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0b99b7cd-87d5-4515-a17f-23514700d83a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:00.499732 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0b99b7cd-87d5-4515-a17f-23514700d83a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:00.501176 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0b99b7cd-87d5-4515-a17f-23514700d83a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1335 microversion: 2.47 time: 0.187935 Aug 22 17:24:00.526043 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 906/1810] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:00 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1335 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:01.534135 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-3f80eefe-1cc0-47a7-ba11-738b3b22c508 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:01.535168 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-3f80eefe-1cc0-47a7-ba11-738b3b22c508 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:01.549623 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3f80eefe-1cc0-47a7-ba11-738b3b22c508 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:01.550275 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3f80eefe-1cc0-47a7-ba11-738b3b22c508 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:01.552286 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3f80eefe-1cc0-47a7-ba11-738b3b22c508 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:01.554680 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3f80eefe-1cc0-47a7-ba11-738b3b22c508 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:01.556660 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3f80eefe-1cc0-47a7-ba11-738b3b22c508 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:01.558605 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3f80eefe-1cc0-47a7-ba11-738b3b22c508 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:01.727766 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-3f80eefe-1cc0-47a7-ba11-738b3b22c508 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:01.743975 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-3f80eefe-1cc0-47a7-ba11-738b3b22c508 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:01.748489 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-3f80eefe-1cc0-47a7-ba11-738b3b22c508 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:01.750333 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-3f80eefe-1cc0-47a7-ba11-738b3b22c508 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1356 microversion: 2.47 time: 0.222707 Aug 22 17:24:01.753480 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 905/1811] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:01 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1356 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:01.778073 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:24:01.783119 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:01.791116 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:01.794187 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:01.803009 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:01.804978 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:01.806721 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:01.808043 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:01.955572 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:24:01.956454 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:24:01.956934 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:24:01.957385 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:24:01.957798 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:24:02.247754 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:02.256096 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:02.256846 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:02.257639 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:02.258526 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:02.259330 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:02.260635 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:02.338066 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ce9fb40b-8b2d-4335-8be6-aa9223eb4c90 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "POST /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833/action" status: 202 len: 1078 microversion: 2.47 time: 0.564710 Aug 22 17:24:02.344308 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 907/1812] 10.222.0.96 () {62 vars in 1319 bytes} [Mon Aug 22 17:24:01 2022] POST /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833/action => generated 1078 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 22 17:24:02.362742 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e91bd9dc-4220-4dde-a03b-1cbeebb898f9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:02.368690 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-e91bd9dc-4220-4dde-a03b-1cbeebb898f9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:02.386506 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e91bd9dc-4220-4dde-a03b-1cbeebb898f9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:02.389694 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e91bd9dc-4220-4dde-a03b-1cbeebb898f9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:02.397540 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e91bd9dc-4220-4dde-a03b-1cbeebb898f9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:02.400549 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e91bd9dc-4220-4dde-a03b-1cbeebb898f9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:02.401394 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e91bd9dc-4220-4dde-a03b-1cbeebb898f9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:02.402126 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e91bd9dc-4220-4dde-a03b-1cbeebb898f9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:02.874209 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f511889b-d511-49b0-a013-c65b66139f84 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-315396747", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": "none"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:24:02.957209 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-f511889b-d511-49b0-a013-c65b66139f84 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:24:02.962281 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-f511889b-d511-49b0-a013-c65b66139f84 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:24:02.962984 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-f511889b-d511-49b0-a013-c65b66139f84 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:24:02.964727 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-f511889b-d511-49b0-a013-c65b66139f84 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:24:02.965276 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-f511889b-d511-49b0-a013-c65b66139f84 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:24:02.992426 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f511889b-d511-49b0-a013-c65b66139f84 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:02.996032 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f511889b-d511-49b0-a013-c65b66139f84 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:02.996841 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f511889b-d511-49b0-a013-c65b66139f84 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:02.998357 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f511889b-d511-49b0-a013-c65b66139f84 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:03.004576 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f511889b-d511-49b0-a013-c65b66139f84 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:03.004576 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f511889b-d511-49b0-a013-c65b66139f84 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:03.052404 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-f511889b-d511-49b0-a013-c65b66139f84 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Getting quotas for project d034cf1cc3df4d98948c7c135c926e38. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:24:03.067172 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-f511889b-d511-49b0-a013-c65b66139f84 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Getting quotas for user 0eeedc48346744bcace96800f65a8b78 and project d034cf1cc3df4d98948c7c135c926e38. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:24:03.079510 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e91bd9dc-4220-4dde-a03b-1cbeebb898f9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:03.092325 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e91bd9dc-4220-4dde-a03b-1cbeebb898f9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:03.094360 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e91bd9dc-4220-4dde-a03b-1cbeebb898f9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:03.096045 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e91bd9dc-4220-4dde-a03b-1cbeebb898f9 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.742069 Aug 22 17:24:03.097225 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 908/1813] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:02 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:24:03.097362 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-f511889b-d511-49b0-a013-c65b66139f84 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Going to run 1 instances... {{(pid=123016) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:24:03.099672 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-f511889b-d511-49b0-a013-c65b66139f84 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:24:03.255362 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f511889b-d511-49b0-a013-c65b66139f84 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.959662 Aug 22 17:24:03.256546 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 906/1814] 10.222.0.96 () {62 vars in 1188 bytes} [Mon Aug 22 17:24:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 22 17:24:03.265950 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:03.269853 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=12 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:03.275109 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b4c59658-1a5c-475c-97b4-a7e0926a31c3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:03.275719 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b4c59658-1a5c-475c-97b4-a7e0926a31c3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:03.398914 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b4c59658-1a5c-475c-97b4-a7e0926a31c3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:03.406850 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b4c59658-1a5c-475c-97b4-a7e0926a31c3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:03.409334 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b4c59658-1a5c-475c-97b4-a7e0926a31c3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:03.411401 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b4c59658-1a5c-475c-97b4-a7e0926a31c3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1277 microversion: 2.57 time: 0.146550 Aug 22 17:24:03.412370 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 909/1815] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:03 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:04.125604 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-3337b288-c4d3-4609-8f86-3b13521a67e3 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:04.125604 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-3337b288-c4d3-4609-8f86-3b13521a67e3 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:04.131610 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3337b288-c4d3-4609-8f86-3b13521a67e3 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:04.132472 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3337b288-c4d3-4609-8f86-3b13521a67e3 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:04.132915 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3337b288-c4d3-4609-8f86-3b13521a67e3 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:04.133642 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3337b288-c4d3-4609-8f86-3b13521a67e3 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:04.134266 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3337b288-c4d3-4609-8f86-3b13521a67e3 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:04.134718 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-3337b288-c4d3-4609-8f86-3b13521a67e3 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:04.253013 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-3337b288-c4d3-4609-8f86-3b13521a67e3 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:04.265497 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-3337b288-c4d3-4609-8f86-3b13521a67e3 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:04.271988 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-3337b288-c4d3-4609-8f86-3b13521a67e3 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:04.273279 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-3337b288-c4d3-4609-8f86-3b13521a67e3 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.157290 Aug 22 17:24:04.285361 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 907/1816] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:04 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:04.436678 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7b46a6ef-b21e-4093-9b10-b0fab4ac7ec7 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:04.438167 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-7b46a6ef-b21e-4093-9b10-b0fab4ac7ec7 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:04.600093 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-7b46a6ef-b21e-4093-9b10-b0fab4ac7ec7 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:04.614635 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-7b46a6ef-b21e-4093-9b10-b0fab4ac7ec7 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:04.617786 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-7b46a6ef-b21e-4093-9b10-b0fab4ac7ec7 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:04.623786 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7b46a6ef-b21e-4093-9b10-b0fab4ac7ec7 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1277 microversion: 2.57 time: 0.191256 Aug 22 17:24:04.625724 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 910/1817] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:04 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:05.298601 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-04c8b8ce-ba82-4911-a1a9-6292a9580e8a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:05.299773 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-04c8b8ce-ba82-4911-a1a9-6292a9580e8a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:05.316021 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-04c8b8ce-ba82-4911-a1a9-6292a9580e8a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:05.330125 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-04c8b8ce-ba82-4911-a1a9-6292a9580e8a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:05.330925 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-04c8b8ce-ba82-4911-a1a9-6292a9580e8a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:05.334478 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-04c8b8ce-ba82-4911-a1a9-6292a9580e8a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:05.334478 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-04c8b8ce-ba82-4911-a1a9-6292a9580e8a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:05.335675 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-04c8b8ce-ba82-4911-a1a9-6292a9580e8a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:05.647962 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-178b02cf-4892-443f-9c94-929295a07661 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:05.649482 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-178b02cf-4892-443f-9c94-929295a07661 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:05.655126 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-04c8b8ce-ba82-4911-a1a9-6292a9580e8a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:05.660024 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-178b02cf-4892-443f-9c94-929295a07661 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:05.661337 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-178b02cf-4892-443f-9c94-929295a07661 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:05.662685 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-178b02cf-4892-443f-9c94-929295a07661 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:05.665826 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-178b02cf-4892-443f-9c94-929295a07661 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:05.668539 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-04c8b8ce-ba82-4911-a1a9-6292a9580e8a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:05.669496 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-178b02cf-4892-443f-9c94-929295a07661 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:05.672267 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-178b02cf-4892-443f-9c94-929295a07661 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:05.674861 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-04c8b8ce-ba82-4911-a1a9-6292a9580e8a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:05.678823 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-04c8b8ce-ba82-4911-a1a9-6292a9580e8a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.384939 Aug 22 17:24:05.683883 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 908/1818] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:05 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:05.986363 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-178b02cf-4892-443f-9c94-929295a07661 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:05.999921 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-178b02cf-4892-443f-9c94-929295a07661 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:06.005997 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-178b02cf-4892-443f-9c94-929295a07661 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:06.008544 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-178b02cf-4892-443f-9c94-929295a07661 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1281 microversion: 2.57 time: 0.364425 Aug 22 17:24:06.012177 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 911/1819] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:05 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1281 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:06.739087 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-409dc21b-69f7-4a4e-97d4-8aa9cfcd162c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:06.739087 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-409dc21b-69f7-4a4e-97d4-8aa9cfcd162c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:06.739087 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-409dc21b-69f7-4a4e-97d4-8aa9cfcd162c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:06.739087 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-409dc21b-69f7-4a4e-97d4-8aa9cfcd162c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:06.739087 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-409dc21b-69f7-4a4e-97d4-8aa9cfcd162c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:06.739087 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-409dc21b-69f7-4a4e-97d4-8aa9cfcd162c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:06.739087 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-409dc21b-69f7-4a4e-97d4-8aa9cfcd162c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:06.739087 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-409dc21b-69f7-4a4e-97d4-8aa9cfcd162c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:06.933032 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-409dc21b-69f7-4a4e-97d4-8aa9cfcd162c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:06.936617 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=90 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:06.976977 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-409dc21b-69f7-4a4e-97d4-8aa9cfcd162c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:06.986305 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-409dc21b-69f7-4a4e-97d4-8aa9cfcd162c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:06.993205 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-409dc21b-69f7-4a4e-97d4-8aa9cfcd162c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.277191 Aug 22 17:24:06.997824 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 909/1820] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:06 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:07.047330 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8cc65e6c-9bbe-415a-bdbd-663405e33a61 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:07.048602 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8cc65e6c-9bbe-415a-bdbd-663405e33a61 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:07.062336 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8cc65e6c-9bbe-415a-bdbd-663405e33a61 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:07.063082 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8cc65e6c-9bbe-415a-bdbd-663405e33a61 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:07.063761 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8cc65e6c-9bbe-415a-bdbd-663405e33a61 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:07.064715 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8cc65e6c-9bbe-415a-bdbd-663405e33a61 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:07.065434 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8cc65e6c-9bbe-415a-bdbd-663405e33a61 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:07.066087 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8cc65e6c-9bbe-415a-bdbd-663405e33a61 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:07.207765 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8cc65e6c-9bbe-415a-bdbd-663405e33a61 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:07.225439 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8cc65e6c-9bbe-415a-bdbd-663405e33a61 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:07.232130 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8cc65e6c-9bbe-415a-bdbd-663405e33a61 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:07.235040 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8cc65e6c-9bbe-415a-bdbd-663405e33a61 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1329 microversion: 2.57 time: 0.194513 Aug 22 17:24:07.235628 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 912/1821] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:07 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1329 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:08.026216 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-46a866ca-5df8-4870-ba10-55f824a1ed88 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:08.026893 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-46a866ca-5df8-4870-ba10-55f824a1ed88 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:08.045297 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-46a866ca-5df8-4870-ba10-55f824a1ed88 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:08.048994 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-46a866ca-5df8-4870-ba10-55f824a1ed88 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:08.049565 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-46a866ca-5df8-4870-ba10-55f824a1ed88 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:08.056412 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-46a866ca-5df8-4870-ba10-55f824a1ed88 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:08.056412 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-46a866ca-5df8-4870-ba10-55f824a1ed88 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:08.056412 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-46a866ca-5df8-4870-ba10-55f824a1ed88 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:08.197859 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-46a866ca-5df8-4870-ba10-55f824a1ed88 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:08.216261 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-46a866ca-5df8-4870-ba10-55f824a1ed88 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:08.222800 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-46a866ca-5df8-4870-ba10-55f824a1ed88 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:08.226316 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-46a866ca-5df8-4870-ba10-55f824a1ed88 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.204583 Aug 22 17:24:08.228627 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 910/1822] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:08 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:08.267940 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d323b54d-f347-4c4f-91c2-06e5aa3022a6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:08.278366 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-d323b54d-f347-4c4f-91c2-06e5aa3022a6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:08.290326 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d323b54d-f347-4c4f-91c2-06e5aa3022a6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:08.293167 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d323b54d-f347-4c4f-91c2-06e5aa3022a6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:08.293981 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d323b54d-f347-4c4f-91c2-06e5aa3022a6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:08.297684 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d323b54d-f347-4c4f-91c2-06e5aa3022a6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:08.298891 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d323b54d-f347-4c4f-91c2-06e5aa3022a6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:08.301472 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-d323b54d-f347-4c4f-91c2-06e5aa3022a6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:08.549636 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d323b54d-f347-4c4f-91c2-06e5aa3022a6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:08.560867 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d323b54d-f347-4c4f-91c2-06e5aa3022a6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:08.563158 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-d323b54d-f347-4c4f-91c2-06e5aa3022a6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:08.564755 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d323b54d-f347-4c4f-91c2-06e5aa3022a6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1335 microversion: 2.57 time: 0.300736 Aug 22 17:24:08.566292 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 913/1823] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:08 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1335 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:09.260064 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-165ceaa6-41ef-4ebf-897d-68e2557d6658 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:09.261708 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-165ceaa6-41ef-4ebf-897d-68e2557d6658 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:09.273110 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-165ceaa6-41ef-4ebf-897d-68e2557d6658 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:09.273879 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-165ceaa6-41ef-4ebf-897d-68e2557d6658 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:09.276905 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-165ceaa6-41ef-4ebf-897d-68e2557d6658 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:09.280667 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-165ceaa6-41ef-4ebf-897d-68e2557d6658 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:09.282196 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-165ceaa6-41ef-4ebf-897d-68e2557d6658 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:09.285268 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-165ceaa6-41ef-4ebf-897d-68e2557d6658 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:09.455429 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-165ceaa6-41ef-4ebf-897d-68e2557d6658 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:09.476094 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-165ceaa6-41ef-4ebf-897d-68e2557d6658 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:09.480052 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-165ceaa6-41ef-4ebf-897d-68e2557d6658 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:09.481920 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-165ceaa6-41ef-4ebf-897d-68e2557d6658 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.226134 Aug 22 17:24:09.483594 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 911/1824] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:09 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:09.591507 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f6b7b6f0-9e73-4066-99eb-7f3a86013a75 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:09.592131 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f6b7b6f0-9e73-4066-99eb-7f3a86013a75 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:09.604084 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f6b7b6f0-9e73-4066-99eb-7f3a86013a75 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:09.605509 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f6b7b6f0-9e73-4066-99eb-7f3a86013a75 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:09.606179 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f6b7b6f0-9e73-4066-99eb-7f3a86013a75 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:09.608681 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f6b7b6f0-9e73-4066-99eb-7f3a86013a75 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:09.609462 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f6b7b6f0-9e73-4066-99eb-7f3a86013a75 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:09.614099 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f6b7b6f0-9e73-4066-99eb-7f3a86013a75 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:10.259780 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f6b7b6f0-9e73-4066-99eb-7f3a86013a75 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:10.269243 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f6b7b6f0-9e73-4066-99eb-7f3a86013a75 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:10.270967 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f6b7b6f0-9e73-4066-99eb-7f3a86013a75 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:10.272224 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f6b7b6f0-9e73-4066-99eb-7f3a86013a75 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1335 microversion: 2.57 time: 0.685123 Aug 22 17:24:10.286578 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 914/1825] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:09 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1335 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:10.521137 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9cdb3410-66a8-49fc-88d9-649092ea0967 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:10.521964 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-9cdb3410-66a8-49fc-88d9-649092ea0967 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:10.542754 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9cdb3410-66a8-49fc-88d9-649092ea0967 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:10.543805 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9cdb3410-66a8-49fc-88d9-649092ea0967 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:10.544524 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9cdb3410-66a8-49fc-88d9-649092ea0967 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:10.548309 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9cdb3410-66a8-49fc-88d9-649092ea0967 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:10.549231 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9cdb3410-66a8-49fc-88d9-649092ea0967 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:10.549896 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9cdb3410-66a8-49fc-88d9-649092ea0967 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:10.699254 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9cdb3410-66a8-49fc-88d9-649092ea0967 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:10.709535 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9cdb3410-66a8-49fc-88d9-649092ea0967 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:10.711435 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9cdb3410-66a8-49fc-88d9-649092ea0967 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:10.712896 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9cdb3410-66a8-49fc-88d9-649092ea0967 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.204443 Aug 22 17:24:10.715562 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 912/1826] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:10 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:11.299664 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0ed4f934-982d-4863-8de0-4cec78ba413f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:11.300470 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0ed4f934-982d-4863-8de0-4cec78ba413f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:11.313234 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0ed4f934-982d-4863-8de0-4cec78ba413f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:11.313750 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0ed4f934-982d-4863-8de0-4cec78ba413f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:11.317539 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0ed4f934-982d-4863-8de0-4cec78ba413f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:11.317539 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0ed4f934-982d-4863-8de0-4cec78ba413f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:11.317539 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0ed4f934-982d-4863-8de0-4cec78ba413f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:11.317539 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0ed4f934-982d-4863-8de0-4cec78ba413f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:11.589099 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0ed4f934-982d-4863-8de0-4cec78ba413f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:11.608728 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0ed4f934-982d-4863-8de0-4cec78ba413f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:11.615953 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-0ed4f934-982d-4863-8de0-4cec78ba413f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:11.615953 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0ed4f934-982d-4863-8de0-4cec78ba413f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1335 microversion: 2.57 time: 0.317499 Aug 22 17:24:11.615953 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 915/1827] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:11 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1335 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:11.738243 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-302bb3b7-1781-42f7-ae9b-4674846dda0e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:11.738872 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-302bb3b7-1781-42f7-ae9b-4674846dda0e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:11.746339 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-302bb3b7-1781-42f7-ae9b-4674846dda0e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:11.746842 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-302bb3b7-1781-42f7-ae9b-4674846dda0e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:11.747276 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-302bb3b7-1781-42f7-ae9b-4674846dda0e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:11.747992 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-302bb3b7-1781-42f7-ae9b-4674846dda0e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:11.748446 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-302bb3b7-1781-42f7-ae9b-4674846dda0e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:11.748868 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-302bb3b7-1781-42f7-ae9b-4674846dda0e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:11.990623 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-302bb3b7-1781-42f7-ae9b-4674846dda0e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:12.004873 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-302bb3b7-1781-42f7-ae9b-4674846dda0e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:12.007047 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-302bb3b7-1781-42f7-ae9b-4674846dda0e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:12.008668 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-302bb3b7-1781-42f7-ae9b-4674846dda0e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.276728 Aug 22 17:24:12.021859 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 913/1828] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:11 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:24:12.642857 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-438741c8-2f79-432d-a594-6bea059fe820 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:12.643473 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-438741c8-2f79-432d-a594-6bea059fe820 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:12.652690 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-438741c8-2f79-432d-a594-6bea059fe820 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:12.653243 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-438741c8-2f79-432d-a594-6bea059fe820 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:12.653668 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-438741c8-2f79-432d-a594-6bea059fe820 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:12.673173 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-438741c8-2f79-432d-a594-6bea059fe820 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:12.673902 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-438741c8-2f79-432d-a594-6bea059fe820 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:12.674657 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-438741c8-2f79-432d-a594-6bea059fe820 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:12.786362 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-438741c8-2f79-432d-a594-6bea059fe820 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:12.801291 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-438741c8-2f79-432d-a594-6bea059fe820 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:12.807169 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-438741c8-2f79-432d-a594-6bea059fe820 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:12.818350 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-438741c8-2f79-432d-a594-6bea059fe820 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1335 microversion: 2.57 time: 0.180018 Aug 22 17:24:12.821530 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 916/1829] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:12 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1335 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:13.032935 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-357395f8-44ef-48af-bb03-1dcfc703627d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:13.034364 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-357395f8-44ef-48af-bb03-1dcfc703627d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:13.045357 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:13.048613 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-357395f8-44ef-48af-bb03-1dcfc703627d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:13.060375 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-357395f8-44ef-48af-bb03-1dcfc703627d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:13.061194 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-357395f8-44ef-48af-bb03-1dcfc703627d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:13.075640 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-357395f8-44ef-48af-bb03-1dcfc703627d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:13.076506 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-357395f8-44ef-48af-bb03-1dcfc703627d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:13.082377 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-357395f8-44ef-48af-bb03-1dcfc703627d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:13.105550 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=10 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:13.267545 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-357395f8-44ef-48af-bb03-1dcfc703627d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:13.280069 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-357395f8-44ef-48af-bb03-1dcfc703627d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:13.287662 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-357395f8-44ef-48af-bb03-1dcfc703627d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:13.292953 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-357395f8-44ef-48af-bb03-1dcfc703627d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.261602 Aug 22 17:24:13.294090 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 914/1830] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:13 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:13.844351 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b2d12548-6633-4fd3-8ed1-e01ec83696b8 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:13.846089 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b2d12548-6633-4fd3-8ed1-e01ec83696b8 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:13.852802 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b2d12548-6633-4fd3-8ed1-e01ec83696b8 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:13.858086 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b2d12548-6633-4fd3-8ed1-e01ec83696b8 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:13.859860 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b2d12548-6633-4fd3-8ed1-e01ec83696b8 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:13.860811 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b2d12548-6633-4fd3-8ed1-e01ec83696b8 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:13.864390 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b2d12548-6633-4fd3-8ed1-e01ec83696b8 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:13.865055 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b2d12548-6633-4fd3-8ed1-e01ec83696b8 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:13.989607 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b2d12548-6633-4fd3-8ed1-e01ec83696b8 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:14.000784 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b2d12548-6633-4fd3-8ed1-e01ec83696b8 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:14.003559 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-b2d12548-6633-4fd3-8ed1-e01ec83696b8 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:14.011254 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b2d12548-6633-4fd3-8ed1-e01ec83696b8 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1356 microversion: 2.57 time: 0.171131 Aug 22 17:24:14.015369 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 917/1831] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:13 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1356 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:14.042631 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:24:14.047825 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:14.066434 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:14.070884 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:14.071486 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:14.074029 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:14.074642 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:14.075212 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:14.316524 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:24:14.316987 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:24:14.317501 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:24:14.317948 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:24:14.318371 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:24:14.321153 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cb9b78bd-f977-41ef-a827-51364179af93 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:14.321805 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-cb9b78bd-f977-41ef-a827-51364179af93 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:14.336321 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cb9b78bd-f977-41ef-a827-51364179af93 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:14.336833 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cb9b78bd-f977-41ef-a827-51364179af93 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:14.337334 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cb9b78bd-f977-41ef-a827-51364179af93 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:14.342133 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cb9b78bd-f977-41ef-a827-51364179af93 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:14.342639 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cb9b78bd-f977-41ef-a827-51364179af93 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:14.345548 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cb9b78bd-f977-41ef-a827-51364179af93 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:14.722658 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-cb9b78bd-f977-41ef-a827-51364179af93 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:14.743753 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-cb9b78bd-f977-41ef-a827-51364179af93 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:14.746391 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-cb9b78bd-f977-41ef-a827-51364179af93 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:14.765012 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-cb9b78bd-f977-41ef-a827-51364179af93 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.442028 Aug 22 17:24:14.765886 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 918/1832] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:14 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:14.798723 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:14.822252 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:14.824442 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:14.827907 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:14.831450 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:14.832259 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:14.833801 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:14.921240 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c42cf42b-eaca-472b-9842-67b49f489423 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "POST /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702/action" status: 202 len: 1137 microversion: 2.57 time: 0.883045 Aug 22 17:24:14.934243 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 915/1833] 10.222.0.96 () {62 vars in 1320 bytes} [Mon Aug 22 17:24:14 2022] POST /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702/action => generated 1137 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 22 17:24:14.945515 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8590a920-62e5-4d70-9202-5ee8484c337a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:14.946806 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8590a920-62e5-4d70-9202-5ee8484c337a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:14.954032 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8590a920-62e5-4d70-9202-5ee8484c337a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:14.955199 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8590a920-62e5-4d70-9202-5ee8484c337a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:14.955877 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8590a920-62e5-4d70-9202-5ee8484c337a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:14.956918 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8590a920-62e5-4d70-9202-5ee8484c337a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:14.957618 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8590a920-62e5-4d70-9202-5ee8484c337a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:14.958273 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8590a920-62e5-4d70-9202-5ee8484c337a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:15.047023 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:15.784978 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:15.791423 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9b079642-cdd3-4442-80c0-d9def9f34900 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:15.793182 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-9b079642-cdd3-4442-80c0-d9def9f34900 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:15.816758 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b079642-cdd3-4442-80c0-d9def9f34900 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:15.817574 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b079642-cdd3-4442-80c0-d9def9f34900 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:15.818177 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b079642-cdd3-4442-80c0-d9def9f34900 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:15.819135 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b079642-cdd3-4442-80c0-d9def9f34900 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:15.819782 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b079642-cdd3-4442-80c0-d9def9f34900 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:15.820391 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9b079642-cdd3-4442-80c0-d9def9f34900 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:15.844887 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8590a920-62e5-4d70-9202-5ee8484c337a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:15.855180 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8590a920-62e5-4d70-9202-5ee8484c337a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:15.864431 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8590a920-62e5-4d70-9202-5ee8484c337a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:15.868049 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8590a920-62e5-4d70-9202-5ee8484c337a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.926744 Aug 22 17:24:15.885593 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 919/1834] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:14 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:16.044840 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9b079642-cdd3-4442-80c0-d9def9f34900 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:16.068248 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9b079642-cdd3-4442-80c0-d9def9f34900 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:16.070202 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9b079642-cdd3-4442-80c0-d9def9f34900 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:16.071430 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9b079642-cdd3-4442-80c0-d9def9f34900 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.285136 Aug 22 17:24:16.072194 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 916/1835] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:15 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:16.893684 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-897a248c-c159-4461-a706-6e1769079fcb tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:16.895452 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-897a248c-c159-4461-a706-6e1769079fcb tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:16.907268 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-897a248c-c159-4461-a706-6e1769079fcb tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:16.913912 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-897a248c-c159-4461-a706-6e1769079fcb tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:16.916143 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-897a248c-c159-4461-a706-6e1769079fcb tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:16.919568 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-897a248c-c159-4461-a706-6e1769079fcb tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:16.920561 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-897a248c-c159-4461-a706-6e1769079fcb tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:16.922101 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-897a248c-c159-4461-a706-6e1769079fcb tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:17.095917 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c99a5b0e-32fc-4b97-9da7-eca2411110d1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:17.096645 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c99a5b0e-32fc-4b97-9da7-eca2411110d1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:17.111753 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c99a5b0e-32fc-4b97-9da7-eca2411110d1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:17.119592 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c99a5b0e-32fc-4b97-9da7-eca2411110d1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:17.121595 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c99a5b0e-32fc-4b97-9da7-eca2411110d1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:17.123852 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-897a248c-c159-4461-a706-6e1769079fcb tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:17.125497 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c99a5b0e-32fc-4b97-9da7-eca2411110d1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:17.126771 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c99a5b0e-32fc-4b97-9da7-eca2411110d1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:17.128588 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c99a5b0e-32fc-4b97-9da7-eca2411110d1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:17.139074 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-897a248c-c159-4461-a706-6e1769079fcb tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:17.147372 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-897a248c-c159-4461-a706-6e1769079fcb tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:17.147372 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-897a248c-c159-4461-a706-6e1769079fcb tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.256729 Aug 22 17:24:17.148204 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 920/1836] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:16 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:24:17.235304 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c99a5b0e-32fc-4b97-9da7-eca2411110d1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:17.252472 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c99a5b0e-32fc-4b97-9da7-eca2411110d1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:17.254576 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c99a5b0e-32fc-4b97-9da7-eca2411110d1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:17.256077 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c99a5b0e-32fc-4b97-9da7-eca2411110d1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.164144 Aug 22 17:24:17.256656 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 917/1837] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:17 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:18.180472 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e7f2705a-0811-49dd-9dc9-f91dff0312ad tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:18.183519 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-e7f2705a-0811-49dd-9dc9-f91dff0312ad tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:18.194160 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e7f2705a-0811-49dd-9dc9-f91dff0312ad tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:18.195688 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e7f2705a-0811-49dd-9dc9-f91dff0312ad tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:18.196323 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e7f2705a-0811-49dd-9dc9-f91dff0312ad tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:18.199628 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e7f2705a-0811-49dd-9dc9-f91dff0312ad tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:18.200682 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e7f2705a-0811-49dd-9dc9-f91dff0312ad tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:18.202034 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e7f2705a-0811-49dd-9dc9-f91dff0312ad tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:18.281395 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5060a025-71cd-4bf7-8b61-85b5dcd19888 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:18.282172 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5060a025-71cd-4bf7-8b61-85b5dcd19888 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:18.299047 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5060a025-71cd-4bf7-8b61-85b5dcd19888 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:18.300000 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5060a025-71cd-4bf7-8b61-85b5dcd19888 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:18.304156 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5060a025-71cd-4bf7-8b61-85b5dcd19888 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:18.305373 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5060a025-71cd-4bf7-8b61-85b5dcd19888 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:18.307163 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5060a025-71cd-4bf7-8b61-85b5dcd19888 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:18.311309 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5060a025-71cd-4bf7-8b61-85b5dcd19888 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:18.479450 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e7f2705a-0811-49dd-9dc9-f91dff0312ad tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:18.496113 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e7f2705a-0811-49dd-9dc9-f91dff0312ad tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:18.498032 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e7f2705a-0811-49dd-9dc9-f91dff0312ad tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:18.501035 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e7f2705a-0811-49dd-9dc9-f91dff0312ad tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.329239 Aug 22 17:24:18.502398 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 921/1838] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:18 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:18.986772 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-5060a025-71cd-4bf7-8b61-85b5dcd19888 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:19.000563 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-5060a025-71cd-4bf7-8b61-85b5dcd19888 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:19.002728 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-5060a025-71cd-4bf7-8b61-85b5dcd19888 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:19.009186 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5060a025-71cd-4bf7-8b61-85b5dcd19888 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.731040 Aug 22 17:24:19.013310 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 918/1839] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:18 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:19.528648 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c678ea24-1319-486d-8931-616653decd3b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:19.529383 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-c678ea24-1319-486d-8931-616653decd3b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:19.536250 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5060a025-71cd-4bf7-8b61-85b5dcd19888 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:19.541100 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5060a025-71cd-4bf7-8b61-85b5dcd19888 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001304 Aug 22 17:24:19.541100 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 919/1840] 10.222.0.96 () {56 vars in 886 bytes} [Mon Aug 22 17:24:19 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 22 17:24:19.546711 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c678ea24-1319-486d-8931-616653decd3b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:19.548084 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c678ea24-1319-486d-8931-616653decd3b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:19.549524 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c678ea24-1319-486d-8931-616653decd3b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:19.551823 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c678ea24-1319-486d-8931-616653decd3b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:19.552471 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c678ea24-1319-486d-8931-616653decd3b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:19.556977 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c678ea24-1319-486d-8931-616653decd3b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:19.711362 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c678ea24-1319-486d-8931-616653decd3b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:19.728575 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c678ea24-1319-486d-8931-616653decd3b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:19.735226 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c678ea24-1319-486d-8931-616653decd3b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:19.736940 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c678ea24-1319-486d-8931-616653decd3b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.213011 Aug 22 17:24:19.753448 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 922/1841] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:19 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:20.038962 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-de7b3197-f62c-4762-ae4f-b11399a37c0b tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:20.040090 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-de7b3197-f62c-4762-ae4f-b11399a37c0b tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:20.053214 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-de7b3197-f62c-4762-ae4f-b11399a37c0b tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:20.054105 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-de7b3197-f62c-4762-ae4f-b11399a37c0b tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:20.056003 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-de7b3197-f62c-4762-ae4f-b11399a37c0b tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:20.058449 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-de7b3197-f62c-4762-ae4f-b11399a37c0b tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:20.060257 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-de7b3197-f62c-4762-ae4f-b11399a37c0b tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:20.061014 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-de7b3197-f62c-4762-ae4f-b11399a37c0b tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:20.162561 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-de7b3197-f62c-4762-ae4f-b11399a37c0b tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:20.175197 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-de7b3197-f62c-4762-ae4f-b11399a37c0b tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:20.176721 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-de7b3197-f62c-4762-ae4f-b11399a37c0b tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:20.178440 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-de7b3197-f62c-4762-ae4f-b11399a37c0b tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.143472 Aug 22 17:24:20.180385 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 920/1842] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:20 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:20.772018 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-211bc637-9bb1-4d1c-800b-b9528a95bb7b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:20.773758 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-211bc637-9bb1-4d1c-800b-b9528a95bb7b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:20.794180 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-211bc637-9bb1-4d1c-800b-b9528a95bb7b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:20.809681 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-211bc637-9bb1-4d1c-800b-b9528a95bb7b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:20.811377 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-211bc637-9bb1-4d1c-800b-b9528a95bb7b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:20.814852 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-211bc637-9bb1-4d1c-800b-b9528a95bb7b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:20.815470 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-211bc637-9bb1-4d1c-800b-b9528a95bb7b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:20.815988 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-211bc637-9bb1-4d1c-800b-b9528a95bb7b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:21.044996 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-211bc637-9bb1-4d1c-800b-b9528a95bb7b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:21.075141 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-211bc637-9bb1-4d1c-800b-b9528a95bb7b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:21.086921 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-211bc637-9bb1-4d1c-800b-b9528a95bb7b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:21.095955 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-211bc637-9bb1-4d1c-800b-b9528a95bb7b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.329346 Aug 22 17:24:21.097954 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 923/1843] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:20 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:21.203610 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-cea59d37-a576-4dea-b8ee-4936974931ee tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:21.207851 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-cea59d37-a576-4dea-b8ee-4936974931ee tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:21.222234 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cea59d37-a576-4dea-b8ee-4936974931ee tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:21.222741 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cea59d37-a576-4dea-b8ee-4936974931ee tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:21.223179 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cea59d37-a576-4dea-b8ee-4936974931ee tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:21.232421 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cea59d37-a576-4dea-b8ee-4936974931ee tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:21.234045 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cea59d37-a576-4dea-b8ee-4936974931ee tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:21.234496 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cea59d37-a576-4dea-b8ee-4936974931ee tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:21.446887 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-cea59d37-a576-4dea-b8ee-4936974931ee tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:21.465743 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-cea59d37-a576-4dea-b8ee-4936974931ee tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:21.470469 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-cea59d37-a576-4dea-b8ee-4936974931ee tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:21.474727 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-cea59d37-a576-4dea-b8ee-4936974931ee tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.275198 Aug 22 17:24:21.477800 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 921/1844] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:21 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:22.123013 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-04bbeade-2776-4fa8-a843-84bffec7ce7c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:22.123956 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-04bbeade-2776-4fa8-a843-84bffec7ce7c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:22.142169 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-04bbeade-2776-4fa8-a843-84bffec7ce7c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:22.142678 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-04bbeade-2776-4fa8-a843-84bffec7ce7c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:22.146941 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-04bbeade-2776-4fa8-a843-84bffec7ce7c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:22.149788 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-04bbeade-2776-4fa8-a843-84bffec7ce7c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:22.150861 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-04bbeade-2776-4fa8-a843-84bffec7ce7c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:22.153890 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-04bbeade-2776-4fa8-a843-84bffec7ce7c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:22.292339 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-04bbeade-2776-4fa8-a843-84bffec7ce7c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:22.318844 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-04bbeade-2776-4fa8-a843-84bffec7ce7c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:22.353330 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-04bbeade-2776-4fa8-a843-84bffec7ce7c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:22.374068 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-04bbeade-2776-4fa8-a843-84bffec7ce7c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.250675 Aug 22 17:24:22.379903 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 924/1845] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:22 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:22.502653 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-19fc149d-9106-4761-9267-a951ae6cdd1d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:22.504057 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-19fc149d-9106-4761-9267-a951ae6cdd1d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:22.564892 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19fc149d-9106-4761-9267-a951ae6cdd1d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:22.570633 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19fc149d-9106-4761-9267-a951ae6cdd1d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:22.571246 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19fc149d-9106-4761-9267-a951ae6cdd1d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:22.572672 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19fc149d-9106-4761-9267-a951ae6cdd1d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:22.577625 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19fc149d-9106-4761-9267-a951ae6cdd1d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:22.578527 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-19fc149d-9106-4761-9267-a951ae6cdd1d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:22.857766 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-19fc149d-9106-4761-9267-a951ae6cdd1d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:22.874387 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-19fc149d-9106-4761-9267-a951ae6cdd1d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:22.876382 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-19fc149d-9106-4761-9267-a951ae6cdd1d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:22.878077 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-19fc149d-9106-4761-9267-a951ae6cdd1d tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.381412 Aug 22 17:24:22.881401 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 922/1846] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:22 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:23.410132 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e9b1e5e3-0432-4b9c-8a59-da7601ee05d6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:23.410758 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-e9b1e5e3-0432-4b9c-8a59-da7601ee05d6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:23.426414 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e9b1e5e3-0432-4b9c-8a59-da7601ee05d6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:23.428772 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e9b1e5e3-0432-4b9c-8a59-da7601ee05d6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:23.428772 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e9b1e5e3-0432-4b9c-8a59-da7601ee05d6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:23.428772 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e9b1e5e3-0432-4b9c-8a59-da7601ee05d6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:23.428772 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e9b1e5e3-0432-4b9c-8a59-da7601ee05d6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:23.429450 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e9b1e5e3-0432-4b9c-8a59-da7601ee05d6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:23.613272 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e9b1e5e3-0432-4b9c-8a59-da7601ee05d6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:23.626879 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e9b1e5e3-0432-4b9c-8a59-da7601ee05d6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:23.660940 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e9b1e5e3-0432-4b9c-8a59-da7601ee05d6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:23.665392 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e9b1e5e3-0432-4b9c-8a59-da7601ee05d6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.264860 Aug 22 17:24:23.669223 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 925/1847] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:23 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:23.907786 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2c9527b3-45a8-4910-bfc0-89cff587ce69 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:23.910839 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-2c9527b3-45a8-4910-bfc0-89cff587ce69 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:23.928453 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2c9527b3-45a8-4910-bfc0-89cff587ce69 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:23.929783 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2c9527b3-45a8-4910-bfc0-89cff587ce69 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:23.939543 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2c9527b3-45a8-4910-bfc0-89cff587ce69 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:23.939543 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2c9527b3-45a8-4910-bfc0-89cff587ce69 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:23.939543 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2c9527b3-45a8-4910-bfc0-89cff587ce69 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:23.939543 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2c9527b3-45a8-4910-bfc0-89cff587ce69 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:24.408080 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-2c9527b3-45a8-4910-bfc0-89cff587ce69 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:24.422974 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-2c9527b3-45a8-4910-bfc0-89cff587ce69 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:24.426494 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-2c9527b3-45a8-4910-bfc0-89cff587ce69 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:24.429870 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2c9527b3-45a8-4910-bfc0-89cff587ce69 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.529552 Aug 22 17:24:24.431462 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 923/1848] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:23 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:24.694546 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-92d7a83d-a46a-45ec-91ee-1a38d0bf001d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:24.695800 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-92d7a83d-a46a-45ec-91ee-1a38d0bf001d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:24.703046 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-92d7a83d-a46a-45ec-91ee-1a38d0bf001d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:24.703573 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-92d7a83d-a46a-45ec-91ee-1a38d0bf001d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:24.704274 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-92d7a83d-a46a-45ec-91ee-1a38d0bf001d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:24.705127 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-92d7a83d-a46a-45ec-91ee-1a38d0bf001d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:24.706078 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-92d7a83d-a46a-45ec-91ee-1a38d0bf001d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:24.706681 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-92d7a83d-a46a-45ec-91ee-1a38d0bf001d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:24.782015 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-92d7a83d-a46a-45ec-91ee-1a38d0bf001d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:24.793650 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-92d7a83d-a46a-45ec-91ee-1a38d0bf001d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:24.795333 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-92d7a83d-a46a-45ec-91ee-1a38d0bf001d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:24.799005 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-92d7a83d-a46a-45ec-91ee-1a38d0bf001d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.106382 Aug 22 17:24:24.799005 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 926/1849] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:24 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:25.458796 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c5e3d6d6-1509-4cf9-bd77-30902d738569 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:25.459491 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-c5e3d6d6-1509-4cf9-bd77-30902d738569 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:25.476853 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c5e3d6d6-1509-4cf9-bd77-30902d738569 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:25.478066 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c5e3d6d6-1509-4cf9-bd77-30902d738569 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:25.478516 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c5e3d6d6-1509-4cf9-bd77-30902d738569 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:25.480438 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c5e3d6d6-1509-4cf9-bd77-30902d738569 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:25.481125 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c5e3d6d6-1509-4cf9-bd77-30902d738569 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:25.481734 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c5e3d6d6-1509-4cf9-bd77-30902d738569 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:25.590357 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c5e3d6d6-1509-4cf9-bd77-30902d738569 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:25.621618 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c5e3d6d6-1509-4cf9-bd77-30902d738569 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:25.621618 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-c5e3d6d6-1509-4cf9-bd77-30902d738569 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:25.630039 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c5e3d6d6-1509-4cf9-bd77-30902d738569 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.163481 Aug 22 17:24:25.653243 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 924/1850] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:25 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:25.821476 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6afa9875-c2b1-4de9-a35f-d2df431ecee0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:25.822400 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-6afa9875-c2b1-4de9-a35f-d2df431ecee0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:25.838189 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6afa9875-c2b1-4de9-a35f-d2df431ecee0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:25.840047 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6afa9875-c2b1-4de9-a35f-d2df431ecee0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:25.840669 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6afa9875-c2b1-4de9-a35f-d2df431ecee0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:25.841471 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6afa9875-c2b1-4de9-a35f-d2df431ecee0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:25.841932 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6afa9875-c2b1-4de9-a35f-d2df431ecee0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:25.842472 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-6afa9875-c2b1-4de9-a35f-d2df431ecee0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:25.919710 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6afa9875-c2b1-4de9-a35f-d2df431ecee0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:25.928879 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6afa9875-c2b1-4de9-a35f-d2df431ecee0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:25.930580 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-6afa9875-c2b1-4de9-a35f-d2df431ecee0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:25.931787 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6afa9875-c2b1-4de9-a35f-d2df431ecee0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.114541 Aug 22 17:24:25.932841 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 927/1851] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:25 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:26.658659 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e138d028-6bd4-4242-876b-d045d8db916c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:26.659271 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e138d028-6bd4-4242-876b-d045d8db916c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:26.669504 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e138d028-6bd4-4242-876b-d045d8db916c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:26.681979 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e138d028-6bd4-4242-876b-d045d8db916c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:26.688817 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e138d028-6bd4-4242-876b-d045d8db916c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:26.690136 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e138d028-6bd4-4242-876b-d045d8db916c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:26.692281 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e138d028-6bd4-4242-876b-d045d8db916c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:26.693003 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e138d028-6bd4-4242-876b-d045d8db916c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:26.722950 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:26.924487 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e138d028-6bd4-4242-876b-d045d8db916c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:26.941307 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e138d028-6bd4-4242-876b-d045d8db916c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:26.945311 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e138d028-6bd4-4242-876b-d045d8db916c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:26.946919 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e138d028-6bd4-4242-876b-d045d8db916c tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.292480 Aug 22 17:24:26.961976 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 925/1852] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:26 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:26.971033 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-90b4ddbb-cb52-4ca2-b69c-8743c565c816 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:26.971033 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-90b4ddbb-cb52-4ca2-b69c-8743c565c816 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:26.971033 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:26.977124 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-90b4ddbb-cb52-4ca2-b69c-8743c565c816 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:26.977618 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-90b4ddbb-cb52-4ca2-b69c-8743c565c816 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:26.978051 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-90b4ddbb-cb52-4ca2-b69c-8743c565c816 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:26.982132 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-90b4ddbb-cb52-4ca2-b69c-8743c565c816 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:26.982619 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-90b4ddbb-cb52-4ca2-b69c-8743c565c816 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:26.983056 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-90b4ddbb-cb52-4ca2-b69c-8743c565c816 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:27.143514 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-90b4ddbb-cb52-4ca2-b69c-8743c565c816 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:27.155780 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-90b4ddbb-cb52-4ca2-b69c-8743c565c816 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:27.158518 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-90b4ddbb-cb52-4ca2-b69c-8743c565c816 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:27.160030 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-90b4ddbb-cb52-4ca2-b69c-8743c565c816 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.207986 Aug 22 17:24:27.161195 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 928/1853] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:26 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:27.993932 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a22dd803-d4e2-459b-991d-557d887a4317 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:27.993932 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-a22dd803-d4e2-459b-991d-557d887a4317 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:27.998998 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a22dd803-d4e2-459b-991d-557d887a4317 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:27.999982 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a22dd803-d4e2-459b-991d-557d887a4317 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:28.000651 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a22dd803-d4e2-459b-991d-557d887a4317 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:28.001660 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a22dd803-d4e2-459b-991d-557d887a4317 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:28.002315 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a22dd803-d4e2-459b-991d-557d887a4317 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:28.002909 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a22dd803-d4e2-459b-991d-557d887a4317 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:28.186258 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4aacc2f5-2f48-4f5b-8d45-f6ad67eebc86 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:28.186949 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-4aacc2f5-2f48-4f5b-8d45-f6ad67eebc86 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:28.195568 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4aacc2f5-2f48-4f5b-8d45-f6ad67eebc86 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:28.196215 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4aacc2f5-2f48-4f5b-8d45-f6ad67eebc86 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:28.197069 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4aacc2f5-2f48-4f5b-8d45-f6ad67eebc86 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:28.198886 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4aacc2f5-2f48-4f5b-8d45-f6ad67eebc86 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:28.200064 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4aacc2f5-2f48-4f5b-8d45-f6ad67eebc86 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:28.200747 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4aacc2f5-2f48-4f5b-8d45-f6ad67eebc86 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:28.221018 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a22dd803-d4e2-459b-991d-557d887a4317 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:28.245726 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a22dd803-d4e2-459b-991d-557d887a4317 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:28.250462 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a22dd803-d4e2-459b-991d-557d887a4317 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:28.251720 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a22dd803-d4e2-459b-991d-557d887a4317 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.279937 Aug 22 17:24:28.252328 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 926/1854] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:27 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:28.367254 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-4aacc2f5-2f48-4f5b-8d45-f6ad67eebc86 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:28.380063 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-4aacc2f5-2f48-4f5b-8d45-f6ad67eebc86 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:28.382083 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-4aacc2f5-2f48-4f5b-8d45-f6ad67eebc86 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:28.383714 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-4aacc2f5-2f48-4f5b-8d45-f6ad67eebc86 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.203682 Aug 22 17:24:28.384853 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 929/1855] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:28 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:29.278268 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-03a99b60-842d-4d57-99c3-af70f27d2d43 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:29.278952 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-03a99b60-842d-4d57-99c3-af70f27d2d43 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:29.293106 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-03a99b60-842d-4d57-99c3-af70f27d2d43 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:29.295802 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-03a99b60-842d-4d57-99c3-af70f27d2d43 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:29.302379 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-03a99b60-842d-4d57-99c3-af70f27d2d43 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:29.302379 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-03a99b60-842d-4d57-99c3-af70f27d2d43 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:29.302379 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-03a99b60-842d-4d57-99c3-af70f27d2d43 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:29.302379 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-03a99b60-842d-4d57-99c3-af70f27d2d43 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:29.408791 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c4bba8f2-a702-458e-ad5f-2a141ec025c5 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:29.409677 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-c4bba8f2-a702-458e-ad5f-2a141ec025c5 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:29.429783 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c4bba8f2-a702-458e-ad5f-2a141ec025c5 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:29.430303 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c4bba8f2-a702-458e-ad5f-2a141ec025c5 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:29.431030 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c4bba8f2-a702-458e-ad5f-2a141ec025c5 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:29.431790 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c4bba8f2-a702-458e-ad5f-2a141ec025c5 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:29.432718 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c4bba8f2-a702-458e-ad5f-2a141ec025c5 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:29.432939 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c4bba8f2-a702-458e-ad5f-2a141ec025c5 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:29.520976 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-03a99b60-842d-4d57-99c3-af70f27d2d43 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:29.531723 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-03a99b60-842d-4d57-99c3-af70f27d2d43 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:29.535097 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-03a99b60-842d-4d57-99c3-af70f27d2d43 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:29.537225 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-03a99b60-842d-4d57-99c3-af70f27d2d43 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1365 microversion: 2.47 time: 0.263504 Aug 22 17:24:29.549111 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 927/1856] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:29 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:29.713461 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c4bba8f2-a702-458e-ad5f-2a141ec025c5 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:29.731427 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c4bba8f2-a702-458e-ad5f-2a141ec025c5 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:29.731427 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c4bba8f2-a702-458e-ad5f-2a141ec025c5 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:29.731427 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c4bba8f2-a702-458e-ad5f-2a141ec025c5 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.326788 Aug 22 17:24:29.731720 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 930/1857] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:29 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:30.566166 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-32e43845-a7a8-49ec-86bc-dcea7835faf7 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:30.566784 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-32e43845-a7a8-49ec-86bc-dcea7835faf7 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:30.583159 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-32e43845-a7a8-49ec-86bc-dcea7835faf7 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:30.584654 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-32e43845-a7a8-49ec-86bc-dcea7835faf7 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:30.585337 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-32e43845-a7a8-49ec-86bc-dcea7835faf7 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:30.588026 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-32e43845-a7a8-49ec-86bc-dcea7835faf7 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:30.590764 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-32e43845-a7a8-49ec-86bc-dcea7835faf7 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:30.593872 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-32e43845-a7a8-49ec-86bc-dcea7835faf7 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:30.762363 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ce929fee-a752-484e-8c9e-ef1dba4cfe66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:30.763122 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ce929fee-a752-484e-8c9e-ef1dba4cfe66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:30.785357 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ce929fee-a752-484e-8c9e-ef1dba4cfe66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:30.785357 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ce929fee-a752-484e-8c9e-ef1dba4cfe66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:30.785357 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ce929fee-a752-484e-8c9e-ef1dba4cfe66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:30.786062 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ce929fee-a752-484e-8c9e-ef1dba4cfe66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:30.786242 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ce929fee-a752-484e-8c9e-ef1dba4cfe66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:30.789316 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ce929fee-a752-484e-8c9e-ef1dba4cfe66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:30.796426 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-32e43845-a7a8-49ec-86bc-dcea7835faf7 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:30.828055 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-32e43845-a7a8-49ec-86bc-dcea7835faf7 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:30.833811 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-32e43845-a7a8-49ec-86bc-dcea7835faf7 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:30.835950 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-32e43845-a7a8-49ec-86bc-dcea7835faf7 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1371 microversion: 2.47 time: 0.275474 Aug 22 17:24:30.855474 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 928/1858] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:30 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:30.987120 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ce929fee-a752-484e-8c9e-ef1dba4cfe66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:30.999186 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ce929fee-a752-484e-8c9e-ef1dba4cfe66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:31.000115 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ce929fee-a752-484e-8c9e-ef1dba4cfe66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:31.001624 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ce929fee-a752-484e-8c9e-ef1dba4cfe66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.247000 Aug 22 17:24:31.002262 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 931/1859] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:30 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:31.299178 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-32e43845-a7a8-49ec-86bc-dcea7835faf7 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:31.300263 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-32e43845-a7a8-49ec-86bc-dcea7835faf7 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002881 Aug 22 17:24:31.300560 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 929/1860] 10.222.0.96 () {56 vars in 886 bytes} [Mon Aug 22 17:24:31 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 22 17:24:31.864522 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-bccf73d8-834c-4784-a139-490548b7b40a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:31.874751 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-bccf73d8-834c-4784-a139-490548b7b40a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:31.884576 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bccf73d8-834c-4784-a139-490548b7b40a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:31.886220 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bccf73d8-834c-4784-a139-490548b7b40a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:31.887053 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bccf73d8-834c-4784-a139-490548b7b40a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:31.888281 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bccf73d8-834c-4784-a139-490548b7b40a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:31.888984 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bccf73d8-834c-4784-a139-490548b7b40a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:31.889754 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bccf73d8-834c-4784-a139-490548b7b40a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:31.997255 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-bccf73d8-834c-4784-a139-490548b7b40a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:32.005225 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-bccf73d8-834c-4784-a139-490548b7b40a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:32.007284 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-bccf73d8-834c-4784-a139-490548b7b40a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:32.008891 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-bccf73d8-834c-4784-a139-490548b7b40a tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1371 microversion: 2.47 time: 0.149235 Aug 22 17:24:32.026724 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 932/1861] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:31 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:32.034462 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-323f4441-b449-44cc-8b25-4106cfb506ec tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:32.035253 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-323f4441-b449-44cc-8b25-4106cfb506ec tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:32.047437 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-323f4441-b449-44cc-8b25-4106cfb506ec tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:32.048139 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-323f4441-b449-44cc-8b25-4106cfb506ec tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:32.049095 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-323f4441-b449-44cc-8b25-4106cfb506ec tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:32.050011 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-323f4441-b449-44cc-8b25-4106cfb506ec tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:32.050710 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-323f4441-b449-44cc-8b25-4106cfb506ec tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:32.052164 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-323f4441-b449-44cc-8b25-4106cfb506ec tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:32.333648 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-323f4441-b449-44cc-8b25-4106cfb506ec tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:32.348125 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-323f4441-b449-44cc-8b25-4106cfb506ec tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:32.355473 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-323f4441-b449-44cc-8b25-4106cfb506ec tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:32.356765 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-323f4441-b449-44cc-8b25-4106cfb506ec tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.332340 Aug 22 17:24:32.357414 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 930/1862] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:32 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:33.037523 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cd2007e7-88ac-402e-84b9-7bf566560da8 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:33.038308 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-cd2007e7-88ac-402e-84b9-7bf566560da8 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:33.067606 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cd2007e7-88ac-402e-84b9-7bf566560da8 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:33.068866 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cd2007e7-88ac-402e-84b9-7bf566560da8 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:33.072490 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cd2007e7-88ac-402e-84b9-7bf566560da8 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:33.073981 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cd2007e7-88ac-402e-84b9-7bf566560da8 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:33.074637 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cd2007e7-88ac-402e-84b9-7bf566560da8 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:33.075381 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cd2007e7-88ac-402e-84b9-7bf566560da8 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:33.392108 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9f1fec39-5834-479a-aac0-7aba5bc83f32 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:33.396525 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-9f1fec39-5834-479a-aac0-7aba5bc83f32 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:33.406445 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:33.432367 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9f1fec39-5834-479a-aac0-7aba5bc83f32 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:33.439840 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9f1fec39-5834-479a-aac0-7aba5bc83f32 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:33.441100 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9f1fec39-5834-479a-aac0-7aba5bc83f32 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:33.442901 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9f1fec39-5834-479a-aac0-7aba5bc83f32 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:33.446009 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9f1fec39-5834-479a-aac0-7aba5bc83f32 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:33.452508 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-cd2007e7-88ac-402e-84b9-7bf566560da8 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:33.466881 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-9f1fec39-5834-479a-aac0-7aba5bc83f32 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:33.493620 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-cd2007e7-88ac-402e-84b9-7bf566560da8 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:33.507545 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-cd2007e7-88ac-402e-84b9-7bf566560da8 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:33.511738 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-cd2007e7-88ac-402e-84b9-7bf566560da8 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1356 microversion: 2.47 time: 0.477945 Aug 22 17:24:33.514408 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 933/1863] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:33 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1356 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:33.553301 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9b1c4a05-b09a-4bc1-a008-c02816c0cd62 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:33.569549 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9b1c4a05-b09a-4bc1-a008-c02816c0cd62 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:33.581123 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9b1c4a05-b09a-4bc1-a008-c02816c0cd62 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Searching by: {'deleted': False, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0'} {{(pid=123015) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 22 17:24:33.604727 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b1c4a05-b09a-4bc1-a008-c02816c0cd62 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:33.604727 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b1c4a05-b09a-4bc1-a008-c02816c0cd62 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:33.604727 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b1c4a05-b09a-4bc1-a008-c02816c0cd62 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:33.605425 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b1c4a05-b09a-4bc1-a008-c02816c0cd62 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:33.605425 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b1c4a05-b09a-4bc1-a008-c02816c0cd62 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:33.606052 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b1c4a05-b09a-4bc1-a008-c02816c0cd62 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:33.662914 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9f1fec39-5834-479a-aac0-7aba5bc83f32 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:33.678271 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9f1fec39-5834-479a-aac0-7aba5bc83f32 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:33.680538 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-9f1fec39-5834-479a-aac0-7aba5bc83f32 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:33.686665 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9f1fec39-5834-479a-aac0-7aba5bc83f32 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.305727 Aug 22 17:24:33.694576 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 931/1864] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:33 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:33.828584 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.multi_cell_list [None req-9b1c4a05-b09a-4bc1-a008-c02816c0cd62 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123015) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 22 17:24:33.963287 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9b1c4a05-b09a-4bc1-a008-c02816c0cd62 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:33.981118 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b1c4a05-b09a-4bc1-a008-c02816c0cd62 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:33.981620 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b1c4a05-b09a-4bc1-a008-c02816c0cd62 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:33.982055 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9b1c4a05-b09a-4bc1-a008-c02816c0cd62 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:33.994489 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9b1c4a05-b09a-4bc1-a008-c02816c0cd62 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:33.997278 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9b1c4a05-b09a-4bc1-a008-c02816c0cd62 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:34.202165 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9b1c4a05-b09a-4bc1-a008-c02816c0cd62 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.663422 Aug 22 17:24:34.203427 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 934/1865] 10.222.0.96 () {60 vars in 1187 bytes} [Mon Aug 22 17:24:33 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:34.231447 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-83e51021-afb9-47bd-823a-5a5c068030bd tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:34.231781 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-83e51021-afb9-47bd-823a-5a5c068030bd tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:34.239079 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83e51021-afb9-47bd-823a-5a5c068030bd tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:34.242086 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83e51021-afb9-47bd-823a-5a5c068030bd tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:34.242824 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83e51021-afb9-47bd-823a-5a5c068030bd tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:34.246086 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83e51021-afb9-47bd-823a-5a5c068030bd tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:34.246854 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83e51021-afb9-47bd-823a-5a5c068030bd tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:34.247522 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-83e51021-afb9-47bd-823a-5a5c068030bd tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:34.308737 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-83e51021-afb9-47bd-823a-5a5c068030bd tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Going to try to terminate instance {{(pid=123016) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:24:34.718091 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-4fa6cfc1-6c3b-40c6-bad3-ce77f518ef1b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:34.718657 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-4fa6cfc1-6c3b-40c6-bad3-ce77f518ef1b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:34.728658 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4fa6cfc1-6c3b-40c6-bad3-ce77f518ef1b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:34.729765 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4fa6cfc1-6c3b-40c6-bad3-ce77f518ef1b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:34.731376 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4fa6cfc1-6c3b-40c6-bad3-ce77f518ef1b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:34.733775 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4fa6cfc1-6c3b-40c6-bad3-ce77f518ef1b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:34.734329 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4fa6cfc1-6c3b-40c6-bad3-ce77f518ef1b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:34.735528 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-4fa6cfc1-6c3b-40c6-bad3-ce77f518ef1b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:34.777658 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=100 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:34.801379 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-83e51021-afb9-47bd-823a-5a5c068030bd tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "DELETE /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 204 len: 0 microversion: 2.47 time: 0.573143 Aug 22 17:24:34.801379 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 932/1866] 10.222.0.96 () {60 vars in 1280 bytes} [Mon Aug 22 17:24:34 2022] DELETE /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 17:24:34.820718 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-edcf826a-e839-4662-b50f-4065e0482bfc tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:34.821711 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-edcf826a-e839-4662-b50f-4065e0482bfc tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:34.842905 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-edcf826a-e839-4662-b50f-4065e0482bfc tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:34.843623 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-edcf826a-e839-4662-b50f-4065e0482bfc tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:34.844951 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-edcf826a-e839-4662-b50f-4065e0482bfc tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:34.848900 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-edcf826a-e839-4662-b50f-4065e0482bfc tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:34.849609 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-edcf826a-e839-4662-b50f-4065e0482bfc tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:34.850113 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-edcf826a-e839-4662-b50f-4065e0482bfc tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:34.939807 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-4fa6cfc1-6c3b-40c6-bad3-ce77f518ef1b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:34.951683 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-4fa6cfc1-6c3b-40c6-bad3-ce77f518ef1b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:34.953587 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-4fa6cfc1-6c3b-40c6-bad3-ce77f518ef1b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:34.955907 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-4fa6cfc1-6c3b-40c6-bad3-ce77f518ef1b tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.244841 Aug 22 17:24:34.957140 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 935/1867] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:34 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:24:35.055330 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-edcf826a-e839-4662-b50f-4065e0482bfc tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:35.070803 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-edcf826a-e839-4662-b50f-4065e0482bfc tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:35.075791 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-edcf826a-e839-4662-b50f-4065e0482bfc tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:35.093978 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-edcf826a-e839-4662-b50f-4065e0482bfc tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1362 microversion: 2.47 time: 0.272762 Aug 22 17:24:35.093978 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 933/1868] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:34 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:24:35.995515 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-78684841-5b04-449d-b592-9fc1fd3a1e66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:35.996139 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-78684841-5b04-449d-b592-9fc1fd3a1e66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:36.008067 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78684841-5b04-449d-b592-9fc1fd3a1e66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:36.008554 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78684841-5b04-449d-b592-9fc1fd3a1e66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:36.008990 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78684841-5b04-449d-b592-9fc1fd3a1e66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:36.013891 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78684841-5b04-449d-b592-9fc1fd3a1e66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:36.014639 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78684841-5b04-449d-b592-9fc1fd3a1e66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:36.023717 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-78684841-5b04-449d-b592-9fc1fd3a1e66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:36.102097 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b870de6e-2209-4340-bf44-f00651916c84 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:36.105662 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-b870de6e-2209-4340-bf44-f00651916c84 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:36.122554 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b870de6e-2209-4340-bf44-f00651916c84 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:36.123162 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b870de6e-2209-4340-bf44-f00651916c84 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:36.123614 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b870de6e-2209-4340-bf44-f00651916c84 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:36.124366 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b870de6e-2209-4340-bf44-f00651916c84 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:36.127761 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b870de6e-2209-4340-bf44-f00651916c84 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:36.128263 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-b870de6e-2209-4340-bf44-f00651916c84 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:36.263710 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b870de6e-2209-4340-bf44-f00651916c84 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:36.275356 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b870de6e-2209-4340-bf44-f00651916c84 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:36.283939 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-b870de6e-2209-4340-bf44-f00651916c84 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:36.285273 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b870de6e-2209-4340-bf44-f00651916c84 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1362 microversion: 2.47 time: 0.187636 Aug 22 17:24:36.288811 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 934/1869] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:36 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:24:36.306414 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-78684841-5b04-449d-b592-9fc1fd3a1e66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:36.314405 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-78684841-5b04-449d-b592-9fc1fd3a1e66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:36.317467 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-78684841-5b04-449d-b592-9fc1fd3a1e66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:36.317467 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-78684841-5b04-449d-b592-9fc1fd3a1e66 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.332243 Aug 22 17:24:36.318551 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 936/1870] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:35 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:37.311877 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a8a694b1-3dfa-4e1e-b3bd-6421201f52a0 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:37.315106 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-a8a694b1-3dfa-4e1e-b3bd-6421201f52a0 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:37.335834 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8a694b1-3dfa-4e1e-b3bd-6421201f52a0 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:37.335834 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8a694b1-3dfa-4e1e-b3bd-6421201f52a0 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:37.335834 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8a694b1-3dfa-4e1e-b3bd-6421201f52a0 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:37.335834 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8a694b1-3dfa-4e1e-b3bd-6421201f52a0 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:37.337101 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8a694b1-3dfa-4e1e-b3bd-6421201f52a0 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:37.337565 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8a694b1-3dfa-4e1e-b3bd-6421201f52a0 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:37.345332 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ee0d61a0-ecb9-4d46-8104-b55a5f41b263 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:37.345953 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ee0d61a0-ecb9-4d46-8104-b55a5f41b263 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:37.364259 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ee0d61a0-ecb9-4d46-8104-b55a5f41b263 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:37.364259 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ee0d61a0-ecb9-4d46-8104-b55a5f41b263 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:37.364259 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ee0d61a0-ecb9-4d46-8104-b55a5f41b263 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:37.364259 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ee0d61a0-ecb9-4d46-8104-b55a5f41b263 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:37.364259 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ee0d61a0-ecb9-4d46-8104-b55a5f41b263 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:37.364259 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ee0d61a0-ecb9-4d46-8104-b55a5f41b263 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:37.440880 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8a694b1-3dfa-4e1e-b3bd-6421201f52a0 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:37.448545 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8a694b1-3dfa-4e1e-b3bd-6421201f52a0 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:37.448545 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8a694b1-3dfa-4e1e-b3bd-6421201f52a0 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:37.448545 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.instance [None req-a8a694b1-3dfa-4e1e-b3bd-6421201f52a0 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lazy-loading 'fault' on Instance uuid fa0cfdfa-dd6b-437b-946e-e08fd925e833 {{(pid=123016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:24:37.530799 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a8a694b1-3dfa-4e1e-b3bd-6421201f52a0 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:37.540247 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a8a694b1-3dfa-4e1e-b3bd-6421201f52a0 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:37.542125 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a8a694b1-3dfa-4e1e-b3bd-6421201f52a0 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:37.553385 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a8a694b1-3dfa-4e1e-b3bd-6421201f52a0 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 200 len: 1367 microversion: 2.47 time: 0.236986 Aug 22 17:24:37.553385 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 935/1871] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:37 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:37.564467 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ee0d61a0-ecb9-4d46-8104-b55a5f41b263 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:37.574966 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ee0d61a0-ecb9-4d46-8104-b55a5f41b263 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:37.578224 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ee0d61a0-ecb9-4d46-8104-b55a5f41b263 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:37.580047 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ee0d61a0-ecb9-4d46-8104-b55a5f41b263 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.240194 Aug 22 17:24:37.583933 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 937/1872] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:37 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:38.571163 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7ec584de-fedc-4b1b-851b-c7c5bf92c95e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:38.571788 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-7ec584de-fedc-4b1b-851b-c7c5bf92c95e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: fa0cfdfa-dd6b-437b-946e-e08fd925e833] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:38.590620 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7ec584de-fedc-4b1b-851b-c7c5bf92c95e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:38.591111 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7ec584de-fedc-4b1b-851b-c7c5bf92c95e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:38.595833 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7ec584de-fedc-4b1b-851b-c7c5bf92c95e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:38.596608 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7ec584de-fedc-4b1b-851b-c7c5bf92c95e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:38.597103 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7ec584de-fedc-4b1b-851b-c7c5bf92c95e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:38.601855 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7ec584de-fedc-4b1b-851b-c7c5bf92c95e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:38.620799 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-20126727-13fa-4721-aa43-e787f78523ae tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:38.623409 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-20126727-13fa-4721-aa43-e787f78523ae tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:38.634967 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-20126727-13fa-4721-aa43-e787f78523ae tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:38.636327 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-20126727-13fa-4721-aa43-e787f78523ae tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:38.636757 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-7ec584de-fedc-4b1b-851b-c7c5bf92c95e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] HTTP exception thrown: Instance fa0cfdfa-dd6b-437b-946e-e08fd925e833 could not be found. Aug 22 17:24:38.637389 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-20126727-13fa-4721-aa43-e787f78523ae tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7ec584de-fedc-4b1b-851b-c7c5bf92c95e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Request method failure captured: Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 HTTP/1.1 Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7umHce2Q47tHeH1Yfo1hZTGUhRr1dh1nTK2dh-ERyrZDbUW2kB0xcwDcUcVvqj5tHxkhjDIYzFKVDTG7sUz2Cw7lhNX2r7Gy1PFsvfityJg5trx-j2W-plOV_pWw-nR28YF8NVBCB3KfJLR31uLZJpmxdeILT3OURf2c3E5KncXjq0 Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-Openstack-Nova-Api-Version: 2.47 Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 8a23c9cfe83549e89a722585a71ca6b0 Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServerShowV247Test-108340868 Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8a23c9cfe83549e89a722585a71ca6b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_8a23c9cfe83549e89a722585a71ca6b0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8a23c9cfe83549e89a722585a71ca6b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/8a23c9cfe83549e89a722585a71ca6b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServerShowV247Test-108340868 Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 8a23c9cfe83549e89a722585a71ca6b0 Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServerShowV247Test-108340868 Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServerShowV247Test-108340868-project Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: fc398f9195a74edd84c259ec48b7a618 Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServerShowV247Test-108340868-project Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance fa0cfdfa-dd6b-437b-946e-e08fd925e833 could not be found. Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'fa0cfdfa-dd6b-437b-946e-e08fd925e833'} Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0cfdfa-dd6b-437b-946e-e08fd925e833 could not be found. Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0cfdfa-dd6b-437b-946e-e08fd925e833 could not be found. Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:24:38.638521 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:24:38.643401 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:24:38.643401 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:24:38.643401 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:24:38.643401 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:24:38.643401 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:24:38.643401 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0cfdfa-dd6b-437b-946e-e08fd925e833 could not be found. Aug 22 17:24:38.643401 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:24:38.644094 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-20126727-13fa-4721-aa43-e787f78523ae tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:38.644094 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-20126727-13fa-4721-aa43-e787f78523ae tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:38.644094 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-20126727-13fa-4721-aa43-e787f78523ae tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:38.645739 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7ec584de-fedc-4b1b-851b-c7c5bf92c95e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Returning 404 to user: Instance fa0cfdfa-dd6b-437b-946e-e08fd925e833 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:24:38.647821 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7ec584de-fedc-4b1b-851b-c7c5bf92c95e tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833" status: 404 len: 111 microversion: 2.47 time: 0.081452 Aug 22 17:24:38.652706 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 936/1873] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:38 2022] GET /compute/v2.1/servers/fa0cfdfa-dd6b-437b-946e-e08fd925e833 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:24:38.663334 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7c511cbd-e935-4a97-84ef-99456ed70457 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:38.663810 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-7c511cbd-e935-4a97-84ef-99456ed70457 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: 6a1e0af4-8a41-4381-9c98-974ebc9bfa89] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:38.686343 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7c511cbd-e935-4a97-84ef-99456ed70457 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:38.693001 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7c511cbd-e935-4a97-84ef-99456ed70457 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:38.693586 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7c511cbd-e935-4a97-84ef-99456ed70457 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:38.694568 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7c511cbd-e935-4a97-84ef-99456ed70457 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:38.694910 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7c511cbd-e935-4a97-84ef-99456ed70457 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:38.695250 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7c511cbd-e935-4a97-84ef-99456ed70457 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:38.735464 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-7c511cbd-e935-4a97-84ef-99456ed70457 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: 6a1e0af4-8a41-4381-9c98-974ebc9bfa89] Going to try to terminate instance {{(pid=123016) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:24:38.756182 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-20126727-13fa-4721-aa43-e787f78523ae tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:38.782153 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-20126727-13fa-4721-aa43-e787f78523ae tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:38.784285 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-20126727-13fa-4721-aa43-e787f78523ae tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:38.787072 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-20126727-13fa-4721-aa43-e787f78523ae tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.184023 Aug 22 17:24:38.788117 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 938/1874] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:38 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:24:39.144569 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7c511cbd-e935-4a97-84ef-99456ed70457 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "DELETE /compute/v2.1/servers/6a1e0af4-8a41-4381-9c98-974ebc9bfa89" status: 204 len: 0 microversion: 2.47 time: 0.490418 Aug 22 17:24:39.146199 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 937/1875] 10.222.0.96 () {60 vars in 1280 bytes} [Mon Aug 22 17:24:38 2022] DELETE /compute/v2.1/servers/6a1e0af4-8a41-4381-9c98-974ebc9bfa89 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 17:24:39.156695 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5ffe7819-f651-4384-8cf4-be186fbb8225 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:39.157730 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-5ffe7819-f651-4384-8cf4-be186fbb8225 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: 6a1e0af4-8a41-4381-9c98-974ebc9bfa89] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:39.170123 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5ffe7819-f651-4384-8cf4-be186fbb8225 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:39.172693 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5ffe7819-f651-4384-8cf4-be186fbb8225 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:39.173572 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5ffe7819-f651-4384-8cf4-be186fbb8225 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:39.176485 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5ffe7819-f651-4384-8cf4-be186fbb8225 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:39.178367 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5ffe7819-f651-4384-8cf4-be186fbb8225 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:39.179088 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-5ffe7819-f651-4384-8cf4-be186fbb8225 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:39.376419 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-5ffe7819-f651-4384-8cf4-be186fbb8225 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:39.390510 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-5ffe7819-f651-4384-8cf4-be186fbb8225 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:39.392665 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-5ffe7819-f651-4384-8cf4-be186fbb8225 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:39.394098 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5ffe7819-f651-4384-8cf4-be186fbb8225 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/6a1e0af4-8a41-4381-9c98-974ebc9bfa89" status: 200 len: 1363 microversion: 2.47 time: 0.243937 Aug 22 17:24:39.416843 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 939/1876] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:39 2022] GET /compute/v2.1/servers/6a1e0af4-8a41-4381-9c98-974ebc9bfa89 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:24:39.817820 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-05fa1ffa-3d10-4e19-8584-9a65c5f4b3f0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:39.819527 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-05fa1ffa-3d10-4e19-8584-9a65c5f4b3f0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:39.829754 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-05fa1ffa-3d10-4e19-8584-9a65c5f4b3f0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:39.830333 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-05fa1ffa-3d10-4e19-8584-9a65c5f4b3f0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:39.831484 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-05fa1ffa-3d10-4e19-8584-9a65c5f4b3f0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:39.832371 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-05fa1ffa-3d10-4e19-8584-9a65c5f4b3f0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:39.832848 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-05fa1ffa-3d10-4e19-8584-9a65c5f4b3f0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:39.834020 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-05fa1ffa-3d10-4e19-8584-9a65c5f4b3f0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:40.003463 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-05fa1ffa-3d10-4e19-8584-9a65c5f4b3f0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:40.023376 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-05fa1ffa-3d10-4e19-8584-9a65c5f4b3f0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:40.029282 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-05fa1ffa-3d10-4e19-8584-9a65c5f4b3f0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:40.030952 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-05fa1ffa-3d10-4e19-8584-9a65c5f4b3f0 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.219812 Aug 22 17:24:40.049883 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 938/1877] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:39 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:40.420877 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-bb2a2032-a11c-4507-8fed-3f9cce1260a1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:40.421636 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-bb2a2032-a11c-4507-8fed-3f9cce1260a1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: 6a1e0af4-8a41-4381-9c98-974ebc9bfa89] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:40.427829 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bb2a2032-a11c-4507-8fed-3f9cce1260a1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:40.428327 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bb2a2032-a11c-4507-8fed-3f9cce1260a1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:40.428763 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bb2a2032-a11c-4507-8fed-3f9cce1260a1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:40.429702 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bb2a2032-a11c-4507-8fed-3f9cce1260a1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:40.430159 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bb2a2032-a11c-4507-8fed-3f9cce1260a1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:40.430672 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bb2a2032-a11c-4507-8fed-3f9cce1260a1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:40.578722 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-bb2a2032-a11c-4507-8fed-3f9cce1260a1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:40.587670 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-bb2a2032-a11c-4507-8fed-3f9cce1260a1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:40.591085 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-bb2a2032-a11c-4507-8fed-3f9cce1260a1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:40.592367 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-bb2a2032-a11c-4507-8fed-3f9cce1260a1 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/6a1e0af4-8a41-4381-9c98-974ebc9bfa89" status: 200 len: 1363 microversion: 2.47 time: 0.176262 Aug 22 17:24:40.608859 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 940/1878] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:40 2022] GET /compute/v2.1/servers/6a1e0af4-8a41-4381-9c98-974ebc9bfa89 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:41.060198 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-dc395f0b-d701-43c0-85e5-ca957c08f203 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:41.060962 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-dc395f0b-d701-43c0-85e5-ca957c08f203 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:41.078805 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dc395f0b-d701-43c0-85e5-ca957c08f203 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:41.079563 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dc395f0b-d701-43c0-85e5-ca957c08f203 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:41.080007 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dc395f0b-d701-43c0-85e5-ca957c08f203 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:41.085444 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dc395f0b-d701-43c0-85e5-ca957c08f203 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:41.086236 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dc395f0b-d701-43c0-85e5-ca957c08f203 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:41.088299 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-dc395f0b-d701-43c0-85e5-ca957c08f203 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:41.209963 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-dc395f0b-d701-43c0-85e5-ca957c08f203 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:41.220622 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-dc395f0b-d701-43c0-85e5-ca957c08f203 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:41.222232 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-dc395f0b-d701-43c0-85e5-ca957c08f203 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:41.223440 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-dc395f0b-d701-43c0-85e5-ca957c08f203 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.170743 Aug 22 17:24:41.224058 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 939/1879] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:41 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:41.616189 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a4d071c9-a48a-42bf-b138-2fb90570bd59 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:41.616803 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-a4d071c9-a48a-42bf-b138-2fb90570bd59 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: 6a1e0af4-8a41-4381-9c98-974ebc9bfa89] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:41.623734 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a4d071c9-a48a-42bf-b138-2fb90570bd59 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:41.624234 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a4d071c9-a48a-42bf-b138-2fb90570bd59 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:41.624732 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a4d071c9-a48a-42bf-b138-2fb90570bd59 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:41.625629 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a4d071c9-a48a-42bf-b138-2fb90570bd59 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:41.626140 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a4d071c9-a48a-42bf-b138-2fb90570bd59 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:41.626771 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a4d071c9-a48a-42bf-b138-2fb90570bd59 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:41.664161 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a4d071c9-a48a-42bf-b138-2fb90570bd59 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:41.664916 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a4d071c9-a48a-42bf-b138-2fb90570bd59 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:41.665565 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-a4d071c9-a48a-42bf-b138-2fb90570bd59 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:41.666290 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-a4d071c9-a48a-42bf-b138-2fb90570bd59 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lazy-loading 'fault' on Instance uuid 6a1e0af4-8a41-4381-9c98-974ebc9bfa89 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:24:41.791114 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a4d071c9-a48a-42bf-b138-2fb90570bd59 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:41.806096 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a4d071c9-a48a-42bf-b138-2fb90570bd59 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:41.808575 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-a4d071c9-a48a-42bf-b138-2fb90570bd59 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc398f9195a74edd84c259ec48b7a618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a23c9cfe83549e89a722585a71ca6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:41.810185 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a4d071c9-a48a-42bf-b138-2fb90570bd59 tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/6a1e0af4-8a41-4381-9c98-974ebc9bfa89" status: 200 len: 1368 microversion: 2.47 time: 0.197989 Aug 22 17:24:41.811367 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 941/1880] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:41 2022] GET /compute/v2.1/servers/6a1e0af4-8a41-4381-9c98-974ebc9bfa89 => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:42.253555 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-009b5390-6bfa-4572-a5a0-ab5d834a500f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:42.254235 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-009b5390-6bfa-4572-a5a0-ab5d834a500f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:42.262469 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-009b5390-6bfa-4572-a5a0-ab5d834a500f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:42.263753 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-009b5390-6bfa-4572-a5a0-ab5d834a500f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:42.264551 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-009b5390-6bfa-4572-a5a0-ab5d834a500f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:42.265802 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-009b5390-6bfa-4572-a5a0-ab5d834a500f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:42.266440 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-009b5390-6bfa-4572-a5a0-ab5d834a500f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:42.267057 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-009b5390-6bfa-4572-a5a0-ab5d834a500f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:42.273961 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:42.387636 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-009b5390-6bfa-4572-a5a0-ab5d834a500f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:42.405188 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-009b5390-6bfa-4572-a5a0-ab5d834a500f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:42.418177 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-009b5390-6bfa-4572-a5a0-ab5d834a500f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:42.419408 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-009b5390-6bfa-4572-a5a0-ab5d834a500f tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.171541 Aug 22 17:24:42.420004 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 940/1881] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:42 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:42.846186 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-63c3fd88-dc8f-4ef2-8529-a8ce47bcf0fa tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:42.846909 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-63c3fd88-dc8f-4ef2-8529-a8ce47bcf0fa tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] [instance: 6a1e0af4-8a41-4381-9c98-974ebc9bfa89] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:42.870879 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-63c3fd88-dc8f-4ef2-8529-a8ce47bcf0fa tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:42.873071 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-63c3fd88-dc8f-4ef2-8529-a8ce47bcf0fa tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:42.873635 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-63c3fd88-dc8f-4ef2-8529-a8ce47bcf0fa tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:42.874399 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-63c3fd88-dc8f-4ef2-8529-a8ce47bcf0fa tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:42.874874 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-63c3fd88-dc8f-4ef2-8529-a8ce47bcf0fa tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:42.875307 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-63c3fd88-dc8f-4ef2-8529-a8ce47bcf0fa tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:42.907869 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-63c3fd88-dc8f-4ef2-8529-a8ce47bcf0fa tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] HTTP exception thrown: Instance 6a1e0af4-8a41-4381-9c98-974ebc9bfa89 could not be found. Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-63c3fd88-dc8f-4ef2-8529-a8ce47bcf0fa tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Request method failure captured: Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/servers/6a1e0af4-8a41-4381-9c98-974ebc9bfa89 HTTP/1.1 Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7umHce2Q47tHeH1Yfo1hZTGUhRr1dh1nTK2dh-ERyrZDbUW2kB0xcwDcUcVvqj5tHxkhjDIYzFKVDTG7sUz2Cw7lhNX2r7Gy1PFsvfityJg5trx-j2W-plOV_pWw-nR28YF8NVBCB3KfJLR31uLZJpmxdeILT3OURf2c3E5KncXjq0 Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-Openstack-Nova-Api-Version: 2.47 Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 8a23c9cfe83549e89a722585a71ca6b0 Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServerShowV247Test-108340868 Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8a23c9cfe83549e89a722585a71ca6b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_8a23c9cfe83549e89a722585a71ca6b0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8a23c9cfe83549e89a722585a71ca6b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/8a23c9cfe83549e89a722585a71ca6b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServerShowV247Test-108340868 Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 8a23c9cfe83549e89a722585a71ca6b0 Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServerShowV247Test-108340868 Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServerShowV247Test-108340868-project Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: fc398f9195a74edd84c259ec48b7a618 Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServerShowV247Test-108340868-project Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance 6a1e0af4-8a41-4381-9c98-974ebc9bfa89 could not be found. Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '6a1e0af4-8a41-4381-9c98-974ebc9bfa89'} Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a1e0af4-8a41-4381-9c98-974ebc9bfa89 could not be found. Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a1e0af4-8a41-4381-9c98-974ebc9bfa89 could not be found. Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:24:42.909524 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:24:42.914264 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:24:42.914264 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:24:42.914264 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:24:42.914264 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:24:42.914264 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:24:42.914264 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a1e0af4-8a41-4381-9c98-974ebc9bfa89 could not be found. Aug 22 17:24:42.914264 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:24:42.914264 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-63c3fd88-dc8f-4ef2-8529-a8ce47bcf0fa tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] Returning 404 to user: Instance 6a1e0af4-8a41-4381-9c98-974ebc9bfa89 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:24:42.914264 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-63c3fd88-dc8f-4ef2-8529-a8ce47bcf0fa tempest-ServerShowV247Test-108340868 tempest-ServerShowV247Test-108340868-project] 10.222.0.96 "GET /compute/v2.1/servers/6a1e0af4-8a41-4381-9c98-974ebc9bfa89" status: 404 len: 111 microversion: 2.47 time: 0.075139 Aug 22 17:24:42.914264 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 942/1882] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:42 2022] GET /compute/v2.1/servers/6a1e0af4-8a41-4381-9c98-974ebc9bfa89 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:24:43.451215 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ed564eeb-5b72-4e2b-b485-4709907ffed1 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:43.451843 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-ed564eeb-5b72-4e2b-b485-4709907ffed1 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:43.484715 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ed564eeb-5b72-4e2b-b485-4709907ffed1 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:43.485251 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ed564eeb-5b72-4e2b-b485-4709907ffed1 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:43.485701 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ed564eeb-5b72-4e2b-b485-4709907ffed1 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:43.486441 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ed564eeb-5b72-4e2b-b485-4709907ffed1 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:43.486903 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ed564eeb-5b72-4e2b-b485-4709907ffed1 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:43.487336 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ed564eeb-5b72-4e2b-b485-4709907ffed1 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:43.646933 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ed564eeb-5b72-4e2b-b485-4709907ffed1 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:43.658636 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ed564eeb-5b72-4e2b-b485-4709907ffed1 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:43.662560 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ed564eeb-5b72-4e2b-b485-4709907ffed1 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:43.663795 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ed564eeb-5b72-4e2b-b485-4709907ffed1 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.217124 Aug 22 17:24:43.677402 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 941/1883] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:43 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:44.691800 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c3ca3632-1712-4e22-a8fc-f990738b44bf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:44.693146 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-c3ca3632-1712-4e22-a8fc-f990738b44bf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:44.702678 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:44.703697 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:44.711448 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c3ca3632-1712-4e22-a8fc-f990738b44bf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:44.712548 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c3ca3632-1712-4e22-a8fc-f990738b44bf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:44.713184 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c3ca3632-1712-4e22-a8fc-f990738b44bf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:44.715037 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c3ca3632-1712-4e22-a8fc-f990738b44bf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:44.718747 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c3ca3632-1712-4e22-a8fc-f990738b44bf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:44.720394 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c3ca3632-1712-4e22-a8fc-f990738b44bf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:44.857730 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c3ca3632-1712-4e22-a8fc-f990738b44bf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:44.873558 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c3ca3632-1712-4e22-a8fc-f990738b44bf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:44.875391 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c3ca3632-1712-4e22-a8fc-f990738b44bf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:44.877324 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c3ca3632-1712-4e22-a8fc-f990738b44bf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.190882 Aug 22 17:24:44.878420 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 943/1884] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:44 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:45.904338 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a8be1c9b-110f-4389-bd3b-422a8788df0d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:45.904970 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-a8be1c9b-110f-4389-bd3b-422a8788df0d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:45.922672 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8be1c9b-110f-4389-bd3b-422a8788df0d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:45.923272 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8be1c9b-110f-4389-bd3b-422a8788df0d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:45.923790 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8be1c9b-110f-4389-bd3b-422a8788df0d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:45.924597 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8be1c9b-110f-4389-bd3b-422a8788df0d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:45.925459 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8be1c9b-110f-4389-bd3b-422a8788df0d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:45.926634 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8be1c9b-110f-4389-bd3b-422a8788df0d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:46.111091 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a8be1c9b-110f-4389-bd3b-422a8788df0d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:46.132055 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a8be1c9b-110f-4389-bd3b-422a8788df0d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:46.145932 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a8be1c9b-110f-4389-bd3b-422a8788df0d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:46.147461 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a8be1c9b-110f-4389-bd3b-422a8788df0d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.247088 Aug 22 17:24:46.158927 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 942/1885] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:45 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:47.174679 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2a953e80-311e-4a0c-86f5-ca2aae8c401d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:47.176518 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-2a953e80-311e-4a0c-86f5-ca2aae8c401d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:47.191760 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2a953e80-311e-4a0c-86f5-ca2aae8c401d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:47.195737 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2a953e80-311e-4a0c-86f5-ca2aae8c401d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:47.195737 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2a953e80-311e-4a0c-86f5-ca2aae8c401d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:47.197841 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2a953e80-311e-4a0c-86f5-ca2aae8c401d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:47.199162 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2a953e80-311e-4a0c-86f5-ca2aae8c401d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:47.200314 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-2a953e80-311e-4a0c-86f5-ca2aae8c401d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:47.378335 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-2a953e80-311e-4a0c-86f5-ca2aae8c401d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:47.394118 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-2a953e80-311e-4a0c-86f5-ca2aae8c401d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:47.396266 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-2a953e80-311e-4a0c-86f5-ca2aae8c401d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:47.398275 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2a953e80-311e-4a0c-86f5-ca2aae8c401d tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1365 microversion: 2.57 time: 0.228869 Aug 22 17:24:47.413427 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 944/1886] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:47 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:48.424836 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-046fb54d-7cca-41db-9385-97e4cf0a866c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:48.425507 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-046fb54d-7cca-41db-9385-97e4cf0a866c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:48.434971 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-046fb54d-7cca-41db-9385-97e4cf0a866c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:48.435923 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-046fb54d-7cca-41db-9385-97e4cf0a866c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:48.436607 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-046fb54d-7cca-41db-9385-97e4cf0a866c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:48.437670 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-046fb54d-7cca-41db-9385-97e4cf0a866c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:48.438367 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-046fb54d-7cca-41db-9385-97e4cf0a866c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:48.439027 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-046fb54d-7cca-41db-9385-97e4cf0a866c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:48.673059 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-046fb54d-7cca-41db-9385-97e4cf0a866c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:48.684078 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-046fb54d-7cca-41db-9385-97e4cf0a866c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:48.694884 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-046fb54d-7cca-41db-9385-97e4cf0a866c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:48.697214 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-046fb54d-7cca-41db-9385-97e4cf0a866c tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1383 microversion: 2.57 time: 0.276757 Aug 22 17:24:48.727131 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 943/1887] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:48 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1383 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:49.729954 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-da33a8ee-fb9e-4685-a5f3-c814d965d1e7 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:49.730700 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-da33a8ee-fb9e-4685-a5f3-c814d965d1e7 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:49.737319 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-da33a8ee-fb9e-4685-a5f3-c814d965d1e7 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:49.737892 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-da33a8ee-fb9e-4685-a5f3-c814d965d1e7 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:49.738396 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-da33a8ee-fb9e-4685-a5f3-c814d965d1e7 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:49.739360 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-da33a8ee-fb9e-4685-a5f3-c814d965d1e7 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:49.740043 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-da33a8ee-fb9e-4685-a5f3-c814d965d1e7 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:49.740548 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-da33a8ee-fb9e-4685-a5f3-c814d965d1e7 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:49.815185 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-da33a8ee-fb9e-4685-a5f3-c814d965d1e7 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:49.818077 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-da33a8ee-fb9e-4685-a5f3-c814d965d1e7 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:49.819590 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-da33a8ee-fb9e-4685-a5f3-c814d965d1e7 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:49.820807 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-da33a8ee-fb9e-4685-a5f3-c814d965d1e7 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1371 microversion: 2.57 time: 0.095360 Aug 22 17:24:49.821430 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 945/1888] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:49 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:50.845134 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e73662cf-6876-4dbb-a8b3-a2c5a1f6a7b3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:50.846477 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e73662cf-6876-4dbb-a8b3-a2c5a1f6a7b3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:50.858294 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e73662cf-6876-4dbb-a8b3-a2c5a1f6a7b3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:50.864329 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e73662cf-6876-4dbb-a8b3-a2c5a1f6a7b3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:50.865522 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e73662cf-6876-4dbb-a8b3-a2c5a1f6a7b3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:50.868252 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e73662cf-6876-4dbb-a8b3-a2c5a1f6a7b3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:50.868926 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e73662cf-6876-4dbb-a8b3-a2c5a1f6a7b3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:50.871721 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e73662cf-6876-4dbb-a8b3-a2c5a1f6a7b3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:50.955770 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e73662cf-6876-4dbb-a8b3-a2c5a1f6a7b3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:50.968979 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e73662cf-6876-4dbb-a8b3-a2c5a1f6a7b3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:50.971846 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e73662cf-6876-4dbb-a8b3-a2c5a1f6a7b3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:50.973219 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e73662cf-6876-4dbb-a8b3-a2c5a1f6a7b3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1371 microversion: 2.57 time: 0.132645 Aug 22 17:24:50.985928 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 944/1889] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:50 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:51.999806 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-dd3b0101-b9c1-42ab-b0dc-ed75a2235de3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:52.002315 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-dd3b0101-b9c1-42ab-b0dc-ed75a2235de3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:52.014475 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dd3b0101-b9c1-42ab-b0dc-ed75a2235de3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:52.018793 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dd3b0101-b9c1-42ab-b0dc-ed75a2235de3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:52.019501 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dd3b0101-b9c1-42ab-b0dc-ed75a2235de3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:52.020611 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dd3b0101-b9c1-42ab-b0dc-ed75a2235de3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:52.022697 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dd3b0101-b9c1-42ab-b0dc-ed75a2235de3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:52.024682 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-dd3b0101-b9c1-42ab-b0dc-ed75a2235de3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:52.341840 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-dd3b0101-b9c1-42ab-b0dc-ed75a2235de3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:52.365182 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-dd3b0101-b9c1-42ab-b0dc-ed75a2235de3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:52.365182 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-dd3b0101-b9c1-42ab-b0dc-ed75a2235de3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:52.365182 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-dd3b0101-b9c1-42ab-b0dc-ed75a2235de3 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1371 microversion: 2.57 time: 0.369149 Aug 22 17:24:52.380487 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 946/1890] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:51 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1371 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:53.388175 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-d0bb0619-5af5-4453-a5bb-6a03d8795d55 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:53.396359 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-d0bb0619-5af5-4453-a5bb-6a03d8795d55 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:53.399530 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d0bb0619-5af5-4453-a5bb-6a03d8795d55 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:53.400262 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d0bb0619-5af5-4453-a5bb-6a03d8795d55 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:53.401882 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d0bb0619-5af5-4453-a5bb-6a03d8795d55 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:53.403664 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d0bb0619-5af5-4453-a5bb-6a03d8795d55 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:53.404502 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d0bb0619-5af5-4453-a5bb-6a03d8795d55 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:53.405153 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-d0bb0619-5af5-4453-a5bb-6a03d8795d55 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:53.583672 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-d0bb0619-5af5-4453-a5bb-6a03d8795d55 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:53.607498 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-d0bb0619-5af5-4453-a5bb-6a03d8795d55 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:53.607498 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-d0bb0619-5af5-4453-a5bb-6a03d8795d55 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:53.607498 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-d0bb0619-5af5-4453-a5bb-6a03d8795d55 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1371 microversion: 2.57 time: 0.220059 Aug 22 17:24:53.607498 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 945/1891] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:53 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:54.631227 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9e35e8c9-ac29-4aa5-b999-99ca21435cd6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:54.631888 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9e35e8c9-ac29-4aa5-b999-99ca21435cd6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:54.642188 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9e35e8c9-ac29-4aa5-b999-99ca21435cd6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:54.643247 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9e35e8c9-ac29-4aa5-b999-99ca21435cd6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:54.645902 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9e35e8c9-ac29-4aa5-b999-99ca21435cd6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:54.647619 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9e35e8c9-ac29-4aa5-b999-99ca21435cd6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:54.649475 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9e35e8c9-ac29-4aa5-b999-99ca21435cd6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:54.651436 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9e35e8c9-ac29-4aa5-b999-99ca21435cd6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:54.800025 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9e35e8c9-ac29-4aa5-b999-99ca21435cd6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:54.813347 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9e35e8c9-ac29-4aa5-b999-99ca21435cd6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:54.825358 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9e35e8c9-ac29-4aa5-b999-99ca21435cd6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:54.827272 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9e35e8c9-ac29-4aa5-b999-99ca21435cd6 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1356 microversion: 2.57 time: 0.200720 Aug 22 17:24:54.832579 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 947/1892] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:54 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1356 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:54.864537 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1193281e-bec8-435d-a96d-cc49718dd2fe tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:54.868964 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-1193281e-bec8-435d-a96d-cc49718dd2fe tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:54.875273 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1193281e-bec8-435d-a96d-cc49718dd2fe tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:54.877613 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1193281e-bec8-435d-a96d-cc49718dd2fe tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:54.878708 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1193281e-bec8-435d-a96d-cc49718dd2fe tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:54.879993 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1193281e-bec8-435d-a96d-cc49718dd2fe tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:54.882442 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1193281e-bec8-435d-a96d-cc49718dd2fe tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:54.883111 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-1193281e-bec8-435d-a96d-cc49718dd2fe tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:54.955044 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-1193281e-bec8-435d-a96d-cc49718dd2fe tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Going to try to terminate instance {{(pid=123016) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:24:55.354579 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1193281e-bec8-435d-a96d-cc49718dd2fe tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "DELETE /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 204 len: 0 microversion: 2.57 time: 0.493600 Aug 22 17:24:55.355354 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 946/1893] 10.222.0.96 () {60 vars in 1280 bytes} [Mon Aug 22 17:24:54 2022] DELETE /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 17:24:55.367104 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-53bc830b-d6af-423d-9285-241766ba9ebf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:55.368774 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-53bc830b-d6af-423d-9285-241766ba9ebf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:55.376853 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-53bc830b-d6af-423d-9285-241766ba9ebf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:55.377632 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-53bc830b-d6af-423d-9285-241766ba9ebf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:55.378239 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-53bc830b-d6af-423d-9285-241766ba9ebf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:55.379246 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-53bc830b-d6af-423d-9285-241766ba9ebf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:55.379870 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-53bc830b-d6af-423d-9285-241766ba9ebf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:55.380505 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-53bc830b-d6af-423d-9285-241766ba9ebf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:55.674745 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-53bc830b-d6af-423d-9285-241766ba9ebf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:55.691088 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-53bc830b-d6af-423d-9285-241766ba9ebf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:55.693424 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-53bc830b-d6af-423d-9285-241766ba9ebf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:55.704501 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-53bc830b-d6af-423d-9285-241766ba9ebf tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1362 microversion: 2.57 time: 0.343823 Aug 22 17:24:55.705728 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 948/1894] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:55 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:56.734893 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fa31235f-2cf9-4607-9cea-fd6cde39d47e tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:56.735704 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-fa31235f-2cf9-4607-9cea-fd6cde39d47e tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:56.751182 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa31235f-2cf9-4607-9cea-fd6cde39d47e tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:56.751182 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa31235f-2cf9-4607-9cea-fd6cde39d47e tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:56.751182 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa31235f-2cf9-4607-9cea-fd6cde39d47e tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:56.757465 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa31235f-2cf9-4607-9cea-fd6cde39d47e tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:56.757990 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa31235f-2cf9-4607-9cea-fd6cde39d47e tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:56.758430 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fa31235f-2cf9-4607-9cea-fd6cde39d47e tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:56.898231 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-fa31235f-2cf9-4607-9cea-fd6cde39d47e tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:56.908720 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-fa31235f-2cf9-4607-9cea-fd6cde39d47e tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:56.912218 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-fa31235f-2cf9-4607-9cea-fd6cde39d47e tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:56.912881 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-fa31235f-2cf9-4607-9cea-fd6cde39d47e tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1362 microversion: 2.57 time: 0.183847 Aug 22 17:24:56.924106 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 947/1895] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:56 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:57.939767 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fd39c892-cfda-4a3c-86b7-5a62aac2202a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:57.941018 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-fd39c892-cfda-4a3c-86b7-5a62aac2202a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:57.962016 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd39c892-cfda-4a3c-86b7-5a62aac2202a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:57.962974 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd39c892-cfda-4a3c-86b7-5a62aac2202a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:57.964393 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd39c892-cfda-4a3c-86b7-5a62aac2202a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:57.981311 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd39c892-cfda-4a3c-86b7-5a62aac2202a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:57.982459 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd39c892-cfda-4a3c-86b7-5a62aac2202a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:57.983219 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fd39c892-cfda-4a3c-86b7-5a62aac2202a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:58.280793 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-fd39c892-cfda-4a3c-86b7-5a62aac2202a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:58.294695 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-fd39c892-cfda-4a3c-86b7-5a62aac2202a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:58.297257 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-fd39c892-cfda-4a3c-86b7-5a62aac2202a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0eeedc48346744bcace96800f65a8b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd034cf1cc3df4d98948c7c135c926e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:24:58.298688 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fd39c892-cfda-4a3c-86b7-5a62aac2202a tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 200 len: 1362 microversion: 2.57 time: 0.363532 Aug 22 17:24:58.300388 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 949/1896] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:57 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 1362 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:59.331284 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4775ec8f-f49f-4ae6-8d9d-08517e035725 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:59.332637 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-4775ec8f-f49f-4ae6-8d9d-08517e035725 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] [instance: d5338c84-a268-4554-be18-ffbea1443702] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:24:59.344075 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4775ec8f-f49f-4ae6-8d9d-08517e035725 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:59.345922 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4775ec8f-f49f-4ae6-8d9d-08517e035725 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:59.347817 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4775ec8f-f49f-4ae6-8d9d-08517e035725 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:59.350440 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4775ec8f-f49f-4ae6-8d9d-08517e035725 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:59.360856 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4775ec8f-f49f-4ae6-8d9d-08517e035725 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:59.361761 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4775ec8f-f49f-4ae6-8d9d-08517e035725 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:59.431399 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-4775ec8f-f49f-4ae6-8d9d-08517e035725 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] HTTP exception thrown: Instance d5338c84-a268-4554-be18-ffbea1443702 could not be found. Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4775ec8f-f49f-4ae6-8d9d-08517e035725 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Request method failure captured: Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 HTTP/1.1 Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7uxjkf_LAUwCf0V8sR6c1MJiTb2UVj1ZEPkEw2S4P1qmhG-h7IslwbtgqBuDT7pH3IXrT-RKAooWkLkxm7UZeKmkY0qLlSdBmUYWox8xpyucySfYUTF9BzNTpHL-Jm7tT9vSdQ07spsECw467pGdBnMSenC0dRBe3IRV1FC3T5CLMw Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-Openstack-Nova-Api-Version: 2.57 Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: d034cf1cc3df4d98948c7c135c926e38 Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServerShowV257Test-882613007 Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d034cf1cc3df4d98948c7c135c926e38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_d034cf1cc3df4d98948c7c135c926e38", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/d034cf1cc3df4d98948c7c135c926e38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/d034cf1cc3df4d98948c7c135c926e38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServerShowV257Test-882613007 Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: d034cf1cc3df4d98948c7c135c926e38 Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServerShowV257Test-882613007 Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServerShowV257Test-882613007-project Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 0eeedc48346744bcace96800f65a8b78 Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServerShowV257Test-882613007-project Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance d5338c84-a268-4554-be18-ffbea1443702 could not be found. Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'd5338c84-a268-4554-be18-ffbea1443702'} Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5338c84-a268-4554-be18-ffbea1443702 could not be found. Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5338c84-a268-4554-be18-ffbea1443702 could not be found. Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:24:59.435761 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:24:59.440634 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:24:59.440634 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:24:59.440634 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:24:59.440634 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:24:59.440634 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:24:59.440634 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5338c84-a268-4554-be18-ffbea1443702 could not be found. Aug 22 17:24:59.440634 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:24:59.458188 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4775ec8f-f49f-4ae6-8d9d-08517e035725 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Returning 404 to user: Instance d5338c84-a268-4554-be18-ffbea1443702 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:24:59.459471 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4775ec8f-f49f-4ae6-8d9d-08517e035725 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702" status: 404 len: 111 microversion: 2.57 time: 0.134516 Aug 22 17:24:59.461384 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 948/1897] 10.222.0.96 () {60 vars in 1277 bytes} [Mon Aug 22 17:24:59 2022] GET /compute/v2.1/servers/d5338c84-a268-4554-be18-ffbea1443702 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:25:22.989349 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=47 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:25:22.995193 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=85 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:25:23.723584 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d8161e5e-807f-4131-93c9-29430a18efa3 tempest-ServersNegativeTestMultiTenantJSON-1253952328 tempest-ServersNegativeTestMultiTenantJSON-1253952328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-58021561", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "4dde1806-5dae-4dbc-8d57-0e44edf04036"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:25:23.871057 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-d8161e5e-807f-4131-93c9-29430a18efa3 tempest-ServersNegativeTestMultiTenantJSON-1253952328 tempest-ServersNegativeTestMultiTenantJSON-1253952328-project] validate_networks() for [('4dde1806-5dae-4dbc-8d57-0e44edf04036', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-d8161e5e-807f-4131-93c9-29430a18efa3 tempest-ServersNegativeTestMultiTenantJSON-1253952328 tempest-ServersNegativeTestMultiTenantJSON-1253952328-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-53d3810d-9ca4-46d8-b4c6-05acf1b3e76c) Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:25:24.982707 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-53d3810d-9ca4-46d8-b4c6-05acf1b3e76c) Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-d8161e5e-807f-4131-93c9-29430a18efa3 tempest-ServersNegativeTestMultiTenantJSON-1253952328 tempest-ServersNegativeTestMultiTenantJSON-1253952328-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d8161e5e-807f-4131-93c9-29430a18efa3 tempest-ServersNegativeTestMultiTenantJSON-1253952328 tempest-ServersNegativeTestMultiTenantJSON-1253952328-project] Request method failure captured: Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 218 Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7vwdAWWYJKJOhdmGjWRh6N1tTV71YGwOyvAz3MUAC7aB6REo2fXimoVFPG06miqdCcWQj2w69UKDddtIM5O5s7k7WG1fkGXRxgePhTJ2ucoP7twJ0D5wPnM4DLaWTUaUKomenxn0JBNJ935ncDQOvXXX0GtwOdEEPffw__oAUe70Co Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: b22fe1c7eabc4634b9cd05046fa3083d Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1253952328 Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/b22fe1c7eabc4634b9cd05046fa3083d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_b22fe1c7eabc4634b9cd05046fa3083d", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/b22fe1c7eabc4634b9cd05046fa3083d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/b22fe1c7eabc4634b9cd05046fa3083d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1253952328 Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: b22fe1c7eabc4634b9cd05046fa3083d Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1253952328 Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1253952328-project Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: ee5e838876924c598e67737233953950 Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1253952328-project Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-58021561", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "4dde1806-5dae-4dbc-8d57-0e44edf04036"}]}} Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:25:24.988722 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestMultiTenantJSON-server-58021561', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '4dde1806-5dae-4dbc-8d57-0e44edf04036'}]}}} Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:25:24.996723 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-53d3810d-9ca4-46d8-b4c6-05acf1b3e76c) Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d8161e5e-807f-4131-93c9-29430a18efa3 tempest-ServersNegativeTestMultiTenantJSON-1253952328 tempest-ServersNegativeTestMultiTenantJSON-1253952328-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d8161e5e-807f-4131-93c9-29430a18efa3 tempest-ServersNegativeTestMultiTenantJSON-1253952328 tempest-ServersNegativeTestMultiTenantJSON-1253952328-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.003350 Aug 22 17:25:25.008103 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 950/1898] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:25:22 2022] POST /compute/v2.1/servers => generated 214 bytes in 2008 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:25:51.178784 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4775ec8f-f49f-4ae6-8d9d-08517e035725 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:25:51.179921 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4775ec8f-f49f-4ae6-8d9d-08517e035725 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001503 Aug 22 17:25:51.180558 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 949/1899] 10.222.0.96 () {56 vars in 886 bytes} [Mon Aug 22 17:25:51 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 22 17:25:51.191176 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d8161e5e-807f-4131-93c9-29430a18efa3 tempest-ServersNegativeTestMultiTenantJSON-1253952328 tempest-ServersNegativeTestMultiTenantJSON-1253952328-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:25:51.193588 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d8161e5e-807f-4131-93c9-29430a18efa3 tempest-ServersNegativeTestMultiTenantJSON-1253952328 tempest-ServersNegativeTestMultiTenantJSON-1253952328-project] 10.222.0.96 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.004826 Aug 22 17:25:51.194008 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 951/1900] 10.222.0.96 () {54 vars in 1035 bytes} [Mon Aug 22 17:25:51 2022] GET /compute/v2/ => generated 379 bytes in 6 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 22 17:25:51.205627 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4775ec8f-f49f-4ae6-8d9d-08517e035725 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:25:51.218141 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4775ec8f-f49f-4ae6-8d9d-08517e035725 tempest-ServerShowV257Test-882613007 tempest-ServerShowV257Test-882613007-project] 10.222.0.96 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.012410 Aug 22 17:25:51.226530 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 950/1901] 10.222.0.96 () {54 vars in 1041 bytes} [Mon Aug 22 17:25:51 2022] GET /compute/v2.1/ => generated 388 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:25:51.228198 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d8161e5e-807f-4131-93c9-29430a18efa3 tempest-ServersNegativeTestMultiTenantJSON-1253952328 tempest-ServersNegativeTestMultiTenantJSON-1253952328-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:25:51.229850 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d8161e5e-807f-4131-93c9-29430a18efa3 tempest-ServersNegativeTestMultiTenantJSON-1253952328 tempest-ServersNegativeTestMultiTenantJSON-1253952328-project] 10.222.0.96 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001980 Aug 22 17:25:51.230465 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 952/1902] 10.222.0.96 () {56 vars in 886 bytes} [Mon Aug 22 17:25:51 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 22 17:26:12.504723 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:26:12.505760 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:26:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:26:12.710967 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:26:12.710967 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:26:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:26:14.143784 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:14.145536 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:14.330245 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:26:14.330245 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:26:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.96) !!! Aug 22 17:26:14.722139 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2ea83bb4-d1c2-4484-854c-ff78eb99335c tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] Action: 'create', calling method: .version_select at 0x7f800971cb80>, body: {"keypair": {"name": "tempest-keypair-214370225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0qO6FIi2++S3W44bn+6SerG0uf+gOyvoAuuETB3fOKqMJAujorrF0Tt50q+pPVHNZFjBttLBrfXM+Z+fz6bXorsa82uB4IE2K5j2i4CmKVqBsfkBg9X+eNdntc8hRKZg=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:26:14.788026 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-2ea83bb4-d1c2-4484-854c-ff78eb99335c tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] Getting quotas for project e078f565d4f24256857f151c7ce9ca64. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:26:14.800707 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-2ea83bb4-d1c2-4484-854c-ff78eb99335c tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] Getting quotas for user b9d8cd25487b4d5581f904fd63f761ae and project e078f565d4f24256857f151c7ce9ca64. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:26:14.979539 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2ea83bb4-d1c2-4484-854c-ff78eb99335c tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.837532 Aug 22 17:26:14.983230 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 951/1903] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:26:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:26:25.003330 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:25.008959 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0253cd3e-071c-411b-bfc8-9c5f697bca23 tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-653884558", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9cbdc50-2e7f-4bb5-bb29-9fc041d16e37"}], "security_groups": [{"name": "tempest-securitygroup--691976374"}], "key_name": "tempest-keypair-214370225", "user_data": "}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:26:26.013579 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-0253cd3e-071c-411b-bfc8-9c5f697bca23 tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] validate_networks() for [('c9cbdc50-2e7f-4bb5-bb29-9fc041d16e37', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-0253cd3e-071c-411b-bfc8-9c5f697bca23 tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cc94854c-5f7d-4c6a-be48-1a95578f2068) Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:26:26.877932 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:26:26.886974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:26:26.886974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:26:26.886974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:26:26.886974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:26:26.886974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:26:26.886974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:26:26.886974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:26:26.886974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:26:26.886974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:26:26.886974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:26:26.886974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:26:26.886974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:26:26.886974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:26:26.886974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:26:26.886974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cc94854c-5f7d-4c6a-be48-1a95578f2068) Aug 22 17:26:26.886974 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:26:26.886974 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-0253cd3e-071c-411b-bfc8-9c5f697bca23 tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:26:26.886974 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0253cd3e-071c-411b-bfc8-9c5f697bca23 tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] Request method failure captured: Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 483 Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7w1KMTXa2JFoNbPq4cMMjFt1N1mdd_HfPnE8VoZI5yqJzYHKRM2ORergkiShXNiObddlC-UG1gMhxfe1AoOz5gGpt0IU2sCJxePasIqMCDWjH1xM_tV_bRRG-_svFcCR0ilk8dL-zQDwXx2DelOJQUvG754hOUDSHDCTBiWpYCC_us Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: e078f565d4f24256857f151c7ce9ca64 Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-AttachVolumeTestJSON-1047005807 Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e078f565d4f24256857f151c7ce9ca64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_e078f565d4f24256857f151c7ce9ca64", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e078f565d4f24256857f151c7ce9ca64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/e078f565d4f24256857f151c7ce9ca64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-AttachVolumeTestJSON-1047005807 Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: e078f565d4f24256857f151c7ce9ca64 Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1047005807 Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-AttachVolumeTestJSON-1047005807-project Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: b9d8cd25487b4d5581f904fd63f761ae Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-AttachVolumeTestJSON-1047005807-project Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-AttachVolumeTestJSON-server-653884558", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "c9cbdc50-2e7f-4bb5-bb29-9fc041d16e37"}], "security_groups": [{"name": "tempest-securitygroup--691976374"}], "key_name": "tempest-keypair-214370225", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeTestJSON-server-653884558', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': 'c9cbdc50-2e7f-4bb5-bb29-9fc041d16e37'}], 'security_groups': [{'name': 'tempest-securitygroup--691976374'}], 'key_name': 'tempest-keypair-214370225', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:26:26.902646 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cc94854c-5f7d-4c6a-be48-1a95578f2068) Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:26.913929 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0253cd3e-071c-411b-bfc8-9c5f697bca23 tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:26:26.926344 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:26:26.931543 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0253cd3e-071c-411b-bfc8-9c5f697bca23 tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.926890 Aug 22 17:26:26.942252 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 953/1904] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:26:25 2022] POST /compute/v2.1/servers => generated 214 bytes in 1941 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:26:26.959397 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-eb0e3a41-b4a2-4d17-8154-ea26761bc5cd tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] Calling method '.version_select at 0x7f800971c8b0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:26.989597 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:27.153277 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-eb0e3a41-b4a2-4d17-8154-ea26761bc5cd tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-214370225" status: 202 len: 0 microversion: 2.1 time: 0.202727 Aug 22 17:26:27.154916 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 952/1905] 10.222.0.96 () {58 vars in 1218 bytes} [Mon Aug 22 17:26:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-214370225 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:26:31.266886 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fe0201b9-7448-4cc0-a364-c1ee0d8c6f73 tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] Action: 'create', calling method: .version_select at 0x7f800924ba60>, body: {"keypair": {"name": "tempest-keypair-179729938", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJNE+v+2gm2sFhC+jk9GiadECAsrNLSIFVgYSX2TdXd+DS9mbUeELBLHj3sGxdReYj+qvjhPNTrPlueKb5bpcT54wPbB0jL1AQFzfR8wrRsjmbmbaMCOiuZhPtxZlnIog=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:26:31.304672 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-fe0201b9-7448-4cc0-a364-c1ee0d8c6f73 tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] Getting quotas for project e078f565d4f24256857f151c7ce9ca64. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:26:31.319443 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-fe0201b9-7448-4cc0-a364-c1ee0d8c6f73 tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] Getting quotas for user b9d8cd25487b4d5581f904fd63f761ae and project e078f565d4f24256857f151c7ce9ca64. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:26:31.478111 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fe0201b9-7448-4cc0-a364-c1ee0d8c6f73 tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.216089 Aug 22 17:26:31.478820 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 954/1906] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:26:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:26:40.191181 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ce519118-71b8-4060-b3ea-31ceb0ee72e9 tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-49212183", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9cbdc50-2e7f-4bb5-bb29-9fc041d16e37"}], "security_groups": [{"name": "tempest-securitygroup--995196059"}], "key_name": "tempest-keypair-179729938", "user_data": "}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:26:40.205609 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:41.154131 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-ce519118-71b8-4060-b3ea-31ceb0ee72e9 tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] validate_networks() for [('c9cbdc50-2e7f-4bb5-bb29-9fc041d16e37', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-ce519118-71b8-4060-b3ea-31ceb0ee72e9 tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dbbb4810-b289-4324-9f87-5bd935e0ec78) Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:26:42.065176 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:26:42.068542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:26:42.068542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:26:42.068542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:26:42.068542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:26:42.068542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:26:42.068542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:26:42.068542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:26:42.068542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:26:42.068542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:26:42.068542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:26:42.068542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:26:42.068542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:26:42.068542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:26:42.068542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:26:42.068542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dbbb4810-b289-4324-9f87-5bd935e0ec78) Aug 22 17:26:42.068542 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:26:42.068542 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-ce519118-71b8-4060-b3ea-31ceb0ee72e9 tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:26:42.068542 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ce519118-71b8-4060-b3ea-31ceb0ee72e9 tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] Request method failure captured: Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 482 Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA7w1KMTXa2JFoNbPq4cMMjFt1N1mdd_HfPnE8VoZI5yqJzYHKRM2ORergkiShXNiObddlC-UG1gMhxfe1AoOz5gGpt0IU2sCJxePasIqMCDWjH1xM_tV_bRRG-_svFcCR0ilk8dL-zQDwXx2DelOJQUvG754hOUDSHDCTBiWpYCC_us Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: e078f565d4f24256857f151c7ce9ca64 Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-AttachVolumeTestJSON-1047005807 Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e078f565d4f24256857f151c7ce9ca64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_e078f565d4f24256857f151c7ce9ca64", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e078f565d4f24256857f151c7ce9ca64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/e078f565d4f24256857f151c7ce9ca64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-AttachVolumeTestJSON-1047005807 Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: e078f565d4f24256857f151c7ce9ca64 Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1047005807 Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-AttachVolumeTestJSON-1047005807-project Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: b9d8cd25487b4d5581f904fd63f761ae Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-AttachVolumeTestJSON-1047005807-project Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-AttachVolumeTestJSON-server-49212183", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "c9cbdc50-2e7f-4bb5-bb29-9fc041d16e37"}], "security_groups": [{"name": "tempest-securitygroup--995196059"}], "key_name": "tempest-keypair-179729938", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeTestJSON-server-49212183', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': 'c9cbdc50-2e7f-4bb5-bb29-9fc041d16e37'}], 'security_groups': [{'name': 'tempest-securitygroup--995196059'}], 'key_name': 'tempest-keypair-179729938', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:26:42.073392 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dbbb4810-b289-4324-9f87-5bd935e0ec78) Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:42.084330 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ce519118-71b8-4060-b3ea-31ceb0ee72e9 tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:26:42.088363 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ce519118-71b8-4060-b3ea-31ceb0ee72e9 tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.892524 Aug 22 17:26:42.090381 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 953/1907] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:26:40 2022] POST /compute/v2.1/servers => generated 214 bytes in 1904 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:26:42.100984 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-34d2d9cf-32a2-45b7-8605-6cdd0c7df1df tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] Calling method '.version_select at 0x7f80090878b0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:42.124641 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:42.138764 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:42.301830 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-34d2d9cf-32a2-45b7-8605-6cdd0c7df1df tempest-AttachVolumeTestJSON-1047005807 tempest-AttachVolumeTestJSON-1047005807-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-179729938" status: 202 len: 0 microversion: 2.1 time: 0.209985 Aug 22 17:26:42.306677 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 955/1908] 10.222.0.96 () {58 vars in 1218 bytes} [Mon Aug 22 17:26:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-179729938 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:26:44.008071 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:26:44.008919 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:26:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:27:58.569574 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2f82da76-99b0-4132-a8fc-58c9e7a4d425 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322-project-admin] Calling method '.version_select at 0x7f8009b5fca0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:58.583024 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:27:58.583024 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:27:58.583024 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2f82da76-99b0-4132-a8fc-58c9e7a4d425 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:58.585392 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2f82da76-99b0-4132-a8fc-58c9e7a4d425 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:58.586105 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2f82da76-99b0-4132-a8fc-58c9e7a4d425 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:58.626067 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2f82da76-99b0-4132-a8fc-58c9e7a4d425 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:58.627144 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2f82da76-99b0-4132-a8fc-58c9e7a4d425 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:58.629470 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2f82da76-99b0-4132-a8fc-58c9e7a4d425 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:58.646379 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2f82da76-99b0-4132-a8fc-58c9e7a4d425 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:58.647278 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2f82da76-99b0-4132-a8fc-58c9e7a4d425 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:58.648005 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-2f82da76-99b0-4132-a8fc-58c9e7a4d425 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:58.664500 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2f82da76-99b0-4132-a8fc-58c9e7a4d425 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643396322-project-admin] 10.222.0.96 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.657689 Aug 22 17:27:58.668005 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 954/1909] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:27:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:28:05.630632 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:28:05.631460 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:28:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:28:40.284050 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6b731f6c-5425-4da5-b904-6b773474d204 tempest-VolumesActionsTest-1841706373 tempest-VolumesActionsTest-1841706373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-136453810", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "6a21e0bc-9861-4ab3-9033-63e87d061b80"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:28:40.451117 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-6b731f6c-5425-4da5-b904-6b773474d204 tempest-VolumesActionsTest-1841706373 tempest-VolumesActionsTest-1841706373-project] validate_networks() for [('6a21e0bc-9861-4ab3-9033-63e87d061b80', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-6b731f6c-5425-4da5-b904-6b773474d204 tempest-VolumesActionsTest-1841706373 tempest-VolumesActionsTest-1841706373-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9f119c66-c4f1-400d-a59b-6f381ce98d07) Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:28:41.703667 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:28:41.707904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:28:41.707904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:28:41.707904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:28:41.707904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:28:41.707904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:28:41.707904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:28:41.707904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:28:41.707904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:28:41.707904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:28:41.707904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:28:41.707904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:28:41.707904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:28:41.707904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:28:41.707904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:28:41.707904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9f119c66-c4f1-400d-a59b-6f381ce98d07) Aug 22 17:28:41.707904 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:28:41.707904 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-6b731f6c-5425-4da5-b904-6b773474d204 tempest-VolumesActionsTest-1841706373 tempest-VolumesActionsTest-1841706373-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:28:41.707904 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6b731f6c-5425-4da5-b904-6b773474d204 tempest-VolumesActionsTest-1841706373 tempest-VolumesActionsTest-1841706373-project] Request method failure captured: Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 205 Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7zBQK1l4tsEFdHREsqTZolZy6SFbOiy6p_wp8rsfL6ElqRLQxLvNTmQPLY_6DhUyYNLAgHuF4dMchdRbaJGFYeMZsmoIP1DKJ3_EfNI2sryojffhMHCKAesuGesowZCeVoaY1o46sumgm7hneNfHGdPDER6JMI15Ch1mxbxPOwHJhE Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: e6b7cdacb11a47f38f4a086937702ac9 Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-VolumesActionsTest-1841706373 Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e6b7cdacb11a47f38f4a086937702ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_e6b7cdacb11a47f38f4a086937702ac9", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/e6b7cdacb11a47f38f4a086937702ac9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/e6b7cdacb11a47f38f4a086937702ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-VolumesActionsTest-1841706373 Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: e6b7cdacb11a47f38f4a086937702ac9 Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-VolumesActionsTest-1841706373 Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-VolumesActionsTest-1841706373-project Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: abae46684d8d45208c70d7fcaf9f7c7e Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-VolumesActionsTest-1841706373-project Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-VolumesActionsTest-instance-136453810", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "6a21e0bc-9861-4ab3-9033-63e87d061b80"}]}} Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-VolumesActionsTest-instance-136453810', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '6a21e0bc-9861-4ab3-9033-63e87d061b80'}]}}} Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:28:41.713572 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9f119c66-c4f1-400d-a59b-6f381ce98d07) Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:28:41.717519 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:28:41.725651 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:28:41.725651 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:28:41.725651 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:28:41.725651 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:28:41.725651 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:28:41.725651 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:41.725651 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:28:41.725651 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:28:41.725651 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:28:41.725651 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:28:41.725651 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:28:41.725651 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:28:41.725651 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:28:41.730050 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6b731f6c-5425-4da5-b904-6b773474d204 tempest-VolumesActionsTest-1841706373 tempest-VolumesActionsTest-1841706373-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:28:41.730050 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:28:41.731342 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6b731f6c-5425-4da5-b904-6b773474d204 tempest-VolumesActionsTest-1841706373 tempest-VolumesActionsTest-1841706373-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.764208 Aug 22 17:28:41.741307 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 956/1910] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:28:39 2022] POST /compute/v2.1/servers => generated 214 bytes in 1776 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:29:32.514432 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:29:32.515132 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:29:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:29:32.719524 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:29:32.719757 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:29:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:29:33.718516 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:29:33.719076 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:29:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:29:34.342307 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:29:34.342307 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:29:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:30:03.143273 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-34af3418-c741-48b1-96ae-0dc0b5a3d8f6 tempest-VolumesActionsTest-572867422 tempest-VolumesActionsTest-572867422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1915745195", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "7bd06c82-32e0-4d02-bb5d-e3160232df70"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:30:03.195343 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=6 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:03.277296 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-34af3418-c741-48b1-96ae-0dc0b5a3d8f6 tempest-VolumesActionsTest-572867422 tempest-VolumesActionsTest-572867422-project] validate_networks() for [('7bd06c82-32e0-4d02-bb5d-e3160232df70', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:30:04.022552 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:30:04.023005 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:30:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-34af3418-c741-48b1-96ae-0dc0b5a3d8f6 tempest-VolumesActionsTest-572867422 tempest-VolumesActionsTest-572867422-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e0d12cfa-6b34-4071-ad91-36e71ff14560) Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:30:04.152736 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:30:04.160299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:30:04.160299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:30:04.160299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:30:04.160299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:30:04.160299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:30:04.160299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:30:04.160299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:30:04.160299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:30:04.160299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:30:04.160299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:30:04.160299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:30:04.160299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:30:04.160299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:30:04.160299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:30:04.160299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e0d12cfa-6b34-4071-ad91-36e71ff14560) Aug 22 17:30:04.160299 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:30:04.169418 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-34af3418-c741-48b1-96ae-0dc0b5a3d8f6 tempest-VolumesActionsTest-572867422 tempest-VolumesActionsTest-572867422-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:30:04.169418 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-34af3418-c741-48b1-96ae-0dc0b5a3d8f6 tempest-VolumesActionsTest-572867422 tempest-VolumesActionsTest-572867422-project] Request method failure captured: Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 206 Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA70Vfn-ES7tLXwfqQJ8TPdDmpLhbLfaRbvY_nqknghV6dIR_qikBM1M6OJpPQjtStKy4DF0HeBtZ84FjMxQ49nnvayIwoHJZ_svuUVafc9m1kpRlMRD2lcnj5SfOIUmFmGZSluQIx4PJs_pj71n0WQ31JNEy2N_9dgzgiGs0H3Jed-M Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 14b3a97e6ac84c80a5c7e50dd8b91f9c Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-VolumesActionsTest-572867422 Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/14b3a97e6ac84c80a5c7e50dd8b91f9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_14b3a97e6ac84c80a5c7e50dd8b91f9c", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/14b3a97e6ac84c80a5c7e50dd8b91f9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/14b3a97e6ac84c80a5c7e50dd8b91f9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-VolumesActionsTest-572867422 Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 14b3a97e6ac84c80a5c7e50dd8b91f9c Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-VolumesActionsTest-572867422 Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-VolumesActionsTest-572867422-project Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 00d4fbcf7d34418f8171e8c68d1723dc Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-VolumesActionsTest-572867422-project Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-VolumesActionsTest-instance-1915745195", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "7bd06c82-32e0-4d02-bb5d-e3160232df70"}]}} Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-VolumesActionsTest-instance-1915745195', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '7bd06c82-32e0-4d02-bb5d-e3160232df70'}]}}} Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:30:04.173122 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e0d12cfa-6b34-4071-ad91-36e71ff14560) Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:30:04.181899 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:30:04.196072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:30:04.196072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:30:04.196072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:30:04.196072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:30:04.196072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:30:04.196072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:30:04.196072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:30:04.196072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:30:04.196072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:30:04.196072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:30:04.196072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:30:04.196072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:30:04.196072 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:30:04.196072 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-34af3418-c741-48b1-96ae-0dc0b5a3d8f6 tempest-VolumesActionsTest-572867422 tempest-VolumesActionsTest-572867422-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:30:04.196072 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:30:04.200367 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-34af3418-c741-48b1-96ae-0dc0b5a3d8f6 tempest-VolumesActionsTest-572867422 tempest-VolumesActionsTest-572867422-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.051839 Aug 22 17:30:04.202558 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 955/1911] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:30:03 2022] POST /compute/v2.1/servers => generated 214 bytes in 1069 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:30:04.370632 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:04.377509 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e1596112-cc26-4cf3-a731-5d528468e070 tempest-VolumesActionsTest-572867422 tempest-VolumesActionsTest-572867422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1864253920", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "7bd06c82-32e0-4d02-bb5d-e3160232df70"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:30:04.470903 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-e1596112-cc26-4cf3-a731-5d528468e070 tempest-VolumesActionsTest-572867422 tempest-VolumesActionsTest-572867422-project] validate_networks() for [('7bd06c82-32e0-4d02-bb5d-e3160232df70', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-e1596112-cc26-4cf3-a731-5d528468e070 tempest-VolumesActionsTest-572867422 tempest-VolumesActionsTest-572867422-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d1ea6405-3939-41dc-8132-494fa52ca7b7) Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:30:05.108832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:30:05.112313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:30:05.112313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:30:05.112313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:30:05.112313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:30:05.112313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:30:05.112313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:30:05.112313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:30:05.112313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:30:05.112313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:30:05.112313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:30:05.112313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:30:05.112313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:30:05.112313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:30:05.112313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:30:05.112313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d1ea6405-3939-41dc-8132-494fa52ca7b7) Aug 22 17:30:05.112313 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:30:05.112313 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-e1596112-cc26-4cf3-a731-5d528468e070 tempest-VolumesActionsTest-572867422 tempest-VolumesActionsTest-572867422-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:30:05.112313 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e1596112-cc26-4cf3-a731-5d528468e070 tempest-VolumesActionsTest-572867422 tempest-VolumesActionsTest-572867422-project] Request method failure captured: Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 206 Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA70Vfn-ES7tLXwfqQJ8TPdDmpLhbLfaRbvY_nqknghV6dIR_qikBM1M6OJpPQjtStKy4DF0HeBtZ84FjMxQ49nnvayIwoHJZ_svuUVafc9m1kpRlMRD2lcnj5SfOIUmFmGZSluQIx4PJs_pj71n0WQ31JNEy2N_9dgzgiGs0H3Jed-M Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 14b3a97e6ac84c80a5c7e50dd8b91f9c Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-VolumesActionsTest-572867422 Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/14b3a97e6ac84c80a5c7e50dd8b91f9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_14b3a97e6ac84c80a5c7e50dd8b91f9c", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/14b3a97e6ac84c80a5c7e50dd8b91f9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/14b3a97e6ac84c80a5c7e50dd8b91f9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-VolumesActionsTest-572867422 Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 14b3a97e6ac84c80a5c7e50dd8b91f9c Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-VolumesActionsTest-572867422 Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-VolumesActionsTest-572867422-project Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 00d4fbcf7d34418f8171e8c68d1723dc Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-VolumesActionsTest-572867422-project Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-VolumesActionsTest-instance-1864253920", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "7bd06c82-32e0-4d02-bb5d-e3160232df70"}]}} Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-VolumesActionsTest-instance-1864253920', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '7bd06c82-32e0-4d02-bb5d-e3160232df70'}]}}} Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:30:05.113372 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d1ea6405-3939-41dc-8132-494fa52ca7b7) Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:30:05.126720 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:30:05.134832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:30:05.134832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:30:05.134832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:30:05.134832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:30:05.134832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:30:05.134832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:30:05.134832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:30:05.134832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:30:05.134832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:30:05.134832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:30:05.134832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:30:05.134832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:30:05.134832 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:30:05.134832 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e1596112-cc26-4cf3-a731-5d528468e070 tempest-VolumesActionsTest-572867422 tempest-VolumesActionsTest-572867422-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:30:05.134832 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:30:05.134832 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e1596112-cc26-4cf3-a731-5d528468e070 tempest-VolumesActionsTest-572867422 tempest-VolumesActionsTest-572867422-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.745372 Aug 22 17:30:05.134832 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 957/1912] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:30:04 2022] POST /compute/v2.1/servers => generated 214 bytes in 748 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:30:39.118534 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=10 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:40.028252 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-11518ceb-a043-46c0-a44d-397a09d6c1ae tempest-TestServerBasicOps-571567790 tempest-TestServerBasicOps-571567790-project] Action: 'create', calling method: .version_select at 0x7f8009d42ca0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-539927722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETGyg2tuVenhzYUhxvShJUWjpoGNeGhYXcUPMcPk5cwJa/x9H4qDDrrk9WuBUnNvotjgdBc+H3FoWGMnY2KTZeeuDy52cdi+Ju+0Kpv/fQX3LQazK7T1w3/W9pkaUjgcA=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:30:40.114517 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-11518ceb-a043-46c0-a44d-397a09d6c1ae tempest-TestServerBasicOps-571567790 tempest-TestServerBasicOps-571567790-project] Getting quotas for project 1a77a7f21b1c46799e426a4168945af3. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:30:40.168861 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-11518ceb-a043-46c0-a44d-397a09d6c1ae tempest-TestServerBasicOps-571567790 tempest-TestServerBasicOps-571567790-project] Getting quotas for user ac00e6ee4cda44969bcdb17080ab57e1 and project 1a77a7f21b1c46799e426a4168945af3. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:30:40.448556 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-11518ceb-a043-46c0-a44d-397a09d6c1ae tempest-TestServerBasicOps-571567790 tempest-TestServerBasicOps-571567790-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.340876 Aug 22 17:30:40.450072 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 956/1913] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:30:39 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:30:53.454123 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7d6fcdd4-4d36-4ee6-9680-a4dff1281131 tempest-TestServerBasicOps-571567790 tempest-TestServerBasicOps-571567790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-2050435901", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-539927722", "security_groups": [{"name": "tempest-secgroup-smoke-622827528"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "44952973-b1a6-4a61-a33a-5fc3c9e1febf"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:30:54.197439 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-7d6fcdd4-4d36-4ee6-9680-a4dff1281131 tempest-TestServerBasicOps-571567790 tempest-TestServerBasicOps-571567790-project] validate_networks() for [('44952973-b1a6-4a61-a33a-5fc3c9e1febf', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-7d6fcdd4-4d36-4ee6-9680-a4dff1281131 tempest-TestServerBasicOps-571567790 tempest-TestServerBasicOps-571567790-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8e4a7a61-09bf-4de9-9f3b-18117b33d1d7) Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:30:55.060874 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:30:55.064566 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:30:55.064566 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:30:55.064566 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:30:55.064566 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:30:55.064566 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:30:55.064566 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:30:55.064566 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:30:55.064566 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:30:55.064566 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:30:55.064566 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:30:55.064566 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:30:55.064566 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:30:55.064566 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:30:55.064566 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:30:55.064566 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8e4a7a61-09bf-4de9-9f3b-18117b33d1d7) Aug 22 17:30:55.064566 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:30:55.064566 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-7d6fcdd4-4d36-4ee6-9680-a4dff1281131 tempest-TestServerBasicOps-571567790 tempest-TestServerBasicOps-571567790-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:30:55.064566 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7d6fcdd4-4d36-4ee6-9680-a4dff1281131 tempest-TestServerBasicOps-571567790 tempest-TestServerBasicOps-571567790-project] Request method failure captured: Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 413 Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA70ZRg49KoMOhgcB2U8QGF8lr9Zi15i-cPtlpHCN6WpHm6B7ANoFKpQEVh_NDXA-MuHO1fwx0GRZPafSeI_JzNbbBhmfYOTGhba0IxutcQ5pPAPJMPA5J90O8qqHkZFYQ6biER-CX8vNc5ML1KIEDxf9GwPv_QcyARZldvQt9Apzy5I Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 1a77a7f21b1c46799e426a4168945af3 Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-TestServerBasicOps-571567790 Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1a77a7f21b1c46799e426a4168945af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_1a77a7f21b1c46799e426a4168945af3", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/1a77a7f21b1c46799e426a4168945af3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/1a77a7f21b1c46799e426a4168945af3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-TestServerBasicOps-571567790 Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 1a77a7f21b1c46799e426a4168945af3 Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-TestServerBasicOps-571567790 Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-TestServerBasicOps-571567790-project Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: ac00e6ee4cda44969bcdb17080ab57e1 Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-TestServerBasicOps-571567790-project Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-TestServerBasicOps-server-2050435901", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-539927722", "security_groups": [{"name": "tempest-secgroup-smoke-622827528"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "44952973-b1a6-4a61-a33a-5fc3c9e1febf"}]}} Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-TestServerBasicOps-server-2050435901', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'key_name': 'tempest-TestServerBasicOps-539927722', 'security_groups': [{'name': 'tempest-secgroup-smoke-622827528'}], 'config_drive': True, 'metadata': {'meta1': 'data1', 'meta2': 'data2', 'metaN': 'dataN'}, 'networks': [{'uuid': '44952973-b1a6-4a61-a33a-5fc3c9e1febf'}]}}} Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:30:55.083118 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8e4a7a61-09bf-4de9-9f3b-18117b33d1d7) Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:30:55.087557 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:30:55.097491 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:30:55.097491 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:30:55.097491 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:30:55.097491 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:30:55.097491 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:30:55.097491 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:30:55.097491 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:30:55.097491 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:30:55.097491 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:30:55.097491 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:30:55.097491 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:30:55.097491 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:30:55.097491 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:30:55.097491 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:30:55.097491 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:30:55.097491 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:30:55.097491 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:30:55.097491 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7d6fcdd4-4d36-4ee6-9680-a4dff1281131 tempest-TestServerBasicOps-571567790 tempest-TestServerBasicOps-571567790-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:30:55.097491 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:30:55.118815 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7d6fcdd4-4d36-4ee6-9680-a4dff1281131 tempest-TestServerBasicOps-571567790 tempest-TestServerBasicOps-571567790-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.675809 Aug 22 17:30:55.128280 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 958/1914] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:30:53 2022] POST /compute/v2.1/servers => generated 214 bytes in 1693 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:30:56.609438 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1e0d47f8-1904-4637-bc91-b973876d57ad tempest-TestServerBasicOps-571567790 tempest-TestServerBasicOps-571567790-project] Calling method '.version_select at 0x7f8009bb1e50>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:30:56.627699 n-d-854030-1 devstack@n-api.service[123016]: ERROR oslo.messaging._drivers.impl_rabbit [-] [60bafe1f-ace8-482d-a7e4-e745b51a93e7] AMQP server on 10.222.0.96:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 22 17:30:56.636533 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:56.641734 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:30:56.766464 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1e0d47f8-1904-4637-bc91-b973876d57ad tempest-TestServerBasicOps-571567790 tempest-TestServerBasicOps-571567790-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-539927722" status: 202 len: 0 microversion: 2.1 time: 0.161019 Aug 22 17:30:56.767683 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 957/1915] 10.222.0.96 () {58 vars in 1251 bytes} [Mon Aug 22 17:30:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-539927722 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:31:06.754846 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=6 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:06.760611 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b74059a8-0b27-4d62-9c0a-876e5f6964ec tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-413277949", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:31:06.918928 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-b74059a8-0b27-4d62-9c0a-876e5f6964ec tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] validate_networks() for None {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:31:08.099597 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-b74059a8-0b27-4d62-9c0a-876e5f6964ec tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:31:08.101485 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-b74059a8-0b27-4d62-9c0a-876e5f6964ec tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:31:08.105706 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-b74059a8-0b27-4d62-9c0a-876e5f6964ec tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:31:08.106739 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-b74059a8-0b27-4d62-9c0a-876e5f6964ec tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:31:08.109490 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-b74059a8-0b27-4d62-9c0a-876e5f6964ec tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:31:08.167931 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b74059a8-0b27-4d62-9c0a-876e5f6964ec tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:08.167931 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b74059a8-0b27-4d62-9c0a-876e5f6964ec tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:08.179103 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b74059a8-0b27-4d62-9c0a-876e5f6964ec tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:08.180169 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b74059a8-0b27-4d62-9c0a-876e5f6964ec tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:08.196318 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b74059a8-0b27-4d62-9c0a-876e5f6964ec tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:08.196827 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-b74059a8-0b27-4d62-9c0a-876e5f6964ec tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:08.233760 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-b74059a8-0b27-4d62-9c0a-876e5f6964ec tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Getting quotas for project ec4aa64ffc8743d5833136aa57c96dba. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:31:08.267372 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-b74059a8-0b27-4d62-9c0a-876e5f6964ec tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Getting quotas for user e814d921c4aa44b48f825df8ea4c46a1 and project ec4aa64ffc8743d5833136aa57c96dba. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:31:08.288354 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b74059a8-0b27-4d62-9c0a-876e5f6964ec tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Going to run 1 instances... {{(pid=123015) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:31:08.292174 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-b74059a8-0b27-4d62-9c0a-876e5f6964ec tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:31:08.536572 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b74059a8-0b27-4d62-9c0a-876e5f6964ec tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.782898 Aug 22 17:31:08.543767 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 959/1916] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:31:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:31:08.552065 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-762b14ee-e638-4c2e-8406-49146c491293 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:08.552814 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-762b14ee-e638-4c2e-8406-49146c491293 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:08.647437 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] [60bafe1f-ace8-482d-a7e4-e745b51a93e7] Reconnected to AMQP server on 10.222.0.96:5672 via [amqp] client with port 56360. Aug 22 17:31:09.171561 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-762b14ee-e638-4c2e-8406-49146c491293 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:09.185045 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-762b14ee-e638-4c2e-8406-49146c491293 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1214 microversion: 2.1 time: 0.639105 Aug 22 17:31:09.188578 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 958/1917] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:08 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1214 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:10.212893 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3020277b-24fc-49f0-af57-14e8befdb246 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:10.214627 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-3020277b-24fc-49f0-af57-14e8befdb246 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:10.797748 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-3020277b-24fc-49f0-af57-14e8befdb246 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:10.807630 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3020277b-24fc-49f0-af57-14e8befdb246 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1214 microversion: 2.1 time: 0.600363 Aug 22 17:31:10.818667 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 960/1918] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:10 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1214 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:11.833132 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-763e097a-8f27-4d6a-9d37-3348ae860c0f tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:11.839986 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-763e097a-8f27-4d6a-9d37-3348ae860c0f tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:11.858245 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-763e097a-8f27-4d6a-9d37-3348ae860c0f tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:11.859204 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-763e097a-8f27-4d6a-9d37-3348ae860c0f tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:11.860034 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-763e097a-8f27-4d6a-9d37-3348ae860c0f tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:11.861509 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-763e097a-8f27-4d6a-9d37-3348ae860c0f tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:11.862242 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-763e097a-8f27-4d6a-9d37-3348ae860c0f tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:11.862951 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-763e097a-8f27-4d6a-9d37-3348ae860c0f tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:12.032663 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-763e097a-8f27-4d6a-9d37-3348ae860c0f tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:12.049716 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-763e097a-8f27-4d6a-9d37-3348ae860c0f tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1210 microversion: 2.1 time: 0.221049 Aug 22 17:31:12.050321 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 959/1919] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:11 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1210 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:13.082530 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-ddc5adc2-7d3d-493b-bc91-3aac206407ae tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:13.085594 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-ddc5adc2-7d3d-493b-bc91-3aac206407ae tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:13.132909 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ddc5adc2-7d3d-493b-bc91-3aac206407ae tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:13.134766 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ddc5adc2-7d3d-493b-bc91-3aac206407ae tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:13.135451 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ddc5adc2-7d3d-493b-bc91-3aac206407ae tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:13.141583 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ddc5adc2-7d3d-493b-bc91-3aac206407ae tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:13.142285 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ddc5adc2-7d3d-493b-bc91-3aac206407ae tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:13.142838 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-ddc5adc2-7d3d-493b-bc91-3aac206407ae tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:13.723156 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-ddc5adc2-7d3d-493b-bc91-3aac206407ae tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:13.744774 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-ddc5adc2-7d3d-493b-bc91-3aac206407ae tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1274 microversion: 2.1 time: 0.675401 Aug 22 17:31:13.745725 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 961/1920] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:13 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1274 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:14.768209 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7307b86a-e1c8-417d-8aaf-5a0e8e83419b tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:14.768913 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-7307b86a-e1c8-417d-8aaf-5a0e8e83419b tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:14.782548 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7307b86a-e1c8-417d-8aaf-5a0e8e83419b tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:14.791149 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7307b86a-e1c8-417d-8aaf-5a0e8e83419b tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:14.791149 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7307b86a-e1c8-417d-8aaf-5a0e8e83419b tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:14.791149 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7307b86a-e1c8-417d-8aaf-5a0e8e83419b tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:14.791149 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7307b86a-e1c8-417d-8aaf-5a0e8e83419b tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:14.791149 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7307b86a-e1c8-417d-8aaf-5a0e8e83419b tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:14.964003 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-7307b86a-e1c8-417d-8aaf-5a0e8e83419b tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:14.982809 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7307b86a-e1c8-417d-8aaf-5a0e8e83419b tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1272 microversion: 2.1 time: 0.218510 Aug 22 17:31:14.983387 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 960/1921] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:14 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:31:16.014233 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e30fa399-b642-4cde-800d-1f0bd66842ce tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:16.015483 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-e30fa399-b642-4cde-800d-1f0bd66842ce tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:16.023290 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e30fa399-b642-4cde-800d-1f0bd66842ce tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:16.023786 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e30fa399-b642-4cde-800d-1f0bd66842ce tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:16.024753 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e30fa399-b642-4cde-800d-1f0bd66842ce tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:16.025595 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e30fa399-b642-4cde-800d-1f0bd66842ce tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:16.026237 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e30fa399-b642-4cde-800d-1f0bd66842ce tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:16.026664 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e30fa399-b642-4cde-800d-1f0bd66842ce tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:16.397230 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e30fa399-b642-4cde-800d-1f0bd66842ce tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:16.409517 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e30fa399-b642-4cde-800d-1f0bd66842ce tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1272 microversion: 2.1 time: 0.394269 Aug 22 17:31:16.409517 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 962/1922] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:16 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1272 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:17.432558 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ffc2e780-1850-4bdb-b3e6-3b4a09165f87 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:17.433278 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-ffc2e780-1850-4bdb-b3e6-3b4a09165f87 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:17.440049 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ffc2e780-1850-4bdb-b3e6-3b4a09165f87 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:17.440783 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ffc2e780-1850-4bdb-b3e6-3b4a09165f87 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:17.442672 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ffc2e780-1850-4bdb-b3e6-3b4a09165f87 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:17.444412 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ffc2e780-1850-4bdb-b3e6-3b4a09165f87 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:17.446008 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ffc2e780-1850-4bdb-b3e6-3b4a09165f87 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:17.447944 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ffc2e780-1850-4bdb-b3e6-3b4a09165f87 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:17.709127 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-ffc2e780-1850-4bdb-b3e6-3b4a09165f87 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:17.748388 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ffc2e780-1850-4bdb-b3e6-3b4a09165f87 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1272 microversion: 2.1 time: 0.321311 Aug 22 17:31:17.752599 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 961/1923] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:17 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1272 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:18.785031 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8cd6582d-d30d-4609-a418-30956e782d79 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:18.788201 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8cd6582d-d30d-4609-a418-30956e782d79 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:18.809888 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:18.812588 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8cd6582d-d30d-4609-a418-30956e782d79 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:18.815747 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8cd6582d-d30d-4609-a418-30956e782d79 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:18.816413 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8cd6582d-d30d-4609-a418-30956e782d79 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:18.819202 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8cd6582d-d30d-4609-a418-30956e782d79 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:18.819911 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8cd6582d-d30d-4609-a418-30956e782d79 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:18.821602 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8cd6582d-d30d-4609-a418-30956e782d79 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:19.594827 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8cd6582d-d30d-4609-a418-30956e782d79 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:19.607206 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8cd6582d-d30d-4609-a418-30956e782d79 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1314 microversion: 2.1 time: 0.825281 Aug 22 17:31:19.607847 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 963/1924] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:18 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1314 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:20.630600 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-61153fcb-f7b7-4842-b46d-6e11e69d2df9 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:20.631301 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-61153fcb-f7b7-4842-b46d-6e11e69d2df9 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:20.634098 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:20.649829 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-61153fcb-f7b7-4842-b46d-6e11e69d2df9 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:20.650782 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-61153fcb-f7b7-4842-b46d-6e11e69d2df9 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:20.651403 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-61153fcb-f7b7-4842-b46d-6e11e69d2df9 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:20.652324 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-61153fcb-f7b7-4842-b46d-6e11e69d2df9 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:20.652954 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-61153fcb-f7b7-4842-b46d-6e11e69d2df9 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:20.653708 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-61153fcb-f7b7-4842-b46d-6e11e69d2df9 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:21.227997 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-61153fcb-f7b7-4842-b46d-6e11e69d2df9 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:21.238244 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-61153fcb-f7b7-4842-b46d-6e11e69d2df9 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1314 microversion: 2.1 time: 0.612383 Aug 22 17:31:21.238848 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 962/1925] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:20 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:22.151287 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=8 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:22.263362 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e31f112e-50b2-4db8-be6f-a40f150cc4d4 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:22.263990 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-e31f112e-50b2-4db8-be6f-a40f150cc4d4 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:22.287223 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e31f112e-50b2-4db8-be6f-a40f150cc4d4 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:22.287553 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e31f112e-50b2-4db8-be6f-a40f150cc4d4 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:22.288675 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e31f112e-50b2-4db8-be6f-a40f150cc4d4 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:22.289480 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e31f112e-50b2-4db8-be6f-a40f150cc4d4 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:22.290204 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e31f112e-50b2-4db8-be6f-a40f150cc4d4 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:22.290701 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-e31f112e-50b2-4db8-be6f-a40f150cc4d4 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:22.441230 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-2a4a57eb-ad4a-4b49-91d8-4b11e629679c req-2fe49367-0db3-40a8-8e29-ee4ad75e12c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6743d0e-b3ba-425a-92ed-15a3648a4c68", "tag": "08a047cd-3292-4acc-abc4-80a443c0ce87"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:31:22.480053 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-2a4a57eb-ad4a-4b49-91d8-4b11e629679c req-2fe49367-0db3-40a8-8e29-ee4ad75e12c6 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:22.480552 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-2a4a57eb-ad4a-4b49-91d8-4b11e629679c req-2fe49367-0db3-40a8-8e29-ee4ad75e12c6 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:22.480996 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-2a4a57eb-ad4a-4b49-91d8-4b11e629679c req-2fe49367-0db3-40a8-8e29-ee4ad75e12c6 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:22.518891 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-2a4a57eb-ad4a-4b49-91d8-4b11e629679c req-2fe49367-0db3-40a8-8e29-ee4ad75e12c6 service nova] Creating event network-changed:08a047cd-3292-4acc-abc4-80a443c0ce87 for instance f6743d0e-b3ba-425a-92ed-15a3648a4c68 on n-h1-854030-1 Aug 22 17:31:22.536015 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-2a4a57eb-ad4a-4b49-91d8-4b11e629679c req-2fe49367-0db3-40a8-8e29-ee4ad75e12c6 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.389008 Aug 22 17:31:22.536641 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 964/1926] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:31:23.121262 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-e31f112e-50b2-4db8-be6f-a40f150cc4d4 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:23.134220 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e31f112e-50b2-4db8-be6f-a40f150cc4d4 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1314 microversion: 2.1 time: 0.874080 Aug 22 17:31:23.135195 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 963/1927] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:22 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1314 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:31:24.158415 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-43e824bb-fc29-44e8-861c-f76f420da987 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:24.159473 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-43e824bb-fc29-44e8-861c-f76f420da987 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:24.176471 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-43e824bb-fc29-44e8-861c-f76f420da987 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:24.177320 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-43e824bb-fc29-44e8-861c-f76f420da987 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:24.177935 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-43e824bb-fc29-44e8-861c-f76f420da987 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:24.178822 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-43e824bb-fc29-44e8-861c-f76f420da987 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:24.179443 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-43e824bb-fc29-44e8-861c-f76f420da987 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:24.180031 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-43e824bb-fc29-44e8-861c-f76f420da987 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:24.849206 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-43e824bb-fc29-44e8-861c-f76f420da987 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:24.864264 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-43e824bb-fc29-44e8-861c-f76f420da987 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1314 microversion: 2.1 time: 0.708394 Aug 22 17:31:24.866962 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 965/1928] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:24 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1314 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:25.643880 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:31:25.644451 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:31:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:31:25.900832 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-42929fa2-0e8f-453a-8d21-171ed8fe6fcb tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:25.901662 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-42929fa2-0e8f-453a-8d21-171ed8fe6fcb tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:25.921906 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-42929fa2-0e8f-453a-8d21-171ed8fe6fcb tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:25.922803 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-42929fa2-0e8f-453a-8d21-171ed8fe6fcb tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:25.923384 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-42929fa2-0e8f-453a-8d21-171ed8fe6fcb tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:25.924275 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-42929fa2-0e8f-453a-8d21-171ed8fe6fcb tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:25.924815 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-42929fa2-0e8f-453a-8d21-171ed8fe6fcb tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:25.925370 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-42929fa2-0e8f-453a-8d21-171ed8fe6fcb tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:26.738315 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-42929fa2-0e8f-453a-8d21-171ed8fe6fcb tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:26.747687 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-42929fa2-0e8f-453a-8d21-171ed8fe6fcb tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1314 microversion: 2.1 time: 0.851441 Aug 22 17:31:26.754349 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 964/1929] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:25 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1314 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:27.776101 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-fdf2f046-2629-44e8-8e35-44c241fd5fe3 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:27.776772 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-fdf2f046-2629-44e8-8e35-44c241fd5fe3 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:27.797271 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fdf2f046-2629-44e8-8e35-44c241fd5fe3 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:27.798057 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fdf2f046-2629-44e8-8e35-44c241fd5fe3 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:27.809487 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fdf2f046-2629-44e8-8e35-44c241fd5fe3 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:27.809487 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fdf2f046-2629-44e8-8e35-44c241fd5fe3 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:27.809487 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fdf2f046-2629-44e8-8e35-44c241fd5fe3 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:27.809487 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-fdf2f046-2629-44e8-8e35-44c241fd5fe3 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:28.997658 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-fdf2f046-2629-44e8-8e35-44c241fd5fe3 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:29.024907 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-fdf2f046-2629-44e8-8e35-44c241fd5fe3 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1314 microversion: 2.1 time: 1.253081 Aug 22 17:31:29.026689 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 966/1930] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:27 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1314 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:30.051103 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4f19494c-0eea-4767-a561-548b88fdc68d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:30.052348 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-4f19494c-0eea-4767-a561-548b88fdc68d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:30.059910 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4f19494c-0eea-4767-a561-548b88fdc68d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:30.060497 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4f19494c-0eea-4767-a561-548b88fdc68d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:30.061198 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4f19494c-0eea-4767-a561-548b88fdc68d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:30.061987 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4f19494c-0eea-4767-a561-548b88fdc68d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:30.062531 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4f19494c-0eea-4767-a561-548b88fdc68d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:30.063023 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4f19494c-0eea-4767-a561-548b88fdc68d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:30.731114 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-4f19494c-0eea-4767-a561-548b88fdc68d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:30.761177 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4f19494c-0eea-4767-a561-548b88fdc68d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1314 microversion: 2.1 time: 0.714135 Aug 22 17:31:30.761797 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 965/1931] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:30 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1314 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:31:30.879347 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-7db4d7a6-378f-4657-acdc-f35d3005a956 req-3f3800d9-afac-48cf-9b50-27351bff1237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6743d0e-b3ba-425a-92ed-15a3648a4c68", "name": "network-vif-plugged", "status": "completed", "tag": "08a047cd-3292-4acc-abc4-80a443c0ce87"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:31:30.909028 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-7db4d7a6-378f-4657-acdc-f35d3005a956 req-3f3800d9-afac-48cf-9b50-27351bff1237 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:30.911206 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-7db4d7a6-378f-4657-acdc-f35d3005a956 req-3f3800d9-afac-48cf-9b50-27351bff1237 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:30.913982 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-7db4d7a6-378f-4657-acdc-f35d3005a956 req-3f3800d9-afac-48cf-9b50-27351bff1237 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:30.960107 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-7db4d7a6-378f-4657-acdc-f35d3005a956 req-3f3800d9-afac-48cf-9b50-27351bff1237 service nova] Creating event network-vif-plugged:08a047cd-3292-4acc-abc4-80a443c0ce87 for instance f6743d0e-b3ba-425a-92ed-15a3648a4c68 on n-h1-854030-1 Aug 22 17:31:30.974001 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-7db4d7a6-378f-4657-acdc-f35d3005a956 req-3f3800d9-afac-48cf-9b50-27351bff1237 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.516306 Aug 22 17:31:30.976944 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 967/1932] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:31:31.783801 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8822ab48-3d40-4ea1-8b76-8404bcc2f7c8 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:31.784764 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-8822ab48-3d40-4ea1-8b76-8404bcc2f7c8 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:31.799968 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8822ab48-3d40-4ea1-8b76-8404bcc2f7c8 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:31.800706 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8822ab48-3d40-4ea1-8b76-8404bcc2f7c8 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:31.801886 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8822ab48-3d40-4ea1-8b76-8404bcc2f7c8 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:31.803397 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8822ab48-3d40-4ea1-8b76-8404bcc2f7c8 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:31.804062 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8822ab48-3d40-4ea1-8b76-8404bcc2f7c8 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:31.804670 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8822ab48-3d40-4ea1-8b76-8404bcc2f7c8 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:32.315023 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-8822ab48-3d40-4ea1-8b76-8404bcc2f7c8 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:32.322338 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8822ab48-3d40-4ea1-8b76-8404bcc2f7c8 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1314 microversion: 2.1 time: 0.543060 Aug 22 17:31:32.322903 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 966/1933] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:31 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:31:33.344279 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1ce180f8-75d1-4b61-8bda-49e9101120b1 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:33.345717 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-1ce180f8-75d1-4b61-8bda-49e9101120b1 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:33.353302 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1ce180f8-75d1-4b61-8bda-49e9101120b1 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:33.362967 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1ce180f8-75d1-4b61-8bda-49e9101120b1 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:33.370016 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1ce180f8-75d1-4b61-8bda-49e9101120b1 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:33.370925 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1ce180f8-75d1-4b61-8bda-49e9101120b1 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:33.371401 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1ce180f8-75d1-4b61-8bda-49e9101120b1 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:33.371853 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-1ce180f8-75d1-4b61-8bda-49e9101120b1 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:33.765816 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-1ce180f8-75d1-4b61-8bda-49e9101120b1 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:33.776398 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1ce180f8-75d1-4b61-8bda-49e9101120b1 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1463 microversion: 2.1 time: 0.434581 Aug 22 17:31:33.778921 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 968/1934] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:33 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1463 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:31:33.879850 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0f73e9d2-3a27-4c45-811b-4095fac2d5b6 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:33.880659 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0f73e9d2-3a27-4c45-811b-4095fac2d5b6 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:33.899355 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0f73e9d2-3a27-4c45-811b-4095fac2d5b6 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:33.900895 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0f73e9d2-3a27-4c45-811b-4095fac2d5b6 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:33.903002 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0f73e9d2-3a27-4c45-811b-4095fac2d5b6 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:33.904191 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0f73e9d2-3a27-4c45-811b-4095fac2d5b6 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:33.905640 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0f73e9d2-3a27-4c45-811b-4095fac2d5b6 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:33.906968 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-0f73e9d2-3a27-4c45-811b-4095fac2d5b6 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:33.987468 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-0f73e9d2-3a27-4c45-811b-4095fac2d5b6 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Going to try to terminate instance {{(pid=123015) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:31:34.343921 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e694f693-99fa-4243-ac21-2db95ba57e19 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Action: 'create', calling method: .version_select at 0x7f8009afc4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1227745615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuk3GQ2KH5izTgIOSknc7b1NMkUnkqJDaGEHiT+t1gFIvwujlooiXCXNAKatU7pkwXZsQN4OP/fj8uCnMOUkMubt8ijziVNwbMoGDJJr38vHzFi+KSCehlQuKc9jyeTgQ=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:31:34.380960 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-e694f693-99fa-4243-ac21-2db95ba57e19 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Getting quotas for project 05b947f48bd24315b147bc1cb4c2f6c7. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:31:34.393909 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-e694f693-99fa-4243-ac21-2db95ba57e19 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Getting quotas for user e7ab25bb2da94c739a70719d8829ccda and project 05b947f48bd24315b147bc1cb4c2f6c7. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:31:34.463276 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0f73e9d2-3a27-4c45-811b-4095fac2d5b6 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "DELETE /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 204 len: 0 microversion: 2.1 time: 0.593490 Aug 22 17:31:34.464286 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 969/1935] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:31:33 2022] DELETE /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:31:34.480505 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7355c652-17a0-47d3-b438-b105fd2a3440 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:34.480505 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-7355c652-17a0-47d3-b438-b105fd2a3440 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:34.482773 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7355c652-17a0-47d3-b438-b105fd2a3440 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:34.495758 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7355c652-17a0-47d3-b438-b105fd2a3440 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:34.496287 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7355c652-17a0-47d3-b438-b105fd2a3440 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:34.497153 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7355c652-17a0-47d3-b438-b105fd2a3440 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:34.498157 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7355c652-17a0-47d3-b438-b105fd2a3440 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:34.499607 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7355c652-17a0-47d3-b438-b105fd2a3440 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:34.603712 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e694f693-99fa-4243-ac21-2db95ba57e19 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.744371 Aug 22 17:31:34.603712 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 967/1936] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:31:33 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:31:34.814960 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-7355c652-17a0-47d3-b438-b105fd2a3440 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:34.829007 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7355c652-17a0-47d3-b438-b105fd2a3440 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1469 microversion: 2.1 time: 0.359836 Aug 22 17:31:34.841335 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 970/1937] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:34 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1469 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:35.859803 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-45e19c7b-f7c8-4187-8042-ea101a7ee680 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:35.860423 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-45e19c7b-f7c8-4187-8042-ea101a7ee680 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:35.871108 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45e19c7b-f7c8-4187-8042-ea101a7ee680 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:35.871614 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45e19c7b-f7c8-4187-8042-ea101a7ee680 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:35.872054 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45e19c7b-f7c8-4187-8042-ea101a7ee680 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:35.872789 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45e19c7b-f7c8-4187-8042-ea101a7ee680 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:35.874281 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45e19c7b-f7c8-4187-8042-ea101a7ee680 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:35.874730 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-45e19c7b-f7c8-4187-8042-ea101a7ee680 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:36.214635 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-45e19c7b-f7c8-4187-8042-ea101a7ee680 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:36.224765 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-45e19c7b-f7c8-4187-8042-ea101a7ee680 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1469 microversion: 2.1 time: 0.369957 Aug 22 17:31:36.230478 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 968/1938] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:35 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1469 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:37.263943 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f9618a54-1fb8-4d5b-b830-aaf11ac13938 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:37.264587 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f9618a54-1fb8-4d5b-b830-aaf11ac13938 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:37.279466 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f9618a54-1fb8-4d5b-b830-aaf11ac13938 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:37.280962 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f9618a54-1fb8-4d5b-b830-aaf11ac13938 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:37.284514 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f9618a54-1fb8-4d5b-b830-aaf11ac13938 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:37.286066 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f9618a54-1fb8-4d5b-b830-aaf11ac13938 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:37.286720 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f9618a54-1fb8-4d5b-b830-aaf11ac13938 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:37.290573 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f9618a54-1fb8-4d5b-b830-aaf11ac13938 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:37.309789 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:37.672789 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f9618a54-1fb8-4d5b-b830-aaf11ac13938 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:37.695371 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f9618a54-1fb8-4d5b-b830-aaf11ac13938 tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1469 microversion: 2.1 time: 0.438368 Aug 22 17:31:37.701150 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 971/1939] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:37 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1469 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:37.940522 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-ddb7f416-1c51-406b-a21b-26438a42882b req-afcc55b3-c1de-4b90-9ef5-30e15395a5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6743d0e-b3ba-425a-92ed-15a3648a4c68", "name": "network-vif-deleted", "tag": "08a047cd-3292-4acc-abc4-80a443c0ce87"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:31:37.965254 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-ddb7f416-1c51-406b-a21b-26438a42882b req-afcc55b3-c1de-4b90-9ef5-30e15395a5a6 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:37.965813 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-ddb7f416-1c51-406b-a21b-26438a42882b req-afcc55b3-c1de-4b90-9ef5-30e15395a5a6 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:37.966174 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-ddb7f416-1c51-406b-a21b-26438a42882b req-afcc55b3-c1de-4b90-9ef5-30e15395a5a6 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:38.045643 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-ddb7f416-1c51-406b-a21b-26438a42882b req-afcc55b3-c1de-4b90-9ef5-30e15395a5a6 service nova] Creating event network-vif-deleted:08a047cd-3292-4acc-abc4-80a443c0ce87 for instance f6743d0e-b3ba-425a-92ed-15a3648a4c68 on n-h1-854030-1 Aug 22 17:31:38.067656 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-ddb7f416-1c51-406b-a21b-26438a42882b req-afcc55b3-c1de-4b90-9ef5-30e15395a5a6 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127467 Aug 22 17:31:38.075517 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 969/1940] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:31:38.725957 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-10fa14e3-3e09-4058-86b8-b2340d6d824d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:38.726884 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-10fa14e3-3e09-4058-86b8-b2340d6d824d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:38.731615 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:38.752209 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-10fa14e3-3e09-4058-86b8-b2340d6d824d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:38.752960 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-10fa14e3-3e09-4058-86b8-b2340d6d824d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:38.754774 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-10fa14e3-3e09-4058-86b8-b2340d6d824d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:38.755771 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-10fa14e3-3e09-4058-86b8-b2340d6d824d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:38.756465 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-10fa14e3-3e09-4058-86b8-b2340d6d824d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:38.759250 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-10fa14e3-3e09-4058-86b8-b2340d6d824d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:38.831261 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-10fa14e3-3e09-4058-86b8-b2340d6d824d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:38.832454 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-10fa14e3-3e09-4058-86b8-b2340d6d824d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:38.837689 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-10fa14e3-3e09-4058-86b8-b2340d6d824d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:38.837689 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-10fa14e3-3e09-4058-86b8-b2340d6d824d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lazy-loading 'fault' on Instance uuid f6743d0e-b3ba-425a-92ed-15a3648a4c68 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:31:38.987625 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-10fa14e3-3e09-4058-86b8-b2340d6d824d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e814d921c4aa44b48f825df8ea4c46a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4aa64ffc8743d5833136aa57c96dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:39.020124 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-10fa14e3-3e09-4058-86b8-b2340d6d824d tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 200 len: 1304 microversion: 2.1 time: 0.298819 Aug 22 17:31:39.024646 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 972/1941] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:38 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 1304 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:31:40.047737 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-01b64a56-5b6e-43c4-8ca3-637455a9b8db tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:40.049128 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-01b64a56-5b6e-43c4-8ca3-637455a9b8db tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] [instance: f6743d0e-b3ba-425a-92ed-15a3648a4c68] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:40.051446 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:40.064920 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-01b64a56-5b6e-43c4-8ca3-637455a9b8db tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:40.065501 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-01b64a56-5b6e-43c4-8ca3-637455a9b8db tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:40.065975 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-01b64a56-5b6e-43c4-8ca3-637455a9b8db tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:40.066711 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-01b64a56-5b6e-43c4-8ca3-637455a9b8db tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:40.073297 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-01b64a56-5b6e-43c4-8ca3-637455a9b8db tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:40.073964 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-01b64a56-5b6e-43c4-8ca3-637455a9b8db tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:40.100701 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=57 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:40.102081 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-01b64a56-5b6e-43c4-8ca3-637455a9b8db tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] HTTP exception thrown: Instance f6743d0e-b3ba-425a-92ed-15a3648a4c68 could not be found. Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-01b64a56-5b6e-43c4-8ca3-637455a9b8db tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Request method failure captured: Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 HTTP/1.1 Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA71V7rNGGov2e0vWiv0e6Tu0AG3ai7y7rtux6Z1_fexgSZOqA9wiz6-4UE9sD4JrPMm83bEOx4UjT7b_ExgJdjASZ3HUiQ4u0HvJiiTrvF_7qD33cKc8gc2kebSeHWHiMKIKtzfTfNXadH4ybENaE1Yvujtb6w8erlPuOnFDiMHZhtU Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: ec4aa64ffc8743d5833136aa57c96dba Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-VolumesNegativeTest-1991638927 Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ec4aa64ffc8743d5833136aa57c96dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_ec4aa64ffc8743d5833136aa57c96dba", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ec4aa64ffc8743d5833136aa57c96dba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/ec4aa64ffc8743d5833136aa57c96dba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-VolumesNegativeTest-1991638927 Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: ec4aa64ffc8743d5833136aa57c96dba Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-VolumesNegativeTest-1991638927 Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-VolumesNegativeTest-1991638927-project Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: e814d921c4aa44b48f825df8ea4c46a1 Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-VolumesNegativeTest-1991638927-project Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance f6743d0e-b3ba-425a-92ed-15a3648a4c68 could not be found. Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': 'f6743d0e-b3ba-425a-92ed-15a3648a4c68'} Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6743d0e-b3ba-425a-92ed-15a3648a4c68 could not be found. Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6743d0e-b3ba-425a-92ed-15a3648a4c68 could not be found. Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:31:40.104323 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:31:40.114282 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:31:40.114282 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:31:40.114282 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:31:40.114282 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:31:40.114282 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:31:40.114282 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6743d0e-b3ba-425a-92ed-15a3648a4c68 could not be found. Aug 22 17:31:40.114282 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:31:40.114282 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-01b64a56-5b6e-43c4-8ca3-637455a9b8db tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] Returning 404 to user: Instance f6743d0e-b3ba-425a-92ed-15a3648a4c68 could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:31:40.114282 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-01b64a56-5b6e-43c4-8ca3-637455a9b8db tempest-VolumesNegativeTest-1991638927 tempest-VolumesNegativeTest-1991638927-project] 10.222.0.96 "GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68" status: 404 len: 111 microversion: 2.1 time: 0.067523 Aug 22 17:31:40.120055 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 970/1942] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:40 2022] GET /compute/v2.1/servers/f6743d0e-b3ba-425a-92ed-15a3648a4c68 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:32:10.603211 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-74e11d91-1842-4df3-86e1-955bb9e1fa39 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1918238012", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "14b514d5-dd40-4cde-99b4-7819ff8dfae7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1227745615", "security_groups": [{"name": "tempest-secgroup-smoke-1563321772"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:32:11.280195 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-74e11d91-1842-4df3-86e1-955bb9e1fa39 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] validate_networks() for [('14b514d5-dd40-4cde-99b4-7819ff8dfae7', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-74e11d91-1842-4df3-86e1-955bb9e1fa39 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e4dbb2a9-ed68-4e74-ad84-8e9775377799) Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:32:11.995694 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e4dbb2a9-ed68-4e74-ad84-8e9775377799) Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-74e11d91-1842-4df3-86e1-955bb9e1fa39 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-74e11d91-1842-4df3-86e1-955bb9e1fa39 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Request method failure captured: Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 345 Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA710D2e8WcstUXb1GOXcsmyhhv2Gn8F6D69Li6ikg1ie-d0I_cont0C0FsgMDyCCkYJDLPNUUeDyRcBwAc37X0VNXlNVsHy4sinDYb22euoOa3BLJoBhKzHFh65zbfO8GRGluU1do0oTFKf9pjzyMstik3low-BJu_BDj0rQaud6ubQ Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 05b947f48bd24315b147bc1cb4c2f6c7 Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-847049055 Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/05b947f48bd24315b147bc1cb4c2f6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_05b947f48bd24315b147bc1cb4c2f6c7", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/05b947f48bd24315b147bc1cb4c2f6c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/05b947f48bd24315b147bc1cb4c2f6c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-TestNetworkAdvancedServerOps-847049055 Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 05b947f48bd24315b147bc1cb4c2f6c7 Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-847049055 Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-TestNetworkAdvancedServerOps-847049055-project Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: e7ab25bb2da94c739a70719d8829ccda Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-TestNetworkAdvancedServerOps-847049055-project Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1918238012", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "14b514d5-dd40-4cde-99b4-7819ff8dfae7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1227745615", "security_groups": [{"name": "tempest-secgroup-smoke-1563321772"}]}} Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:32:12.003461 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1918238012', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '14b514d5-dd40-4cde-99b4-7819ff8dfae7'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1227745615', 'security_groups': [{'name': 'tempest-secgroup-smoke-1563321772'}]}}} Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:32:12.014063 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e4dbb2a9-ed68-4e74-ad84-8e9775377799) Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-74e11d91-1842-4df3-86e1-955bb9e1fa39 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-74e11d91-1842-4df3-86e1-955bb9e1fa39 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.402343 Aug 22 17:32:12.028168 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 973/1943] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:32:10 2022] POST /compute/v2.1/servers => generated 214 bytes in 1411 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:32:25.748217 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-74359609-ae00-4985-aead-ac0c2283081f tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Calling method '.version_select at 0x7f8009d429d0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:25.754250 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:25.888183 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-74359609-ae00-4985-aead-ac0c2283081f tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1227745615" status: 202 len: 0 microversion: 2.1 time: 0.147524 Aug 22 17:32:25.892620 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 971/1944] 10.222.0.96 () {58 vars in 1284 bytes} [Mon Aug 22 17:32:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1227745615 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:32:25.908575 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d71dbb68-79be-4d42-8c28-ef3a10aa770e tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Action: 'create', calling method: .version_select at 0x7f800925adc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-159907735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkYnPbhhBRr50Urgd+0dVMl3YpWh+E8SJBpmEJYItypk2rkm+wipbmTDY2CbJU/pXGlJDQO4rQQxCjceYosuHT57kh9y8uJUjdkYRrpem7UiS1Jevvam9OuRrZikVzhew=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:32:25.929498 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=13 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:25.969364 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-d71dbb68-79be-4d42-8c28-ef3a10aa770e tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Getting quotas for project 05b947f48bd24315b147bc1cb4c2f6c7. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:32:25.981122 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-d71dbb68-79be-4d42-8c28-ef3a10aa770e tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Getting quotas for user e7ab25bb2da94c739a70719d8829ccda and project 05b947f48bd24315b147bc1cb4c2f6c7. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:32:26.198657 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d71dbb68-79be-4d42-8c28-ef3a10aa770e tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.297604 Aug 22 17:32:26.199478 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 974/1945] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:32:25 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:32:52.018602 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-78c19bc6-78ad-44cf-894c-6f3cba1a9606 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1938697261", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "9e9eb0df-2d7e-4c74-bec8-071022c83fb7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-159907735", "security_groups": [{"name": "tempest-secgroup-smoke-165891424"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:32:52.040291 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:53.167058 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-78c19bc6-78ad-44cf-894c-6f3cba1a9606 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] validate_networks() for [('9e9eb0df-2d7e-4c74-bec8-071022c83fb7', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-78c19bc6-78ad-44cf-894c-6f3cba1a9606 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-96e490d0-aa01-4d76-bd0d-228586b51e67) Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:32:53.737786 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-96e490d0-aa01-4d76-bd0d-228586b51e67) Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-78c19bc6-78ad-44cf-894c-6f3cba1a9606 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-78c19bc6-78ad-44cf-894c-6f3cba1a9606 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Request method failure captured: Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 343 Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA710D2e8WcstUXb1GOXcsmyhhv2Gn8F6D69Li6ikg1ie-d0I_cont0C0FsgMDyCCkYJDLPNUUeDyRcBwAc37X0VNXlNVsHy4sinDYb22euoOa3BLJoBhKzHFh65zbfO8GRGluU1do0oTFKf9pjzyMstik3low-BJu_BDj0rQaud6ubQ Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 05b947f48bd24315b147bc1cb4c2f6c7 Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-847049055 Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/05b947f48bd24315b147bc1cb4c2f6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_05b947f48bd24315b147bc1cb4c2f6c7", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/05b947f48bd24315b147bc1cb4c2f6c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/05b947f48bd24315b147bc1cb4c2f6c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-TestNetworkAdvancedServerOps-847049055 Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 05b947f48bd24315b147bc1cb4c2f6c7 Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-847049055 Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-TestNetworkAdvancedServerOps-847049055-project Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: e7ab25bb2da94c739a70719d8829ccda Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-TestNetworkAdvancedServerOps-847049055-project Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1938697261", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "9e9eb0df-2d7e-4c74-bec8-071022c83fb7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-159907735", "security_groups": [{"name": "tempest-secgroup-smoke-165891424"}]}} Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:32:53.749827 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1938697261', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '9e9eb0df-2d7e-4c74-bec8-071022c83fb7'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-159907735', 'security_groups': [{'name': 'tempest-secgroup-smoke-165891424'}]}}} Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:32:53.770582 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-96e490d0-aa01-4d76-bd0d-228586b51e67) Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-78c19bc6-78ad-44cf-894c-6f3cba1a9606 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-78c19bc6-78ad-44cf-894c-6f3cba1a9606 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.727630 Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 972/1946] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:32:52 2022] POST /compute/v2.1/servers => generated 214 bytes in 1731 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:32:53.781035 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:32:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:33:06.383706 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:06.385462 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:06.389853 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c71aa403-8a9e-4784-ba51-fb799ede594a tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Calling method '.version_select at 0x7f80091a01f0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:06.494264 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c71aa403-8a9e-4784-ba51-fb799ede594a tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-159907735" status: 202 len: 0 microversion: 2.1 time: 0.111661 Aug 22 17:33:06.494978 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 975/1947] 10.222.0.96 () {58 vars in 1281 bytes} [Mon Aug 22 17:33:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-159907735 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:33:06.511726 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:06.516898 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1b1dd4d8-6a30-4cb3-8570-e97ef69970e0 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Action: 'create', calling method: .version_select at 0x7f8009eb85e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-277874389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKeq+aZO39tkz7Ed6EVhs08LIFHFv9dZjAQoC7lLq9KUh9sW9sDSb52tiheroMu1shj5stMPOEGNnfHv1B5b/6/bQUUE3sEnSlGZHOhG+P8Vxgp8Rf/eGHH3HvAK3rcZw=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:33:06.536115 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-1b1dd4d8-6a30-4cb3-8570-e97ef69970e0 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Getting quotas for project 05b947f48bd24315b147bc1cb4c2f6c7. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:33:06.544047 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-1b1dd4d8-6a30-4cb3-8570-e97ef69970e0 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Getting quotas for user e7ab25bb2da94c739a70719d8829ccda and project 05b947f48bd24315b147bc1cb4c2f6c7. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:33:06.683493 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1b1dd4d8-6a30-4cb3-8570-e97ef69970e0 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.172915 Aug 22 17:33:06.693441 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 973/1948] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:33:06 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:33:32.631094 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-864869b0-539f-4b09-9370-2291e6af6ef9 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1746376443", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "e8baf373-4291-476f-9e47-c6f6e93d7d00"}], "key_name": "tempest-TestNetworkAdvancedServerOps-277874389", "security_groups": [{"name": "tempest-secgroup-smoke-1473467424"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:33:33.049777 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-864869b0-539f-4b09-9370-2291e6af6ef9 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] validate_networks() for [('e8baf373-4291-476f-9e47-c6f6e93d7d00', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-864869b0-539f-4b09-9370-2291e6af6ef9 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-88a7dbbb-6fb2-49a7-bb94-c601fe4e63b3) Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:33:34.153376 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:33:34.157420 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:33:34.157420 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:33:34.157420 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:33:34.157420 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:33:34.157420 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:33:34.157420 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:33:34.157420 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:33:34.157420 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:33:34.157420 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:33:34.157420 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:33:34.157420 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:33:34.157420 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:33:34.157420 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:33:34.157420 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:33:34.157420 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:33:34.157420 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-88a7dbbb-6fb2-49a7-bb94-c601fe4e63b3) Aug 22 17:33:34.157420 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:33:34.160278 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-864869b0-539f-4b09-9370-2291e6af6ef9 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:33:34.160278 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-864869b0-539f-4b09-9370-2291e6af6ef9 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Request method failure captured: Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 344 Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA710D2e8WcstUXb1GOXcsmyhhv2Gn8F6D69Li6ikg1ie-d0I_cont0C0FsgMDyCCkYJDLPNUUeDyRcBwAc37X0VNXlNVsHy4sinDYb22euoOa3BLJoBhKzHFh65zbfO8GRGluU1do0oTFKf9pjzyMstik3low-BJu_BDj0rQaud6ubQ Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 05b947f48bd24315b147bc1cb4c2f6c7 Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-847049055 Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/05b947f48bd24315b147bc1cb4c2f6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_05b947f48bd24315b147bc1cb4c2f6c7", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/05b947f48bd24315b147bc1cb4c2f6c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/05b947f48bd24315b147bc1cb4c2f6c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-TestNetworkAdvancedServerOps-847049055 Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 05b947f48bd24315b147bc1cb4c2f6c7 Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-847049055 Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-TestNetworkAdvancedServerOps-847049055-project Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: e7ab25bb2da94c739a70719d8829ccda Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-TestNetworkAdvancedServerOps-847049055-project Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1746376443", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "e8baf373-4291-476f-9e47-c6f6e93d7d00"}], "key_name": "tempest-TestNetworkAdvancedServerOps-277874389", "security_groups": [{"name": "tempest-secgroup-smoke-1473467424"}]}} Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1746376443', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'e8baf373-4291-476f-9e47-c6f6e93d7d00'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-277874389', 'security_groups': [{'name': 'tempest-secgroup-smoke-1473467424'}]}}} Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:33:34.170395 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-88a7dbbb-6fb2-49a7-bb94-c601fe4e63b3) Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:33:34.177299 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:33:34.180924 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:33:34.180924 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:33:34.180924 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:33:34.180924 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:33:34.180924 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:33:34.180924 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:33:34.180924 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:33:34.180924 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:33:34.180924 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:33:34.180924 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:33:34.180924 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:33:34.180924 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:33:34.180924 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:33:34.180924 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:33:34.180924 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:33:34.180924 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:33:34.180924 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-864869b0-539f-4b09-9370-2291e6af6ef9 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:33:34.180924 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:33:34.180924 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-864869b0-539f-4b09-9370-2291e6af6ef9 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.545896 Aug 22 17:33:34.184565 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 976/1949] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:33:32 2022] POST /compute/v2.1/servers => generated 214 bytes in 1558 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:33:49.972050 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-806454c0-402e-4005-93fb-4627eb487084 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Calling method '.version_select at 0x7f8009b30700>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:49.980002 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:50.079413 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-806454c0-402e-4005-93fb-4627eb487084 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-277874389" status: 202 len: 0 microversion: 2.1 time: 0.111656 Aug 22 17:33:50.092837 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:50.093683 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 974/1950] 10.222.0.96 () {58 vars in 1281 bytes} [Mon Aug 22 17:33:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-277874389 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:33:50.103118 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-2e38f1ed-b5a6-41cb-8577-0ee7a24f891e tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Action: 'create', calling method: .version_select at 0x7f80090ac040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1649978109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMqc2ncVAgijG8Ju8APYrsNrmuedJx2C9hKp5PlWDwSMdlMmK0cHirRLcBzlda4pd66l0Dp3JFwB1sn2Wn/wfwQnCV9MsfWOpXnkmMX18r2dWmHCCvi/k+L2QnPBZKntg=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:33:50.138975 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-2e38f1ed-b5a6-41cb-8577-0ee7a24f891e tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Getting quotas for project 05b947f48bd24315b147bc1cb4c2f6c7. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:33:50.151347 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-2e38f1ed-b5a6-41cb-8577-0ee7a24f891e tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Getting quotas for user e7ab25bb2da94c739a70719d8829ccda and project 05b947f48bd24315b147bc1cb4c2f6c7. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:33:50.322820 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-2e38f1ed-b5a6-41cb-8577-0ee7a24f891e tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.231688 Aug 22 17:33:50.323729 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 977/1951] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:33:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:34:13.823059 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-97b4fda2-2fff-49dc-942f-fc2462cb38e4 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1103982912", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "a6496acd-1422-4304-8a0c-3c36f42327e5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1649978109", "security_groups": [{"name": "tempest-secgroup-smoke-1715702822"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:34:14.099046 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-97b4fda2-2fff-49dc-942f-fc2462cb38e4 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] validate_networks() for [('a6496acd-1422-4304-8a0c-3c36f42327e5', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-97b4fda2-2fff-49dc-942f-fc2462cb38e4 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-72e636b7-9d4e-46b0-856f-c8b8ac276fde) Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:34:14.982918 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:34:14.994100 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:34:14.994100 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:34:14.994100 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:34:14.994100 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:34:14.994100 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:34:14.994100 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:34:14.994100 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:34:14.994100 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:34:14.994100 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:34:14.994100 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:34:14.994100 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:34:14.994100 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:34:14.994100 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:34:14.994100 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:34:14.994100 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:34:14.994100 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-72e636b7-9d4e-46b0-856f-c8b8ac276fde) Aug 22 17:34:14.994100 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:34:15.004189 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-97b4fda2-2fff-49dc-942f-fc2462cb38e4 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:34:15.004189 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-97b4fda2-2fff-49dc-942f-fc2462cb38e4 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Request method failure captured: Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 345 Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA710D2e8WcstUXb1GOXcsmyhhv2Gn8F6D69Li6ikg1ie-d0I_cont0C0FsgMDyCCkYJDLPNUUeDyRcBwAc37X0VNXlNVsHy4sinDYb22euoOa3BLJoBhKzHFh65zbfO8GRGluU1do0oTFKf9pjzyMstik3low-BJu_BDj0rQaud6ubQ Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 05b947f48bd24315b147bc1cb4c2f6c7 Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-847049055 Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/05b947f48bd24315b147bc1cb4c2f6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_05b947f48bd24315b147bc1cb4c2f6c7", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/05b947f48bd24315b147bc1cb4c2f6c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/05b947f48bd24315b147bc1cb4c2f6c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-TestNetworkAdvancedServerOps-847049055 Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 05b947f48bd24315b147bc1cb4c2f6c7 Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-847049055 Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-TestNetworkAdvancedServerOps-847049055-project Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: e7ab25bb2da94c739a70719d8829ccda Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-TestNetworkAdvancedServerOps-847049055-project Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1103982912", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "a6496acd-1422-4304-8a0c-3c36f42327e5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1649978109", "security_groups": [{"name": "tempest-secgroup-smoke-1715702822"}]}} Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1103982912', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'a6496acd-1422-4304-8a0c-3c36f42327e5'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1649978109', 'security_groups': [{'name': 'tempest-secgroup-smoke-1715702822'}]}}} Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:34:15.006213 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-72e636b7-9d4e-46b0-856f-c8b8ac276fde) Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:34:15.014270 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:34:15.022868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:34:15.022868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:34:15.022868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:34:15.022868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:34:15.022868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:34:15.022868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:34:15.022868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:34:15.022868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:34:15.022868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:34:15.022868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:34:15.022868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:34:15.022868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:34:15.022868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:34:15.022868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:34:15.022868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:34:15.022868 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:34:15.022868 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-97b4fda2-2fff-49dc-942f-fc2462cb38e4 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:34:15.022868 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:34:15.022868 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-97b4fda2-2fff-49dc-942f-fc2462cb38e4 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.204099 Aug 22 17:34:15.024669 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 975/1952] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:34:13 2022] POST /compute/v2.1/servers => generated 214 bytes in 1209 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:34:24.714720 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:24.724940 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e2c046dc-7695-4bee-b377-69b80f984429 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] Calling method '.version_select at 0x7f80090acca0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:24.904691 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e2c046dc-7695-4bee-b377-69b80f984429 tempest-TestNetworkAdvancedServerOps-847049055 tempest-TestNetworkAdvancedServerOps-847049055-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1649978109" status: 202 len: 0 microversion: 2.1 time: 0.199220 Aug 22 17:34:24.906213 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 978/1953] 10.222.0.96 () {58 vars in 1284 bytes} [Mon Aug 22 17:34:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1649978109 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:34:35.208702 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:35.695498 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-21c06c0b-6604-4dbb-beb5-fbbebf2de169 tempest-TestSecurityGroupsBasicOps-1783780109 tempest-TestSecurityGroupsBasicOps-1783780109-project] Action: 'create', calling method: .version_select at 0x7f8009449af0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-292320851", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMys0jboTvQHO3PM4O3w/Glhp5ZkE1x64boAp00Y9hnC9hN4VmlWreXwRZzchrPZ3BjGlk6GLZJusv0CCzVr5i6b2ranlBrrMIqTrim6oBpbNLA01u46n3D7CDdopxqOw=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:34:35.740630 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-21c06c0b-6604-4dbb-beb5-fbbebf2de169 tempest-TestSecurityGroupsBasicOps-1783780109 tempest-TestSecurityGroupsBasicOps-1783780109-project] Getting quotas for project ee86ee74e3cd4d878a1b3e8fb4e6b623. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:34:35.769550 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-21c06c0b-6604-4dbb-beb5-fbbebf2de169 tempest-TestSecurityGroupsBasicOps-1783780109 tempest-TestSecurityGroupsBasicOps-1783780109-project] Getting quotas for user 214d612027594017932635890267f063 and project ee86ee74e3cd4d878a1b3e8fb4e6b623. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:34:35.931321 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-21c06c0b-6604-4dbb-beb5-fbbebf2de169 tempest-TestSecurityGroupsBasicOps-1783780109 tempest-TestSecurityGroupsBasicOps-1783780109-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.725094 Aug 22 17:34:35.931952 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 976/1954] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:34:35 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:34:45.660447 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:34:45.661195 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:34:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:34:59.344591 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-bf8848d0-f7e2-4189-be76-2ec47c9013a4 tempest-TestSecurityGroupsBasicOps-1783780109 tempest-TestSecurityGroupsBasicOps-1783780109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1783780109-access_point-1344291993", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "cd7ccea8-fac1-4c6e-8800-6a021bcb2713"}], "key_name": "tempest-TestSecurityGroupsBasicOps-292320851", "security_groups": [{"name": "tempest-secgroup_access--529093618"}, {"name": "tempest-secgroup_general--1271610280"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:34:59.821472 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-bf8848d0-f7e2-4189-be76-2ec47c9013a4 tempest-TestSecurityGroupsBasicOps-1783780109 tempest-TestSecurityGroupsBasicOps-1783780109-project] validate_networks() for [('cd7ccea8-fac1-4c6e-8800-6a021bcb2713', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-bf8848d0-f7e2-4189-be76-2ec47c9013a4 tempest-TestSecurityGroupsBasicOps-1783780109 tempest-TestSecurityGroupsBasicOps-1783780109-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9e4c2bec-5f7b-45d7-9e4c-42eabfd9ea26) Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:35:00.281665 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9e4c2bec-5f7b-45d7-9e4c-42eabfd9ea26) Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-bf8848d0-f7e2-4189-be76-2ec47c9013a4 tempest-TestSecurityGroupsBasicOps-1783780109 tempest-TestSecurityGroupsBasicOps-1783780109-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-bf8848d0-f7e2-4189-be76-2ec47c9013a4 tempest-TestSecurityGroupsBasicOps-1783780109 tempest-TestSecurityGroupsBasicOps-1783780109-project] Request method failure captured: Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 469 Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA74mxH3OIVAdTh-43Wq3ritV8F7aSxtGgn1g7MHHA3WNAFN2WBFM3QG9MjN52fIctzBazNrCPTNn2Q309avzhOJ2XmBVxB-N7gbSgnJyVoogZMbJB2kha_F4gfOOOvVPelky6MCk9vbJJK9dkn3E8QmZ857Vj7RkyckPKE0MTqc57_0 Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: ee86ee74e3cd4d878a1b3e8fb4e6b623 Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1783780109 Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ee86ee74e3cd4d878a1b3e8fb4e6b623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_ee86ee74e3cd4d878a1b3e8fb4e6b623", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/ee86ee74e3cd4d878a1b3e8fb4e6b623"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/ee86ee74e3cd4d878a1b3e8fb4e6b623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1783780109 Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: ee86ee74e3cd4d878a1b3e8fb4e6b623 Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1783780109 Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-TestSecurityGroupsBasicOps-1783780109-project Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 214d612027594017932635890267f063 Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1783780109-project Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1783780109-access_point-1344291993", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "cd7ccea8-fac1-4c6e-8800-6a021bcb2713"}], "key_name": "tempest-TestSecurityGroupsBasicOps-292320851", "security_groups": [{"name": "tempest-secgroup_access--529093618"}, {"name": "tempest-secgroup_general--1271610280"}]}, "os:scheduler_hints": {"different_host": []}} Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:35:00.286196 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-server-tempest-TestSecurityGroupsBasicOps-1783780109-access_point-1344291993', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'cd7ccea8-fac1-4c6e-8800-6a021bcb2713'}], 'key_name': 'tempest-TestSecurityGroupsBasicOps-292320851', 'security_groups': [{'name': 'tempest-secgroup_access--529093618'}, {'name': 'tempest-secgroup_general--1271610280'}]}, 'os:scheduler_hints': {'different_host': []}}} Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:35:00.291853 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9e4c2bec-5f7b-45d7-9e4c-42eabfd9ea26) Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-bf8848d0-f7e2-4189-be76-2ec47c9013a4 tempest-TestSecurityGroupsBasicOps-1783780109 tempest-TestSecurityGroupsBasicOps-1783780109-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-bf8848d0-f7e2-4189-be76-2ec47c9013a4 tempest-TestSecurityGroupsBasicOps-1783780109 tempest-TestSecurityGroupsBasicOps-1783780109-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.961094 Aug 22 17:35:00.298471 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 979/1955] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:34:59 2022] POST /compute/v2.1/servers => generated 214 bytes in 968 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:35:14.375149 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f093b8ad-956b-497b-ae39-f288a65f3c46 tempest-TestSecurityGroupsBasicOps-1783780109 tempest-TestSecurityGroupsBasicOps-1783780109-project] Calling method '.version_select at 0x7f8009dde1f0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:14.389513 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:35:14.499991 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f093b8ad-956b-497b-ae39-f288a65f3c46 tempest-TestSecurityGroupsBasicOps-1783780109 tempest-TestSecurityGroupsBasicOps-1783780109-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-292320851" status: 202 len: 0 microversion: 2.1 time: 0.128689 Aug 22 17:35:14.501281 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 977/1956] 10.222.0.96 () {58 vars in 1275 bytes} [Mon Aug 22 17:35:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-292320851 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:35:31.026386 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:35:31.501611 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7740ea75-ba1d-4972-849a-4d4a26d56d4e tempest-TestServerAdvancedOps-1565500963 tempest-TestServerAdvancedOps-1565500963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1169144017", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "d7d094fa-c44c-424f-8736-bc7acba18430"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:35:31.588569 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-7740ea75-ba1d-4972-849a-4d4a26d56d4e tempest-TestServerAdvancedOps-1565500963 tempest-TestServerAdvancedOps-1565500963-project] validate_networks() for [('d7d094fa-c44c-424f-8736-bc7acba18430', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-7740ea75-ba1d-4972-849a-4d4a26d56d4e tempest-TestServerAdvancedOps-1565500963 tempest-TestServerAdvancedOps-1565500963-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c44960ca-db85-4c9d-8833-9f99d9b94e98) Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:35:32.083031 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:35:32.088648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:35:32.088648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:35:32.088648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:35:32.088648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:35:32.088648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:35:32.088648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:35:32.088648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:35:32.088648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:35:32.088648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:35:32.088648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:35:32.088648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:35:32.088648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:35:32.088648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:35:32.088648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:35:32.088648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c44960ca-db85-4c9d-8833-9f99d9b94e98) Aug 22 17:35:32.088648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:35:32.088648 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-7740ea75-ba1d-4972-849a-4d4a26d56d4e tempest-TestServerAdvancedOps-1565500963 tempest-TestServerAdvancedOps-1565500963-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:35:32.088648 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7740ea75-ba1d-4972-849a-4d4a26d56d4e tempest-TestServerAdvancedOps-1565500963 tempest-TestServerAdvancedOps-1565500963-project] Request method failure captured: Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 207 Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA75eTSHr3wzCGirBMWLi7TwRxYprOEVDIACdJvHb8nsp9EXkHXXqSj8ModRmcUSSEB8qs6RdhEpaA9YHjTggwJQy6253ZqHbK1kUyUsYSAEOBvAyLumvXmjQk0vsNZGtTOBcrRJxgK5VCWGux6WGF8Ro4eLHLPZEca70Ana1XXdsCps Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 2d91500ce4b348eba0a7ca0bd143c2c0 Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-TestServerAdvancedOps-1565500963 Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/2d91500ce4b348eba0a7ca0bd143c2c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_2d91500ce4b348eba0a7ca0bd143c2c0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/2d91500ce4b348eba0a7ca0bd143c2c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/2d91500ce4b348eba0a7ca0bd143c2c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-TestServerAdvancedOps-1565500963 Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 2d91500ce4b348eba0a7ca0bd143c2c0 Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-TestServerAdvancedOps-1565500963 Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-TestServerAdvancedOps-1565500963-project Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: e65a5c038ec840f2937183d3ac3897db Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-TestServerAdvancedOps-1565500963-project Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-TestServerAdvancedOps-server-1169144017", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "d7d094fa-c44c-424f-8736-bc7acba18430"}]}} Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-TestServerAdvancedOps-server-1169144017', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'd7d094fa-c44c-424f-8736-bc7acba18430'}]}}} Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:35:32.090208 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c44960ca-db85-4c9d-8833-9f99d9b94e98) Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:35:32.095594 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:35:32.112828 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:35:32.112828 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:35:32.112828 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:35:32.112828 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:35:32.112828 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:35:32.112828 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:35:32.112828 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:35:32.112828 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:35:32.112828 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:35:32.112828 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:35:32.112828 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:35:32.112828 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:35:32.112828 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:35:32.112828 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7740ea75-ba1d-4972-849a-4d4a26d56d4e tempest-TestServerAdvancedOps-1565500963 tempest-TestServerAdvancedOps-1565500963-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:35:32.112828 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:35:32.112828 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7740ea75-ba1d-4972-849a-4d4a26d56d4e tempest-TestServerAdvancedOps-1565500963 tempest-TestServerAdvancedOps-1565500963-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.077957 Aug 22 17:35:32.112828 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 980/1957] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:35:31 2022] POST /compute/v2.1/servers => generated 214 bytes in 1081 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:36:12.737892 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:36:12.742390 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:36:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:36:13.807279 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:36:13.808200 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:36:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:36:44.040642 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:36:44.044610 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:36:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:37:44.706996 n-d-854030-1 devstack@n-api.service[123016]: ERROR oslo.messaging._drivers.impl_rabbit [-] [60bafe1f-ace8-482d-a7e4-e745b51a93e7] AMQP server on 10.222.0.96:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 17:37:44.715697 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-dc74912c-09fa-4d03-a44d-c9c268e6350e tempest-TestVolumeBackupRestore-1435791850 tempest-TestVolumeBackupRestore-1435791850-project] Action: 'create', calling method: .version_select at 0x7f80094ed5e0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1291802727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR6Ly51kJZio/D5MloLJYl6S0HOngZkuQw+LZwNiu2lwJKfbG9LQKK6/O7GgzU3v9FKMwscFH0czV1Dvh+sv6q8Cedvm9NhCjdRq5/hT32qT9CZErv3bt4Ody+aMsrTJA=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:37:44.737272 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-dc74912c-09fa-4d03-a44d-c9c268e6350e tempest-TestVolumeBackupRestore-1435791850 tempest-TestVolumeBackupRestore-1435791850-project] Getting quotas for project cf467866c658402a934d2499c0dbf618. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:37:44.745386 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-dc74912c-09fa-4d03-a44d-c9c268e6350e tempest-TestVolumeBackupRestore-1435791850 tempest-TestVolumeBackupRestore-1435791850-project] Getting quotas for user 248cae3bea2c49f1a7247036a37c0ec7 and project cf467866c658402a934d2499c0dbf618. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:37:44.760439 n-d-854030-1 devstack@n-api.service[123016]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dc74912c-09fa-4d03-a44d-c9c268e6350e tempest-TestVolumeBackupRestore-1435791850 tempest-TestVolumeBackupRestore-1435791850-project] [acd28e7c-2c43-4e3e-97c0-53d99cbb898d] AMQP server on 10.222.0.96:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 17:37:45.719539 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] [60bafe1f-ace8-482d-a7e4-e745b51a93e7] Reconnected to AMQP server on 10.222.0.96:5672 via [amqp] client with port 36646. Aug 22 17:37:45.770720 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [None req-dc74912c-09fa-4d03-a44d-c9c268e6350e tempest-TestVolumeBackupRestore-1435791850 tempest-TestVolumeBackupRestore-1435791850-project] [acd28e7c-2c43-4e3e-97c0-53d99cbb898d] Reconnected to AMQP server on 10.222.0.96:5672 via [amqp] client with port 36648. Aug 22 17:37:45.895096 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-dc74912c-09fa-4d03-a44d-c9c268e6350e tempest-TestVolumeBackupRestore-1435791850 tempest-TestVolumeBackupRestore-1435791850-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.190565 Aug 22 17:37:45.896527 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 978/1958] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:37:44 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:37:50.100649 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3ce56d86-d6d4-469a-81d8-006e122644d4 tempest-TestVolumeBackupRestore-1435791850 tempest-TestVolumeBackupRestore-1435791850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1937785383", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "aa15c023-932b-43da-b615-db9507b8dbc3", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1291802727", "security_groups": [{"name": "tempest-secgroup-smoke-820238577"}], "networks": [{"uuid": "d2dd7205-5d5e-4e87-b802-c1ffca8fea8d"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:37:50.563893 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-3ce56d86-d6d4-469a-81d8-006e122644d4 tempest-TestVolumeBackupRestore-1435791850 tempest-TestVolumeBackupRestore-1435791850-project] validate_networks() for [('d2dd7205-5d5e-4e87-b802-c1ffca8fea8d', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-3ce56d86-d6d4-469a-81d8-006e122644d4 tempest-TestVolumeBackupRestore-1435791850 tempest-TestVolumeBackupRestore-1435791850-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-216ee6cf-41b0-48f0-b138-19c28c00fc0e) Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:37:50.813280 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-216ee6cf-41b0-48f0-b138-19c28c00fc0e) Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-3ce56d86-d6d4-469a-81d8-006e122644d4 tempest-TestVolumeBackupRestore-1435791850 tempest-TestVolumeBackupRestore-1435791850-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3ce56d86-d6d4-469a-81d8-006e122644d4 tempest-TestVolumeBackupRestore-1435791850 tempest-TestVolumeBackupRestore-1435791850-project] Request method failure captured: Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 449 Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA73nCi7FKg7QvncBYOmU5ktgCsQSyFhdFTYdpUWOLX1iHgCiA8QYZtNQpT9tH9jlcdVJnDIXfT6EMpkwZQUpTuEvW3M4hd164-z7tabq1N6p534piiQotTE2We4dJn9un18oQ2iORwmDseSaCZ5p1lVTW4q9jKmE_QA8_G-D68XSVrk Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: cf467866c658402a934d2499c0dbf618 Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-TestVolumeBackupRestore-1435791850 Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/cf467866c658402a934d2499c0dbf618"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_cf467866c658402a934d2499c0dbf618", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/cf467866c658402a934d2499c0dbf618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/cf467866c658402a934d2499c0dbf618"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-TestVolumeBackupRestore-1435791850 Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: cf467866c658402a934d2499c0dbf618 Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1435791850 Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-TestVolumeBackupRestore-1435791850-project Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 248cae3bea2c49f1a7247036a37c0ec7 Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-TestVolumeBackupRestore-1435791850-project Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1937785383", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "aa15c023-932b-43da-b615-db9507b8dbc3", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1291802727", "security_groups": [{"name": "tempest-secgroup-smoke-820238577"}], "networks": [{"uuid": "d2dd7205-5d5e-4e87-b802-c1ffca8fea8d"}]}} Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:37:50.816515 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBackupRestore-server-1937785383', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'volume_id': 'aa15c023-932b-43da-b615-db9507b8dbc3', 'delete_on_termination': False}], 'key_name': 'tempest-TestVolumeBackupRestore-1291802727', 'security_groups': [{'name': 'tempest-secgroup-smoke-820238577'}], 'networks': [{'uuid': 'd2dd7205-5d5e-4e87-b802-c1ffca8fea8d'}]}}} Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:37:50.819938 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-216ee6cf-41b0-48f0-b138-19c28c00fc0e) Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-3ce56d86-d6d4-469a-81d8-006e122644d4 tempest-TestVolumeBackupRestore-1435791850 tempest-TestVolumeBackupRestore-1435791850-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-3ce56d86-d6d4-469a-81d8-006e122644d4 tempest-TestVolumeBackupRestore-1435791850 tempest-TestVolumeBackupRestore-1435791850-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.723288 Aug 22 17:37:50.826551 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 981/1959] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:37:50 2022] POST /compute/v2.1/servers => generated 214 bytes in 724 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:37:51.201890 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e4bcc165-94b9-45d6-a301-0e139d83c4dd tempest-TestVolumeBackupRestore-1435791850 tempest-TestVolumeBackupRestore-1435791850-project] Calling method '.version_select at 0x7f80094af790>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:51.410132 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e4bcc165-94b9-45d6-a301-0e139d83c4dd tempest-TestVolumeBackupRestore-1435791850 tempest-TestVolumeBackupRestore-1435791850-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1291802727" status: 202 len: 0 microversion: 2.1 time: 0.213562 Aug 22 17:37:51.410876 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 979/1960] 10.222.0.96 () {58 vars in 1269 bytes} [Mon Aug 22 17:37:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1291802727 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:38:05.672862 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:38:05.673834 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:38:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:38:42.984653 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=6 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:42.990366 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c5067d7a-b194-4db5-be78-83a385f5da62 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1541380852", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "58fb0baf-c3c7-4694-ad01-a543ace34b6a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b87a647c-9ee9-4c3f-93f3-341218d515d9"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:38:43.060721 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-c5067d7a-b194-4db5-be78-83a385f5da62 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] validate_networks() for [('b87a647c-9ee9-4c3f-93f3-341218d515d9', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-c5067d7a-b194-4db5-be78-83a385f5da62 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-aa59773e-279c-4806-8ef5-aea1bbfad6d4) Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:38:43.350962 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:38:43.355216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:38:43.355216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:38:43.355216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:38:43.355216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:38:43.355216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:38:43.355216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:38:43.355216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:38:43.355216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:38:43.355216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:38:43.355216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:38:43.355216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:38:43.355216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:38:43.355216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:38:43.355216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:38:43.355216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-aa59773e-279c-4806-8ef5-aea1bbfad6d4) Aug 22 17:38:43.355216 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:38:43.355216 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-c5067d7a-b194-4db5-be78-83a385f5da62 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:38:43.355216 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c5067d7a-b194-4db5-be78-83a385f5da62 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Request method failure captured: Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 354 Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA78SNKo6LWaSavKnrOXvq_SjfWp-Bg17LcglLXKq79ikHLx0RzRS4dYdMXTgSrs2qxn95fTCnsj05cLZdWs0MEAxCvW0GW3ffiQ_1wCjcaH1Ukbr08sDuqHVBEY1UhmjUPZi7X1C-5aT7EeNsUzDlPLvFjI2BgummbYPZFDo_T-Y0wo Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 3753856e1c8043658e95d6108aff12fc Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-TestVolumeBootPattern-1681765592 Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3753856e1c8043658e95d6108aff12fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_3753856e1c8043658e95d6108aff12fc", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3753856e1c8043658e95d6108aff12fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/3753856e1c8043658e95d6108aff12fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-TestVolumeBootPattern-1681765592 Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 3753856e1c8043658e95d6108aff12fc Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-TestVolumeBootPattern-1681765592 Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-TestVolumeBootPattern-1681765592-project Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: d4b025a667e7499b80bdc74611d53c44 Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-TestVolumeBootPattern-1681765592-project Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-TestVolumeBootPattern-server-1541380852", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "58fb0baf-c3c7-4694-ad01-a543ace34b6a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b87a647c-9ee9-4c3f-93f3-341218d515d9"}]}} Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-1541380852', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '58fb0baf-c3c7-4694-ad01-a543ace34b6a'}], 'networks': [{'uuid': 'b87a647c-9ee9-4c3f-93f3-341218d515d9'}]}}} Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:38:43.356449 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-aa59773e-279c-4806-8ef5-aea1bbfad6d4) Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:38:43.359851 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:38:43.369124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:38:43.369124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:38:43.369124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:38:43.369124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:38:43.369124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:38:43.369124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:38:43.369124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:38:43.369124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:38:43.369124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:38:43.369124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:38:43.369124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:38:43.369124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:38:43.369124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:38:43.369124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:38:43.369124 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:38:43.369124 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c5067d7a-b194-4db5-be78-83a385f5da62 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:38:43.369124 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:38:43.369124 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c5067d7a-b194-4db5-be78-83a385f5da62 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.373976 Aug 22 17:38:43.369124 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 982/1961] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:38:42 2022] POST /compute/v2.1/servers => generated 214 bytes in 376 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:38:44.888432 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:44.893159 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:44.894889 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-997be013-c1c0-4a49-9187-38d0f79bdeef tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-204331032", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:38:45.244137 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-997be013-c1c0-4a49-9187-38d0f79bdeef tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] validate_networks() for None {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:38:45.579369 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-997be013-c1c0-4a49-9187-38d0f79bdeef tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Flavor limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:38:45.580108 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-997be013-c1c0-4a49-9187-38d0f79bdeef tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Image limits 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:38:45.580600 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-997be013-c1c0-4a49-9187-38d0f79bdeef tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Flavor pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:38:45.581017 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-997be013-c1c0-4a49-9187-38d0f79bdeef tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Image pref 0:0:0 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:38:45.581764 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.virt.hardware [None req-997be013-c1c0-4a49-9187-38d0f79bdeef tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:38:45.599448 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-997be013-c1c0-4a49-9187-38d0f79bdeef tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:45.606963 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-997be013-c1c0-4a49-9187-38d0f79bdeef tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:45.607650 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-997be013-c1c0-4a49-9187-38d0f79bdeef tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:45.608918 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-997be013-c1c0-4a49-9187-38d0f79bdeef tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:45.609818 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-997be013-c1c0-4a49-9187-38d0f79bdeef tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:45.610254 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-997be013-c1c0-4a49-9187-38d0f79bdeef tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:45.631015 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-997be013-c1c0-4a49-9187-38d0f79bdeef tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Getting quotas for project 40150a4410624fb7a9704f41fbade88d. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:38:45.637481 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-997be013-c1c0-4a49-9187-38d0f79bdeef tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Getting quotas for user 4ad7a1b603dc4476b6e61ab41314e0ac and project 40150a4410624fb7a9704f41fbade88d. Resources: {'ram', 'instances', 'cores'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:38:45.655412 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-997be013-c1c0-4a49-9187-38d0f79bdeef tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Going to run 1 instances... {{(pid=123016) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:38:45.659147 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-997be013-c1c0-4a49-9187-38d0f79bdeef tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:38:45.846440 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-997be013-c1c0-4a49-9187-38d0f79bdeef tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.955389 Aug 22 17:38:45.847492 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 980/1962] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:38:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 17:38:45.858646 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-37ccd0d0-7cfd-46e3-adb9-164b31f5e438 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:45.859852 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-37ccd0d0-7cfd-46e3-adb9-164b31f5e438 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:45.945729 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-37ccd0d0-7cfd-46e3-adb9-164b31f5e438 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad7a1b603dc4476b6e61ab41314e0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40150a4410624fb7a9704f41fbade88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:45.953923 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-37ccd0d0-7cfd-46e3-adb9-164b31f5e438 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34" status: 200 len: 1213 microversion: 2.1 time: 0.099258 Aug 22 17:38:45.954499 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 983/1963] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:45 2022] GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34 => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:46.992489 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7f45c9d3-76b4-4642-bf59-aa103afd9c4c tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:46.992489 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-7f45c9d3-76b4-4642-bf59-aa103afd9c4c tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:47.156987 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-7f45c9d3-76b4-4642-bf59-aa103afd9c4c tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad7a1b603dc4476b6e61ab41314e0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40150a4410624fb7a9704f41fbade88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:47.166834 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7f45c9d3-76b4-4642-bf59-aa103afd9c4c tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34" status: 200 len: 1213 microversion: 2.1 time: 0.186761 Aug 22 17:38:47.178157 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 981/1964] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:46 2022] GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34 => generated 1213 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:48.190145 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-98d621d5-e26f-41fb-918c-17f3828165c6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:48.190883 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-98d621d5-e26f-41fb-918c-17f3828165c6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:48.202385 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98d621d5-e26f-41fb-918c-17f3828165c6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:48.202916 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98d621d5-e26f-41fb-918c-17f3828165c6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:48.203370 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98d621d5-e26f-41fb-918c-17f3828165c6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:48.204111 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98d621d5-e26f-41fb-918c-17f3828165c6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:48.204586 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98d621d5-e26f-41fb-918c-17f3828165c6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:48.205020 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98d621d5-e26f-41fb-918c-17f3828165c6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:48.308865 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-98d621d5-e26f-41fb-918c-17f3828165c6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad7a1b603dc4476b6e61ab41314e0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40150a4410624fb7a9704f41fbade88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:48.317955 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-98d621d5-e26f-41fb-918c-17f3828165c6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34" status: 200 len: 1217 microversion: 2.1 time: 0.131993 Aug 22 17:38:48.318550 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 984/1965] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:48 2022] GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34 => generated 1217 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:49.340857 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a8803494-c1fc-4d77-9247-fd022b7eec43 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:49.341495 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-a8803494-c1fc-4d77-9247-fd022b7eec43 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:49.369427 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8803494-c1fc-4d77-9247-fd022b7eec43 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:49.375912 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8803494-c1fc-4d77-9247-fd022b7eec43 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:49.376908 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8803494-c1fc-4d77-9247-fd022b7eec43 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:49.378202 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8803494-c1fc-4d77-9247-fd022b7eec43 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:49.378911 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8803494-c1fc-4d77-9247-fd022b7eec43 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:49.379612 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a8803494-c1fc-4d77-9247-fd022b7eec43 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:49.580555 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a8803494-c1fc-4d77-9247-fd022b7eec43 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad7a1b603dc4476b6e61ab41314e0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40150a4410624fb7a9704f41fbade88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:49.596509 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a8803494-c1fc-4d77-9247-fd022b7eec43 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34" status: 200 len: 1273 microversion: 2.1 time: 0.260211 Aug 22 17:38:49.597745 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 982/1966] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:49 2022] GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34 => generated 1273 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:50.619028 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-42adf748-d0b8-47f3-933b-4d8525c184f6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:50.619731 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-42adf748-d0b8-47f3-933b-4d8525c184f6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:50.634949 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-42adf748-d0b8-47f3-933b-4d8525c184f6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:50.635529 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-42adf748-d0b8-47f3-933b-4d8525c184f6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:50.635969 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-42adf748-d0b8-47f3-933b-4d8525c184f6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:50.636716 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-42adf748-d0b8-47f3-933b-4d8525c184f6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:50.637190 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-42adf748-d0b8-47f3-933b-4d8525c184f6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:50.637837 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-42adf748-d0b8-47f3-933b-4d8525c184f6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:50.735657 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-42adf748-d0b8-47f3-933b-4d8525c184f6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad7a1b603dc4476b6e61ab41314e0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40150a4410624fb7a9704f41fbade88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:50.746931 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-42adf748-d0b8-47f3-933b-4d8525c184f6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34" status: 200 len: 1271 microversion: 2.1 time: 0.131781 Aug 22 17:38:50.747525 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 985/1967] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:50 2022] GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34 => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:51.357304 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-eecb47e7-e8a6-498d-985f-40e14bfaa360 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-272819470", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0957147d-a0af-47df-b706-7139d2583c3f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b87a647c-9ee9-4c3f-93f3-341218d515d9"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:38:51.496540 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-eecb47e7-e8a6-498d-985f-40e14bfaa360 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] validate_networks() for [('b87a647c-9ee9-4c3f-93f3-341218d515d9', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:38:51.768417 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-50281e9a-5d35-487f-872a-3422ad2145b7 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:51.780832 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-50281e9a-5d35-487f-872a-3422ad2145b7 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:51.798614 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-50281e9a-5d35-487f-872a-3422ad2145b7 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:51.799406 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-50281e9a-5d35-487f-872a-3422ad2145b7 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:51.800041 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-50281e9a-5d35-487f-872a-3422ad2145b7 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:51.800980 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-50281e9a-5d35-487f-872a-3422ad2145b7 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:51.801693 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-50281e9a-5d35-487f-872a-3422ad2145b7 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:51.802374 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-50281e9a-5d35-487f-872a-3422ad2145b7 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-eecb47e7-e8a6-498d-985f-40e14bfaa360 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0ff5dbaa-57a1-4e94-baee-8bfceac0d43b) Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:38:51.995698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:38:51.999240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:38:51.999240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:38:51.999240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:38:51.999240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:38:51.999240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:38:51.999240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:38:51.999240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:38:51.999240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:38:51.999240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:38:51.999240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:38:51.999240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:38:51.999240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:38:51.999240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:38:51.999240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:38:51.999240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0ff5dbaa-57a1-4e94-baee-8bfceac0d43b) Aug 22 17:38:51.999240 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:38:51.999240 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-eecb47e7-e8a6-498d-985f-40e14bfaa360 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:38:51.999240 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-eecb47e7-e8a6-498d-985f-40e14bfaa360 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Request method failure captured: Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 353 Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA78SNKo6LWaSavKnrOXvq_SjfWp-Bg17LcglLXKq79ikHLx0RzRS4dYdMXTgSrs2qxn95fTCnsj05cLZdWs0MEAxCvW0GW3ffiQ_1wCjcaH1Ukbr08sDuqHVBEY1UhmjUPZi7X1C-5aT7EeNsUzDlPLvFjI2BgummbYPZFDo_T-Y0wo Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 3753856e1c8043658e95d6108aff12fc Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-TestVolumeBootPattern-1681765592 Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3753856e1c8043658e95d6108aff12fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_3753856e1c8043658e95d6108aff12fc", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3753856e1c8043658e95d6108aff12fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/3753856e1c8043658e95d6108aff12fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-TestVolumeBootPattern-1681765592 Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 3753856e1c8043658e95d6108aff12fc Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-TestVolumeBootPattern-1681765592 Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-TestVolumeBootPattern-1681765592-project Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: d4b025a667e7499b80bdc74611d53c44 Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-TestVolumeBootPattern-1681765592-project Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-TestVolumeBootPattern-server-272819470", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0957147d-a0af-47df-b706-7139d2583c3f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b87a647c-9ee9-4c3f-93f3-341218d515d9"}]}} Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-272819470', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '0957147d-a0af-47df-b706-7139d2583c3f'}], 'networks': [{'uuid': 'b87a647c-9ee9-4c3f-93f3-341218d515d9'}]}}} Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:38:52.000372 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0ff5dbaa-57a1-4e94-baee-8bfceac0d43b) Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:38:52.005265 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:38:52.018161 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:38:52.018161 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:38:52.018161 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:38:52.018161 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:38:52.018161 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:38:52.018161 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:38:52.018161 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:38:52.018161 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:38:52.018161 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:38:52.018161 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:38:52.018161 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:38:52.018161 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:38:52.018161 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:38:52.018161 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:38:52.018161 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:38:52.018161 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-eecb47e7-e8a6-498d-985f-40e14bfaa360 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:38:52.018161 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:38:52.018161 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-eecb47e7-e8a6-498d-985f-40e14bfaa360 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.648722 Aug 22 17:38:52.018161 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 983/1968] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:38:51 2022] POST /compute/v2.1/servers => generated 214 bytes in 657 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:38:52.049719 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-50281e9a-5d35-487f-872a-3422ad2145b7 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad7a1b603dc4476b6e61ab41314e0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40150a4410624fb7a9704f41fbade88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:52.059518 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-50281e9a-5d35-487f-872a-3422ad2145b7 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34" status: 200 len: 1313 microversion: 2.1 time: 0.295553 Aug 22 17:38:52.073147 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 986/1969] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:51 2022] GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:53.074024 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-6a2b9786-6cc0-4464-bb60-b7fac1f056e9 req-7006ea51-9522-42c4-9a2d-d0e2bd46422a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18bb0859-65f8-4a1b-b47c-e72f92138b34", "tag": "483e9bd1-6ce5-43c1-9b6b-c0f69a025c64"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:38:53.082625 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9ca51cd6-83fb-485e-82fb-3dc5278592de tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:53.083805 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-9ca51cd6-83fb-485e-82fb-3dc5278592de tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:53.092560 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ca51cd6-83fb-485e-82fb-3dc5278592de tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:53.093490 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ca51cd6-83fb-485e-82fb-3dc5278592de tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:53.116609 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ca51cd6-83fb-485e-82fb-3dc5278592de tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:53.116609 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ca51cd6-83fb-485e-82fb-3dc5278592de tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:53.116609 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ca51cd6-83fb-485e-82fb-3dc5278592de tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:53.116609 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-9ca51cd6-83fb-485e-82fb-3dc5278592de tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:53.117326 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-6a2b9786-6cc0-4464-bb60-b7fac1f056e9 req-7006ea51-9522-42c4-9a2d-d0e2bd46422a service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:53.117326 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-6a2b9786-6cc0-4464-bb60-b7fac1f056e9 req-7006ea51-9522-42c4-9a2d-d0e2bd46422a service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:53.117326 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-6a2b9786-6cc0-4464-bb60-b7fac1f056e9 req-7006ea51-9522-42c4-9a2d-d0e2bd46422a service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:53.117326 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-6a2b9786-6cc0-4464-bb60-b7fac1f056e9 req-7006ea51-9522-42c4-9a2d-d0e2bd46422a service nova] Creating event network-changed:483e9bd1-6ce5-43c1-9b6b-c0f69a025c64 for instance 18bb0859-65f8-4a1b-b47c-e72f92138b34 on n-h1-854030-1 Aug 22 17:38:53.119337 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-6a2b9786-6cc0-4464-bb60-b7fac1f056e9 req-7006ea51-9522-42c4-9a2d-d0e2bd46422a service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.372266 Aug 22 17:38:53.120321 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 984/1970] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:38:53.274435 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-9ca51cd6-83fb-485e-82fb-3dc5278592de tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad7a1b603dc4476b6e61ab41314e0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40150a4410624fb7a9704f41fbade88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:53.283677 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9ca51cd6-83fb-485e-82fb-3dc5278592de tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34" status: 200 len: 1313 microversion: 2.1 time: 0.205318 Aug 22 17:38:53.284574 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 987/1971] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:53 2022] GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:38:54.308187 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-76d777a3-be72-4d02-a05e-f66aae0e87d6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:54.309809 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-76d777a3-be72-4d02-a05e-f66aae0e87d6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:54.318896 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-76d777a3-be72-4d02-a05e-f66aae0e87d6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:54.319871 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-76d777a3-be72-4d02-a05e-f66aae0e87d6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:54.321293 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-76d777a3-be72-4d02-a05e-f66aae0e87d6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:54.322957 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-76d777a3-be72-4d02-a05e-f66aae0e87d6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:54.323633 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-76d777a3-be72-4d02-a05e-f66aae0e87d6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:54.324622 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-76d777a3-be72-4d02-a05e-f66aae0e87d6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:54.556986 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-76d777a3-be72-4d02-a05e-f66aae0e87d6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad7a1b603dc4476b6e61ab41314e0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40150a4410624fb7a9704f41fbade88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:54.566687 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-76d777a3-be72-4d02-a05e-f66aae0e87d6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34" status: 200 len: 1313 microversion: 2.1 time: 0.264320 Aug 22 17:38:54.569847 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 985/1972] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:54 2022] GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:55.595775 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-48c8c6cd-d70a-4d04-8c27-edc488dfb561 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:55.596903 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-48c8c6cd-d70a-4d04-8c27-edc488dfb561 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:55.605331 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-48c8c6cd-d70a-4d04-8c27-edc488dfb561 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:55.605989 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-48c8c6cd-d70a-4d04-8c27-edc488dfb561 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:55.606597 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-48c8c6cd-d70a-4d04-8c27-edc488dfb561 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:55.607622 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-48c8c6cd-d70a-4d04-8c27-edc488dfb561 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:55.608229 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-48c8c6cd-d70a-4d04-8c27-edc488dfb561 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:55.608815 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-48c8c6cd-d70a-4d04-8c27-edc488dfb561 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:55.871353 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-48c8c6cd-d70a-4d04-8c27-edc488dfb561 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad7a1b603dc4476b6e61ab41314e0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40150a4410624fb7a9704f41fbade88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:55.908818 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-48c8c6cd-d70a-4d04-8c27-edc488dfb561 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34" status: 200 len: 1313 microversion: 2.1 time: 0.317913 Aug 22 17:38:55.909996 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 988/1973] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:55 2022] GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34 => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:56.931919 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:56.936698 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-bb29ae84-fb45-4682-b07f-873510deb453 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:56.937466 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-bb29ae84-fb45-4682-b07f-873510deb453 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:56.951611 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb29ae84-fb45-4682-b07f-873510deb453 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:56.952204 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb29ae84-fb45-4682-b07f-873510deb453 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:56.952720 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb29ae84-fb45-4682-b07f-873510deb453 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:56.953498 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb29ae84-fb45-4682-b07f-873510deb453 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:56.954135 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb29ae84-fb45-4682-b07f-873510deb453 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:56.954572 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-bb29ae84-fb45-4682-b07f-873510deb453 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:57.105849 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-bb29ae84-fb45-4682-b07f-873510deb453 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad7a1b603dc4476b6e61ab41314e0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40150a4410624fb7a9704f41fbade88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:57.114864 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-bb29ae84-fb45-4682-b07f-873510deb453 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34" status: 200 len: 1313 microversion: 2.1 time: 0.184784 Aug 22 17:38:57.115634 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 986/1974] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:56 2022] GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:58.143042 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f1232c22-a22a-4de5-ac3d-9cacb200e418 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:58.143746 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f1232c22-a22a-4de5-ac3d-9cacb200e418 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:58.147187 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:58.155571 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f1232c22-a22a-4de5-ac3d-9cacb200e418 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:58.156962 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f1232c22-a22a-4de5-ac3d-9cacb200e418 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:58.165539 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f1232c22-a22a-4de5-ac3d-9cacb200e418 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:58.165539 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f1232c22-a22a-4de5-ac3d-9cacb200e418 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:58.165539 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f1232c22-a22a-4de5-ac3d-9cacb200e418 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:58.165539 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f1232c22-a22a-4de5-ac3d-9cacb200e418 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:58.403140 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f1232c22-a22a-4de5-ac3d-9cacb200e418 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad7a1b603dc4476b6e61ab41314e0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40150a4410624fb7a9704f41fbade88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:58.419772 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f1232c22-a22a-4de5-ac3d-9cacb200e418 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34" status: 200 len: 1313 microversion: 2.1 time: 0.282768 Aug 22 17:38:58.434916 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 989/1975] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:58 2022] GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:58.539210 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=8 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:58.625279 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-a8f57137-27cd-4651-a6eb-4eb22ded353b req-9199f5c0-8027-46a3-8338-3e9149ea58c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18bb0859-65f8-4a1b-b47c-e72f92138b34", "name": "network-vif-plugged", "status": "completed", "tag": "483e9bd1-6ce5-43c1-9b6b-c0f69a025c64"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:38:58.626762 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-a8f57137-27cd-4651-a6eb-4eb22ded353b req-9199f5c0-8027-46a3-8338-3e9149ea58c8 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:58.627250 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-a8f57137-27cd-4651-a6eb-4eb22ded353b req-9199f5c0-8027-46a3-8338-3e9149ea58c8 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:58.627678 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-a8f57137-27cd-4651-a6eb-4eb22ded353b req-9199f5c0-8027-46a3-8338-3e9149ea58c8 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:58.639999 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-a8f57137-27cd-4651-a6eb-4eb22ded353b req-9199f5c0-8027-46a3-8338-3e9149ea58c8 service nova] Creating event network-vif-plugged:483e9bd1-6ce5-43c1-9b6b-c0f69a025c64 for instance 18bb0859-65f8-4a1b-b47c-e72f92138b34 on n-h1-854030-1 Aug 22 17:38:58.647138 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-a8f57137-27cd-4651-a6eb-4eb22ded353b req-9199f5c0-8027-46a3-8338-3e9149ea58c8 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123430 Aug 22 17:38:58.648009 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 987/1976] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:38:59.442120 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-628fbb12-631f-466c-8075-1345f689fa27 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:59.442732 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-628fbb12-631f-466c-8075-1345f689fa27 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:59.453037 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-628fbb12-631f-466c-8075-1345f689fa27 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:59.453547 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-628fbb12-631f-466c-8075-1345f689fa27 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:59.454159 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-628fbb12-631f-466c-8075-1345f689fa27 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:59.455268 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-628fbb12-631f-466c-8075-1345f689fa27 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:59.455884 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-628fbb12-631f-466c-8075-1345f689fa27 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:59.457585 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-628fbb12-631f-466c-8075-1345f689fa27 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:59.631077 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-628fbb12-631f-466c-8075-1345f689fa27 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad7a1b603dc4476b6e61ab41314e0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40150a4410624fb7a9704f41fbade88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:59.643990 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-628fbb12-631f-466c-8075-1345f689fa27 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34" status: 200 len: 1313 microversion: 2.1 time: 0.206073 Aug 22 17:38:59.645283 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 990/1977] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:59 2022] GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:00.668877 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-7afdd364-ceaf-4b90-babf-e5aa2b1eeaf6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:00.669906 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-7afdd364-ceaf-4b90-babf-e5aa2b1eeaf6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:00.684380 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7afdd364-ceaf-4b90-babf-e5aa2b1eeaf6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:00.684380 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7afdd364-ceaf-4b90-babf-e5aa2b1eeaf6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:00.684380 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7afdd364-ceaf-4b90-babf-e5aa2b1eeaf6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:00.685455 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7afdd364-ceaf-4b90-babf-e5aa2b1eeaf6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:00.686153 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7afdd364-ceaf-4b90-babf-e5aa2b1eeaf6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:00.686800 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-7afdd364-ceaf-4b90-babf-e5aa2b1eeaf6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:00.868768 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-7afdd364-ceaf-4b90-babf-e5aa2b1eeaf6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad7a1b603dc4476b6e61ab41314e0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40150a4410624fb7a9704f41fbade88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:00.877333 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-7afdd364-ceaf-4b90-babf-e5aa2b1eeaf6 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34" status: 200 len: 1462 microversion: 2.1 time: 0.214166 Aug 22 17:39:00.878174 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 988/1978] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:00 2022] GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34 => generated 1462 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:00.899803 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-32f1c799-7cb3-4509-b7e3-0964f3f2d75c tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e868ec5-279d-4b49-acb8-a4debd5c1751", "device": "/dev/sdb"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:39:00.903261 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-32f1c799-7cb3-4509-b7e3-0964f3f2d75c tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:00.910824 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-32f1c799-7cb3-4509-b7e3-0964f3f2d75c tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:00.911325 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-32f1c799-7cb3-4509-b7e3-0964f3f2d75c tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:00.911765 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-32f1c799-7cb3-4509-b7e3-0964f3f2d75c tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:00.912474 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-32f1c799-7cb3-4509-b7e3-0964f3f2d75c tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:00.912933 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-32f1c799-7cb3-4509-b7e3-0964f3f2d75c tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:00.913396 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-32f1c799-7cb3-4509-b7e3-0964f3f2d75c tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:01.975807 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-32f1c799-7cb3-4509-b7e3-0964f3f2d75c tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "POST /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.080212 Aug 22 17:39:02.001239 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 991/1979] 10.222.0.96 () {60 vars in 1323 bytes} [Mon Aug 22 17:39:00 2022] POST /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34/os-volume_attachments => generated 194 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:39:32.535725 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:39:32.536471 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:39:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:39:32.748390 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:39:32.748530 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:39:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:39:45.393825 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-160c9cef-0be3-4912-8a4f-345ff0d59ff3 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1986488626", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "275fe779-10cd-42f7-afc8-52c6ad6167cb", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b87a647c-9ee9-4c3f-93f3-341218d515d9"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:39:45.404891 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:45.406078 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=30 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:45.500035 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-160c9cef-0be3-4912-8a4f-345ff0d59ff3 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] validate_networks() for [('b87a647c-9ee9-4c3f-93f3-341218d515d9', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-160c9cef-0be3-4912-8a4f-345ff0d59ff3 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e82a331b-3476-46ce-bf31-d87ad39e76d5) Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:39:45.729069 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e82a331b-3476-46ce-bf31-d87ad39e76d5) Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-160c9cef-0be3-4912-8a4f-345ff0d59ff3 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-160c9cef-0be3-4912-8a4f-345ff0d59ff3 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Request method failure captured: Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 355 Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA78SNKo6LWaSavKnrOXvq_SjfWp-Bg17LcglLXKq79ikHLx0RzRS4dYdMXTgSrs2qxn95fTCnsj05cLZdWs0MEAxCvW0GW3ffiQ_1wCjcaH1Ukbr08sDuqHVBEY1UhmjUPZi7X1C-5aT7EeNsUzDlPLvFjI2BgummbYPZFDo_T-Y0wo Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 3753856e1c8043658e95d6108aff12fc Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-TestVolumeBootPattern-1681765592 Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3753856e1c8043658e95d6108aff12fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_3753856e1c8043658e95d6108aff12fc", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3753856e1c8043658e95d6108aff12fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/3753856e1c8043658e95d6108aff12fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-TestVolumeBootPattern-1681765592 Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 3753856e1c8043658e95d6108aff12fc Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-TestVolumeBootPattern-1681765592 Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-TestVolumeBootPattern-1681765592-project Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: d4b025a667e7499b80bdc74611d53c44 Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-TestVolumeBootPattern-1681765592-project Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-TestVolumeBootPattern-server-1986488626", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "275fe779-10cd-42f7-afc8-52c6ad6167cb", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b87a647c-9ee9-4c3f-93f3-341218d515d9"}]}} Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:39:45.732848 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-1986488626', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'snapshot', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'snapshot_id': '275fe779-10cd-42f7-afc8-52c6ad6167cb'}], 'networks': [{'uuid': 'b87a647c-9ee9-4c3f-93f3-341218d515d9'}]}}} Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:39:45.738943 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e82a331b-3476-46ce-bf31-d87ad39e76d5) Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-160c9cef-0be3-4912-8a4f-345ff0d59ff3 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-160c9cef-0be3-4912-8a4f-345ff0d59ff3 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.344059 Aug 22 17:39:45.743300 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 989/1980] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:39:45 2022] POST /compute/v2.1/servers => generated 214 bytes in 345 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:40:14.875164 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=22 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:14.877703 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:14.883319 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a1a4ed46-d8ed-4589-b9dd-ac35a8612a77 tempest-VolumesSnapshotTestJSON-2038313507 tempest-VolumesSnapshotTestJSON-2038313507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-321504512", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "f6565400-a04a-4566-864e-9619df37cd89"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:40:15.025406 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-a1a4ed46-d8ed-4589-b9dd-ac35a8612a77 tempest-VolumesSnapshotTestJSON-2038313507 tempest-VolumesSnapshotTestJSON-2038313507-project] validate_networks() for [('f6565400-a04a-4566-864e-9619df37cd89', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-a1a4ed46-d8ed-4589-b9dd-ac35a8612a77 tempest-VolumesSnapshotTestJSON-2038313507 tempest-VolumesSnapshotTestJSON-2038313507-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6f720e1d-85c3-4bb1-945c-c7da16392a74) Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:40:15.335332 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:40:15.340547 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:40:15.340547 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:40:15.340547 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:40:15.340547 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:40:15.340547 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:40:15.340547 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:40:15.340547 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:40:15.340547 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:40:15.340547 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:40:15.340547 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:40:15.340547 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:40:15.340547 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:40:15.340547 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:40:15.340547 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:40:15.340547 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:40:15.340547 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6f720e1d-85c3-4bb1-945c-c7da16392a74) Aug 22 17:40:15.340547 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:15.340547 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-a1a4ed46-d8ed-4589-b9dd-ac35a8612a77 tempest-VolumesSnapshotTestJSON-2038313507 tempest-VolumesSnapshotTestJSON-2038313507-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:15.340547 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a1a4ed46-d8ed-4589-b9dd-ac35a8612a77 tempest-VolumesSnapshotTestJSON-2038313507 tempest-VolumesSnapshotTestJSON-2038313507-project] Request method failure captured: Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 210 Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA77uqJAp8EL-FoF0z-cB8AuJfFVfPqW5zEIJ1dlj-3M2_uIAPEQKhGz_8iXxMmRgG1pQca6UV-fhF4fR0tKXR5U2TQemf3oWQ9E6-2cKkMUVe1l9B2QRMgbWD-Awy85t-uOMY7L_nCy59ksAgH5GVZ43L3YTGSrmOf7USe_-lgFJTKQ Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 8fb8cbbc262c4330a486120d8a8466f7 Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2038313507 Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8fb8cbbc262c4330a486120d8a8466f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_8fb8cbbc262c4330a486120d8a8466f7", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8fb8cbbc262c4330a486120d8a8466f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/8fb8cbbc262c4330a486120d8a8466f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-VolumesSnapshotTestJSON-2038313507 Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 8fb8cbbc262c4330a486120d8a8466f7 Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2038313507 Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-VolumesSnapshotTestJSON-2038313507-project Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 9f6eb638f39d452581772e673ba5b8d7 Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-VolumesSnapshotTestJSON-2038313507-project Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-321504512", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "f6565400-a04a-4566-864e-9619df37cd89"}]}} Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-VolumesSnapshotTestJSON-instance-321504512', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'f6565400-a04a-4566-864e-9619df37cd89'}]}}} Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:40:15.346080 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6f720e1d-85c3-4bb1-945c-c7da16392a74) Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:40:15.355162 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:40:15.378969 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:15.378969 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:15.378969 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:15.378969 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:40:15.378969 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:15.378969 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:15.378969 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:40:15.378969 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:40:15.378969 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:40:15.378969 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:40:15.378969 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:15.378969 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:15.378969 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:15.378969 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a1a4ed46-d8ed-4589-b9dd-ac35a8612a77 tempest-VolumesSnapshotTestJSON-2038313507 tempest-VolumesSnapshotTestJSON-2038313507-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:15.378969 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:40:15.378969 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a1a4ed46-d8ed-4589-b9dd-ac35a8612a77 tempest-VolumesSnapshotTestJSON-2038313507 tempest-VolumesSnapshotTestJSON-2038313507-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.488298 Aug 22 17:40:15.378969 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 992/1981] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:40:14 2022] POST /compute/v2.1/servers => generated 214 bytes in 490 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:40:19.797145 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:19.802020 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-816e7eb5-f798-43e6-8080-a365d6b4194a tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] Action: 'create', calling method: .version_select at 0x7f8009b309d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-596513399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlA7TUuoVCqdnnIgJvEaBjvyhu8luETIE+ke8b/PuQqKhH7N2nAXjDDgECMGuMTsrlsxrGGgrLruSYaGjI+A1Jh+FFqa/3yUDIOwFHxTryMVtSA6flUaoxLXOMCw7PNiA=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:40:19.833972 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-816e7eb5-f798-43e6-8080-a365d6b4194a tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] Getting quotas for project 364ba74d1afd4775bfb29e90d0013daa. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:40:19.840337 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-816e7eb5-f798-43e6-8080-a365d6b4194a tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] Getting quotas for user e93f2c1817a94c1aab4ce2c7afb39ea4 and project 364ba74d1afd4775bfb29e90d0013daa. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:40:19.944651 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-816e7eb5-f798-43e6-8080-a365d6b4194a tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.153435 Aug 22 17:40:19.945867 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 990/1982] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:40:19 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:40:24.102195 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-20c5812e-4b78-459c-9747-b4a6d39e560b tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-784510721", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "65b27ab6-c605-4051-ac63-25fea585833d"}], "key_name": "tempest-TestNetworkBasicOps-596513399", "security_groups": [{"name": "tempest-secgroup-smoke-1391368355"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:40:24.335077 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-20c5812e-4b78-459c-9747-b4a6d39e560b tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] validate_networks() for [('65b27ab6-c605-4051-ac63-25fea585833d', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-20c5812e-4b78-459c-9747-b4a6d39e560b tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-36ed7cfd-8d91-4e7a-b8fd-d685dc2d5c76) Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:40:24.623038 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-36ed7cfd-8d91-4e7a-b8fd-d685dc2d5c76) Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-20c5812e-4b78-459c-9747-b4a6d39e560b tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-20c5812e-4b78-459c-9747-b4a6d39e560b tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] Request method failure captured: Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 325 Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA792RIrixJXxJVhz7gejwJzFz1Zf73AWzcBTo5jV7IFkfxKkamBTWE-mlbzNGGVprTsZBSEG4QuUNysuru2NZeBP-kKRTGH6RbpNc6vPRBmBz3snBjyP6kvSYuD5U0nQyjf3cC3i75cJJsXLZ1w4dV8Gk5TeUHmjYeg7Kawc4iDqeHY Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 364ba74d1afd4775bfb29e90d0013daa Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-TestNetworkBasicOps-514012671 Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/364ba74d1afd4775bfb29e90d0013daa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_364ba74d1afd4775bfb29e90d0013daa", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/364ba74d1afd4775bfb29e90d0013daa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/364ba74d1afd4775bfb29e90d0013daa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-TestNetworkBasicOps-514012671 Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 364ba74d1afd4775bfb29e90d0013daa Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-TestNetworkBasicOps-514012671 Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-TestNetworkBasicOps-514012671-project Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: e93f2c1817a94c1aab4ce2c7afb39ea4 Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-TestNetworkBasicOps-514012671-project Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-TestNetworkBasicOps-server-784510721", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "65b27ab6-c605-4051-ac63-25fea585833d"}], "key_name": "tempest-TestNetworkBasicOps-596513399", "security_groups": [{"name": "tempest-secgroup-smoke-1391368355"}]}} Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:24.630648 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkBasicOps-server-784510721', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '65b27ab6-c605-4051-ac63-25fea585833d'}], 'key_name': 'tempest-TestNetworkBasicOps-596513399', 'security_groups': [{'name': 'tempest-secgroup-smoke-1391368355'}]}}} Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:40:24.637232 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-36ed7cfd-8d91-4e7a-b8fd-d685dc2d5c76) Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-20c5812e-4b78-459c-9747-b4a6d39e560b tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-20c5812e-4b78-459c-9747-b4a6d39e560b tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.532478 Aug 22 17:40:24.640397 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 993/1983] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:40:24 2022] POST /compute/v2.1/servers => generated 214 bytes in 535 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:40:25.062715 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-78d3f55b-2410-4aeb-b33e-097f9df1b86f tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] Calling method '.version_select at 0x7f80099dc3a0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:25.212624 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-78d3f55b-2410-4aeb-b33e-097f9df1b86f tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-596513399" status: 202 len: 0 microversion: 2.1 time: 0.154424 Aug 22 17:40:25.213615 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 991/1984] 10.222.0.96 () {58 vars in 1254 bytes} [Mon Aug 22 17:40:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-596513399 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:40:28.194167 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a20c87cb-cdf2-4baa-98db-643c2a751aa2 tempest-VolumesSnapshotTestJSON-2038313507 tempest-VolumesSnapshotTestJSON-2038313507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-166086362", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "f6565400-a04a-4566-864e-9619df37cd89"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:40:28.262389 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-a20c87cb-cdf2-4baa-98db-643c2a751aa2 tempest-VolumesSnapshotTestJSON-2038313507 tempest-VolumesSnapshotTestJSON-2038313507-project] validate_networks() for [('f6565400-a04a-4566-864e-9619df37cd89', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-a20c87cb-cdf2-4baa-98db-643c2a751aa2 tempest-VolumesSnapshotTestJSON-2038313507 tempest-VolumesSnapshotTestJSON-2038313507-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e1f876fe-6435-4707-b2c0-f29dc01c613d) Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:40:28.915015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e1f876fe-6435-4707-b2c0-f29dc01c613d) Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-a20c87cb-cdf2-4baa-98db-643c2a751aa2 tempest-VolumesSnapshotTestJSON-2038313507 tempest-VolumesSnapshotTestJSON-2038313507-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a20c87cb-cdf2-4baa-98db-643c2a751aa2 tempest-VolumesSnapshotTestJSON-2038313507 tempest-VolumesSnapshotTestJSON-2038313507-project] Request method failure captured: Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 210 Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA77uqJAp8EL-FoF0z-cB8AuJfFVfPqW5zEIJ1dlj-3M2_uIAPEQKhGz_8iXxMmRgG1pQca6UV-fhF4fR0tKXR5U2TQemf3oWQ9E6-2cKkMUVe1l9B2QRMgbWD-Awy85t-uOMY7L_nCy59ksAgH5GVZ43L3YTGSrmOf7USe_-lgFJTKQ Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 8fb8cbbc262c4330a486120d8a8466f7 Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2038313507 Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8fb8cbbc262c4330a486120d8a8466f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_8fb8cbbc262c4330a486120d8a8466f7", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/8fb8cbbc262c4330a486120d8a8466f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/8fb8cbbc262c4330a486120d8a8466f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-VolumesSnapshotTestJSON-2038313507 Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 8fb8cbbc262c4330a486120d8a8466f7 Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2038313507 Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-VolumesSnapshotTestJSON-2038313507-project Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 9f6eb638f39d452581772e673ba5b8d7 Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-VolumesSnapshotTestJSON-2038313507-project Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-166086362", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "f6565400-a04a-4566-864e-9619df37cd89"}]}} Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:40:28.919143 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-VolumesSnapshotTestJSON-instance-166086362', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'f6565400-a04a-4566-864e-9619df37cd89'}]}}} Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:40:28.923191 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e1f876fe-6435-4707-b2c0-f29dc01c613d) Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-a20c87cb-cdf2-4baa-98db-643c2a751aa2 tempest-VolumesSnapshotTestJSON-2038313507 tempest-VolumesSnapshotTestJSON-2038313507-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:40:28.926810 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-a20c87cb-cdf2-4baa-98db-643c2a751aa2 tempest-VolumesSnapshotTestJSON-2038313507 tempest-VolumesSnapshotTestJSON-2038313507-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.730216 Aug 22 17:40:28.933757 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 994/1985] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:40:28 2022] POST /compute/v2.1/servers => generated 214 bytes in 745 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:40:32.766951 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:32.771364 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6820ed03-6425-48ee-a6b9-95d4de87bd53 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-49155121", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5198d747-f7cc-4471-80d1-30c9b1ab0545", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b87a647c-9ee9-4c3f-93f3-341218d515d9"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:40:32.855612 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-6820ed03-6425-48ee-a6b9-95d4de87bd53 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] validate_networks() for [('b87a647c-9ee9-4c3f-93f3-341218d515d9', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-6820ed03-6425-48ee-a6b9-95d4de87bd53 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6b05b116-00f2-4628-a963-a610d5573ed3) Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:40:33.704877 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6b05b116-00f2-4628-a963-a610d5573ed3) Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-6820ed03-6425-48ee-a6b9-95d4de87bd53 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6820ed03-6425-48ee-a6b9-95d4de87bd53 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Request method failure captured: Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 365 Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA78SNKo6LWaSavKnrOXvq_SjfWp-Bg17LcglLXKq79ikHLx0RzRS4dYdMXTgSrs2qxn95fTCnsj05cLZdWs0MEAxCvW0GW3ffiQ_1wCjcaH1Ukbr08sDuqHVBEY1UhmjUPZi7X1C-5aT7EeNsUzDlPLvFjI2BgummbYPZFDo_T-Y0wo Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 3753856e1c8043658e95d6108aff12fc Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-TestVolumeBootPattern-1681765592 Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3753856e1c8043658e95d6108aff12fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_3753856e1c8043658e95d6108aff12fc", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3753856e1c8043658e95d6108aff12fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/3753856e1c8043658e95d6108aff12fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-TestVolumeBootPattern-1681765592 Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 3753856e1c8043658e95d6108aff12fc Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-TestVolumeBootPattern-1681765592 Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-TestVolumeBootPattern-1681765592-project Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: d4b025a667e7499b80bdc74611d53c44 Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-TestVolumeBootPattern-1681765592-project Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-49155121", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5198d747-f7cc-4471-80d1-30c9b1ab0545", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b87a647c-9ee9-4c3f-93f3-341218d515d9"}]}} Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:33.708193 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-volume-backed-server-49155121', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': '5198d747-f7cc-4471-80d1-30c9b1ab0545'}], 'networks': [{'uuid': 'b87a647c-9ee9-4c3f-93f3-341218d515d9'}]}}} Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:40:33.714550 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6b05b116-00f2-4628-a963-a610d5573ed3) Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6820ed03-6425-48ee-a6b9-95d4de87bd53 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-6820ed03-6425-48ee-a6b9-95d4de87bd53 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.943679 Aug 22 17:40:33.719950 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 992/1986] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:40:32 2022] POST /compute/v2.1/servers => generated 214 bytes in 945 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:40:38.566239 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f66777b7-fb33-4f72-ae07-2b1bd4992bef tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Action: 'create', calling method: .version_select at 0x7f80090ac5e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-656645257", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8+GQWqgSroJk0RL1idh8ok7ikqvl8VRZopZzzKMDCqOFVcq0FNF2McSICHWiL/WCU/iwR1vG6iHD4tHW3EAecmRRunzt8s44Dt8Dhwk9bnJmCoX8Vvi1AnQ2q3cfAUtw=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:40:38.591578 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=8 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:38.637379 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-f66777b7-fb33-4f72-ae07-2b1bd4992bef tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Getting quotas for project 3753856e1c8043658e95d6108aff12fc. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:40:38.665714 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-f66777b7-fb33-4f72-ae07-2b1bd4992bef tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Getting quotas for user d4b025a667e7499b80bdc74611d53c44 and project 3753856e1c8043658e95d6108aff12fc. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:40:38.878004 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f66777b7-fb33-4f72-ae07-2b1bd4992bef tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.315652 Aug 22 17:40:38.885337 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 995/1987] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:40:38 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:40:41.684249 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8aab8ccd-95af-4b77-bf22-f868b30beef4 tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] Action: 'create', calling method: .version_select at 0x7f80094af160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1622154164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBVMpu/QayhwmlihR97QeF1Zqtdj2OECKWo2vexZGgWZqYdS8pvs/zM6PIr2SwQKRuXFX2pifx3aXSPIXmA8MZop3cZ//aoAS0GRlcnthEbR5tjN6ro8WGsMbn+QsZnFQ=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:40:41.724100 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-8aab8ccd-95af-4b77-bf22-f868b30beef4 tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] Getting quotas for project 364ba74d1afd4775bfb29e90d0013daa. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:40:41.748540 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-8aab8ccd-95af-4b77-bf22-f868b30beef4 tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] Getting quotas for user e93f2c1817a94c1aab4ce2c7afb39ea4 and project 364ba74d1afd4775bfb29e90d0013daa. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:40:41.933778 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8aab8ccd-95af-4b77-bf22-f868b30beef4 tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.253519 Aug 22 17:40:41.934654 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 993/1988] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:40:41 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:40:46.129925 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-78c0a170-104d-41e1-a60e-feec1e09c569 tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1278328541", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "e63b97b5-0bf5-4173-adf4-a9a1525f3170"}], "key_name": "tempest-TestNetworkBasicOps-1622154164", "security_groups": [{"name": "tempest-secgroup-smoke-1067393098"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:40:46.312057 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-78c0a170-104d-41e1-a60e-feec1e09c569 tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] validate_networks() for [('e63b97b5-0bf5-4173-adf4-a9a1525f3170', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-78c0a170-104d-41e1-a60e-feec1e09c569 tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6b4c22c9-4edd-4dba-a73e-40eed20a555d) Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:40:46.985673 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:40:46.990161 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:40:46.990161 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:40:46.990161 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:40:46.990161 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:40:46.990161 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:40:46.990161 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:40:46.990161 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:40:46.990161 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:40:46.990161 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:40:46.990161 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:40:46.990161 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:40:46.990161 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:40:46.990161 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:40:46.990161 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:40:46.990161 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6b4c22c9-4edd-4dba-a73e-40eed20a555d) Aug 22 17:40:46.990161 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:46.990161 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-78c0a170-104d-41e1-a60e-feec1e09c569 tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:46.990161 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-78c0a170-104d-41e1-a60e-feec1e09c569 tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] Request method failure captured: Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 327 Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA792RIrixJXxJVhz7gejwJzFz1Zf73AWzcBTo5jV7IFkfxKkamBTWE-mlbzNGGVprTsZBSEG4QuUNysuru2NZeBP-kKRTGH6RbpNc6vPRBmBz3snBjyP6kvSYuD5U0nQyjf3cC3i75cJJsXLZ1w4dV8Gk5TeUHmjYeg7Kawc4iDqeHY Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 364ba74d1afd4775bfb29e90d0013daa Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-TestNetworkBasicOps-514012671 Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/364ba74d1afd4775bfb29e90d0013daa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_364ba74d1afd4775bfb29e90d0013daa", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/364ba74d1afd4775bfb29e90d0013daa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/364ba74d1afd4775bfb29e90d0013daa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-TestNetworkBasicOps-514012671 Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 364ba74d1afd4775bfb29e90d0013daa Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-TestNetworkBasicOps-514012671 Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-TestNetworkBasicOps-514012671-project Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: e93f2c1817a94c1aab4ce2c7afb39ea4 Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-TestNetworkBasicOps-514012671-project Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-TestNetworkBasicOps-server-1278328541", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "e63b97b5-0bf5-4173-adf4-a9a1525f3170"}], "key_name": "tempest-TestNetworkBasicOps-1622154164", "security_groups": [{"name": "tempest-secgroup-smoke-1067393098"}]}} Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkBasicOps-server-1278328541', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'e63b97b5-0bf5-4173-adf4-a9a1525f3170'}], 'key_name': 'tempest-TestNetworkBasicOps-1622154164', 'security_groups': [{'name': 'tempest-secgroup-smoke-1067393098'}]}}} Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:40:46.992546 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6b4c22c9-4edd-4dba-a73e-40eed20a555d) Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:40:47.002050 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:40:47.006499 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:40:47.006499 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:40:47.006499 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:47.006499 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:47.006499 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:47.006499 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:40:47.006499 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:47.006499 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:40:47.006499 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:40:47.006499 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:40:47.006499 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:40:47.006499 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:40:47.006499 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:47.006499 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:47.006499 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:40:47.006499 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-78c0a170-104d-41e1-a60e-feec1e09c569 tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:40:47.006499 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:40:47.006499 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-78c0a170-104d-41e1-a60e-feec1e09c569 tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.868033 Aug 22 17:40:47.006499 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 996/1989] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:40:46 2022] POST /compute/v2.1/servers => generated 214 bytes in 869 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:40:47.308936 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1112ce39-2667-49fe-9416-384f2770c765 tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] Calling method '.version_select at 0x7f80094afdc0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:47.443875 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1112ce39-2667-49fe-9416-384f2770c765 tempest-TestNetworkBasicOps-514012671 tempest-TestNetworkBasicOps-514012671-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1622154164" status: 202 len: 0 microversion: 2.1 time: 0.149131 Aug 22 17:40:47.445262 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 994/1990] 10.222.0.96 () {58 vars in 1257 bytes} [Mon Aug 22 17:40:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1622154164 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:41:13.826847 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:41:13.827709 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:41:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:41:17.355575 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:17.357470 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:17.361822 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b0424317-2065-44ae-affc-c38485c526c0 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-230812062", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-656645257", "security_groups": [{"name": "tempest-secgroup-smoke-2110163752"}], "block_device_mapping_v2": [{"uuid": "7065a29e-9ef9-4bdf-aa62-23bbe78aefcb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b87a647c-9ee9-4c3f-93f3-341218d515d9"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:41:17.500625 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-b0424317-2065-44ae-affc-c38485c526c0 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] validate_networks() for [('b87a647c-9ee9-4c3f-93f3-341218d515d9', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-b0424317-2065-44ae-affc-c38485c526c0 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f9e92700-8227-4ee5-a812-ff214b53ea91) Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:41:17.770576 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f9e92700-8227-4ee5-a812-ff214b53ea91) Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-b0424317-2065-44ae-affc-c38485c526c0 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b0424317-2065-44ae-affc-c38485c526c0 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Request method failure captured: Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 476 Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA78SNKo6LWaSavKnrOXvq_SjfWp-Bg17LcglLXKq79ikHLx0RzRS4dYdMXTgSrs2qxn95fTCnsj05cLZdWs0MEAxCvW0GW3ffiQ_1wCjcaH1Ukbr08sDuqHVBEY1UhmjUPZi7X1C-5aT7EeNsUzDlPLvFjI2BgummbYPZFDo_T-Y0wo Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 3753856e1c8043658e95d6108aff12fc Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-TestVolumeBootPattern-1681765592 Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3753856e1c8043658e95d6108aff12fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_3753856e1c8043658e95d6108aff12fc", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/3753856e1c8043658e95d6108aff12fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/3753856e1c8043658e95d6108aff12fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-TestVolumeBootPattern-1681765592 Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 3753856e1c8043658e95d6108aff12fc Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-TestVolumeBootPattern-1681765592 Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-TestVolumeBootPattern-1681765592-project Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: d4b025a667e7499b80bdc74611d53c44 Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-TestVolumeBootPattern-1681765592-project Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-TestVolumeBootPattern-server-230812062", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-656645257", "security_groups": [{"name": "tempest-secgroup-smoke-2110163752"}], "block_device_mapping_v2": [{"uuid": "7065a29e-9ef9-4bdf-aa62-23bbe78aefcb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b87a647c-9ee9-4c3f-93f3-341218d515d9"}]}} Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:41:17.775171 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-230812062', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestVolumeBootPattern-656645257', 'security_groups': [{'name': 'tempest-secgroup-smoke-2110163752'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '7065a29e-9ef9-4bdf-aa62-23bbe78aefcb'}], 'networks': [{'uuid': 'b87a647c-9ee9-4c3f-93f3-341218d515d9'}]}}} Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:41:17.779824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f9e92700-8227-4ee5-a812-ff214b53ea91) Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b0424317-2065-44ae-affc-c38485c526c0 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b0424317-2065-44ae-affc-c38485c526c0 tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.416399 Aug 22 17:41:17.784827 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 997/1991] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:41:17 2022] POST /compute/v2.1/servers => generated 214 bytes in 418 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:41:21.639078 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:21.639959 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:21.644231 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a3cb644b-fcc5-45d3-9823-2856e17a8cce tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] Calling method '.version_select at 0x7f8009afc0d0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:21.823563 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a3cb644b-fcc5-45d3-9823-2856e17a8cce tempest-TestVolumeBootPattern-1681765592 tempest-TestVolumeBootPattern-1681765592-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-656645257" status: 202 len: 0 microversion: 2.1 time: 0.175284 Aug 22 17:41:21.823563 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 995/1992] 10.222.0.96 () {58 vars in 1260 bytes} [Mon Aug 22 17:41:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-656645257 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:41:22.407521 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8cf5f125-db7d-4a4b-93e3-62d4d7c6d6f0 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:22.414453 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8cf5f125-db7d-4a4b-93e3-62d4d7c6d6f0 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:22.430238 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8cf5f125-db7d-4a4b-93e3-62d4d7c6d6f0 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:22.430727 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8cf5f125-db7d-4a4b-93e3-62d4d7c6d6f0 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:22.431400 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8cf5f125-db7d-4a4b-93e3-62d4d7c6d6f0 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:22.438095 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8cf5f125-db7d-4a4b-93e3-62d4d7c6d6f0 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:22.438095 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8cf5f125-db7d-4a4b-93e3-62d4d7c6d6f0 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:22.438095 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8cf5f125-db7d-4a4b-93e3-62d4d7c6d6f0 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:22.579186 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-8cf5f125-db7d-4a4b-93e3-62d4d7c6d6f0 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lazy-loading 'services' on Instance uuid 18bb0859-65f8-4a1b-b47c-e72f92138b34 {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:41:22.863141 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8cf5f125-db7d-4a4b-93e3-62d4d7c6d6f0 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "DELETE /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34/os-volume_attachments/9e868ec5-279d-4b49-acb8-a4debd5c1751" status: 202 len: 0 microversion: 2.1 time: 0.471322 Aug 22 17:41:22.863905 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 998/1993] 10.222.0.96 () {58 vars in 1416 bytes} [Mon Aug 22 17:41:22 2022] DELETE /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34/os-volume_attachments/9e868ec5-279d-4b49-acb8-a4debd5c1751 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:41:25.688580 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:41:25.689836 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:41:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:41:29.457612 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-164b2510-3351-4595-8b7d-54c6f2454343 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:29.458239 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-164b2510-3351-4595-8b7d-54c6f2454343 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:29.469586 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-164b2510-3351-4595-8b7d-54c6f2454343 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:29.470098 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-164b2510-3351-4595-8b7d-54c6f2454343 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:29.470533 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-164b2510-3351-4595-8b7d-54c6f2454343 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:29.471268 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-164b2510-3351-4595-8b7d-54c6f2454343 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:29.471721 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-164b2510-3351-4595-8b7d-54c6f2454343 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:29.472143 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-164b2510-3351-4595-8b7d-54c6f2454343 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:29.500253 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-164b2510-3351-4595-8b7d-54c6f2454343 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Going to try to terminate instance {{(pid=123016) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:41:29.899005 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-164b2510-3351-4595-8b7d-54c6f2454343 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "DELETE /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34" status: 204 len: 0 microversion: 2.1 time: 0.446281 Aug 22 17:41:29.899625 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 996/1994] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:41:29 2022] DELETE /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:41:29.909162 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-98c34fc6-3d6b-4470-a8cb-dd50e13d5212 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:29.910445 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-98c34fc6-3d6b-4470-a8cb-dd50e13d5212 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:29.917359 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98c34fc6-3d6b-4470-a8cb-dd50e13d5212 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:29.918709 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98c34fc6-3d6b-4470-a8cb-dd50e13d5212 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:29.918709 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98c34fc6-3d6b-4470-a8cb-dd50e13d5212 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:29.919296 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98c34fc6-3d6b-4470-a8cb-dd50e13d5212 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:29.919936 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98c34fc6-3d6b-4470-a8cb-dd50e13d5212 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:29.920676 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-98c34fc6-3d6b-4470-a8cb-dd50e13d5212 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:30.455156 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-98c34fc6-3d6b-4470-a8cb-dd50e13d5212 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad7a1b603dc4476b6e61ab41314e0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40150a4410624fb7a9704f41fbade88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:30.463771 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-98c34fc6-3d6b-4470-a8cb-dd50e13d5212 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34" status: 200 len: 1468 microversion: 2.1 time: 0.559545 Aug 22 17:41:30.464655 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 999/1995] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:29 2022] GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34 => generated 1468 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:31.486172 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-46bbe6ed-7e31-4c45-aa8b-137961d8d294 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:31.486906 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-46bbe6ed-7e31-4c45-aa8b-137961d8d294 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:31.494239 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-46bbe6ed-7e31-4c45-aa8b-137961d8d294 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:31.494771 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-46bbe6ed-7e31-4c45-aa8b-137961d8d294 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:31.495267 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-46bbe6ed-7e31-4c45-aa8b-137961d8d294 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:31.496037 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-46bbe6ed-7e31-4c45-aa8b-137961d8d294 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:31.496496 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-46bbe6ed-7e31-4c45-aa8b-137961d8d294 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:31.496926 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-46bbe6ed-7e31-4c45-aa8b-137961d8d294 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:31.643421 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-46bbe6ed-7e31-4c45-aa8b-137961d8d294 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad7a1b603dc4476b6e61ab41314e0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40150a4410624fb7a9704f41fbade88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:31.655211 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-46bbe6ed-7e31-4c45-aa8b-137961d8d294 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34" status: 200 len: 1468 microversion: 2.1 time: 0.173274 Aug 22 17:41:31.655843 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 997/1996] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:31 2022] GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34 => generated 1468 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:32.573811 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-af57e571-2726-40fa-9a19-2ea5d7a8b871 req-14779382-6b38-4366-b410-50a56844e599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18bb0859-65f8-4a1b-b47c-e72f92138b34", "name": "network-vif-deleted", "tag": "483e9bd1-6ce5-43c1-9b6b-c0f69a025c64"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:41:32.584044 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-af57e571-2726-40fa-9a19-2ea5d7a8b871 req-14779382-6b38-4366-b410-50a56844e599 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:32.584248 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-af57e571-2726-40fa-9a19-2ea5d7a8b871 req-14779382-6b38-4366-b410-50a56844e599 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:32.584528 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-af57e571-2726-40fa-9a19-2ea5d7a8b871 req-14779382-6b38-4366-b410-50a56844e599 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:32.596840 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-af57e571-2726-40fa-9a19-2ea5d7a8b871 req-14779382-6b38-4366-b410-50a56844e599 service nova] Creating event network-vif-deleted:483e9bd1-6ce5-43c1-9b6b-c0f69a025c64 for instance 18bb0859-65f8-4a1b-b47c-e72f92138b34 on n-h1-854030-1 Aug 22 17:41:32.603022 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-af57e571-2726-40fa-9a19-2ea5d7a8b871 req-14779382-6b38-4366-b410-50a56844e599 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033681 Aug 22 17:41:32.604500 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1000/1997] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:41:32.678864 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5edebf9e-ab53-48fd-8ded-3920c2efedd2 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:32.680506 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-5edebf9e-ab53-48fd-8ded-3920c2efedd2 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:32.692049 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5edebf9e-ab53-48fd-8ded-3920c2efedd2 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:32.692648 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5edebf9e-ab53-48fd-8ded-3920c2efedd2 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:32.693349 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5edebf9e-ab53-48fd-8ded-3920c2efedd2 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:32.694148 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5edebf9e-ab53-48fd-8ded-3920c2efedd2 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:32.694806 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5edebf9e-ab53-48fd-8ded-3920c2efedd2 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:32.696033 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-5edebf9e-ab53-48fd-8ded-3920c2efedd2 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:32.785258 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-5edebf9e-ab53-48fd-8ded-3920c2efedd2 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad7a1b603dc4476b6e61ab41314e0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40150a4410624fb7a9704f41fbade88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:32.793725 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5edebf9e-ab53-48fd-8ded-3920c2efedd2 tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34" status: 200 len: 1426 microversion: 2.1 time: 0.119668 Aug 22 17:41:32.794866 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 998/1998] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:32 2022] GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34 => generated 1426 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:33.817659 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7624757d-d3e1-40e2-a793-e44e46d83aca tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:33.818711 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-7624757d-d3e1-40e2-a793-e44e46d83aca tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] [instance: 18bb0859-65f8-4a1b-b47c-e72f92138b34] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:33.830896 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7624757d-d3e1-40e2-a793-e44e46d83aca tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:33.831567 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7624757d-d3e1-40e2-a793-e44e46d83aca tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:33.832109 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7624757d-d3e1-40e2-a793-e44e46d83aca tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:33.832973 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7624757d-d3e1-40e2-a793-e44e46d83aca tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:33.833572 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7624757d-d3e1-40e2-a793-e44e46d83aca tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:33.834098 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-7624757d-d3e1-40e2-a793-e44e46d83aca tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:33.854234 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-7624757d-d3e1-40e2-a793-e44e46d83aca tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] HTTP exception thrown: Instance 18bb0859-65f8-4a1b-b47c-e72f92138b34 could not be found. Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7624757d-d3e1-40e2-a793-e44e46d83aca tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Request method failure captured: Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: request: GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34 HTTP/1.1 Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 0 Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA78gUS3otGurktsPq082AbzSl8lL_oS6MESY8ZNCaz7LKCqFSgXNIWe0LAvePkbw4HlthpYAqGeilsw9XRFPJGBmIePLvkYZp2FWdxMqZa7PuZ9xwo8H-s6sQF-AUL3I-0s_xBOmzJzfKOySJUfmdG2sTOnbZaukZYyTpVWVoqzB8VI Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 40150a4410624fb7a9704f41fbade88d Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-VolumesBackupsTest-781564346 Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/40150a4410624fb7a9704f41fbade88d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_40150a4410624fb7a9704f41fbade88d", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/40150a4410624fb7a9704f41fbade88d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/40150a4410624fb7a9704f41fbade88d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-VolumesBackupsTest-781564346 Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 40150a4410624fb7a9704f41fbade88d Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-VolumesBackupsTest-781564346 Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-VolumesBackupsTest-781564346-project Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 4ad7a1b603dc4476b6e61ab41314e0ac Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-VolumesBackupsTest-781564346-project Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: exception: Instance 18bb0859-65f8-4a1b-b47c-e72f92138b34 could not be found. Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '18bb0859-65f8-4a1b-b47c-e72f92138b34'} Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18bb0859-65f8-4a1b-b47c-e72f92138b34 could not be found. Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18bb0859-65f8-4a1b-b47c-e72f92138b34 could not be found. Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:41:33.856098 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:41:33.864745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:41:33.864745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:41:33.864745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:41:33.864745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:41:33.864745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:41:33.864745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18bb0859-65f8-4a1b-b47c-e72f92138b34 could not be found. Aug 22 17:41:33.864745 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:41:33.864745 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-7624757d-d3e1-40e2-a793-e44e46d83aca tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] Returning 404 to user: Instance 18bb0859-65f8-4a1b-b47c-e72f92138b34 could not be found. {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:41:33.866253 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-7624757d-d3e1-40e2-a793-e44e46d83aca tempest-VolumesBackupsTest-781564346 tempest-VolumesBackupsTest-781564346-project] 10.222.0.96 "GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34" status: 404 len: 111 microversion: 2.1 time: 0.053347 Aug 22 17:41:33.870773 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1001/1999] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:33 2022] GET /compute/v2.1/servers/18bb0859-65f8-4a1b-b47c-e72f92138b34 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:42:01.170935 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:01.172145 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:01.326626 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-8aa1f022-8f95-4280-b24d-be629544370b tempest-TestServerMultinode-1379495146 tempest-TestServerMultinode-1379495146-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:01.327606 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:42:01.327606 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:42:01.328878 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8aa1f022-8f95-4280-b24d-be629544370b tempest-TestServerMultinode-1379495146 tempest-TestServerMultinode-1379495146-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:01.329487 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8aa1f022-8f95-4280-b24d-be629544370b tempest-TestServerMultinode-1379495146 tempest-TestServerMultinode-1379495146-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:01.330211 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8aa1f022-8f95-4280-b24d-be629544370b tempest-TestServerMultinode-1379495146 tempest-TestServerMultinode-1379495146-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:01.338950 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8aa1f022-8f95-4280-b24d-be629544370b tempest-TestServerMultinode-1379495146 tempest-TestServerMultinode-1379495146-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:01.339447 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8aa1f022-8f95-4280-b24d-be629544370b tempest-TestServerMultinode-1379495146 tempest-TestServerMultinode-1379495146-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:01.339918 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-8aa1f022-8f95-4280-b24d-be629544370b tempest-TestServerMultinode-1379495146 tempest-TestServerMultinode-1379495146-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:01.369153 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-8aa1f022-8f95-4280-b24d-be629544370b tempest-TestServerMultinode-1379495146 tempest-TestServerMultinode-1379495146-project-admin] 10.222.0.96 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.204529 Aug 22 17:42:01.369680 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 999/2000] 10.222.0.96 () {58 vars in 1185 bytes} [Mon Aug 22 17:42:01 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:42:01.483521 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-95dfff32-4251-4c6b-be71-03fc85a5ad54 tempest-TestServerMultinode-1379495146 tempest-TestServerMultinode-1379495146-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1620321742", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "availability_zone": "nova:n-h1-854030-1", "networks": [{"uuid": "2ea08b30-85b4-4888-9ea4-fb7e3b879f42"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:42:01.490635 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=12 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:01.492269 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:01.552795 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-95dfff32-4251-4c6b-be71-03fc85a5ad54 tempest-TestServerMultinode-1379495146 tempest-TestServerMultinode-1379495146-project-admin] validate_networks() for [('2ea08b30-85b4-4888-9ea4-fb7e3b879f42', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-95dfff32-4251-4c6b-be71-03fc85a5ad54 tempest-TestServerMultinode-1379495146 tempest-TestServerMultinode-1379495146-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a36d13bc-4d68-4e30-945c-ebfa5f4fbd66) Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:42:01.907743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:42:01.911847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:42:01.911847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:42:01.911847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:42:01.911847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:42:01.911847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:42:01.911847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:42:01.911847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:42:01.911847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:42:01.911847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:42:01.911847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:42:01.911847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:42:01.911847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:42:01.911847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:42:01.911847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:42:01.911847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a36d13bc-4d68-4e30-945c-ebfa5f4fbd66) Aug 22 17:42:01.911847 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:42:01.914310 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-95dfff32-4251-4c6b-be71-03fc85a5ad54 tempest-TestServerMultinode-1379495146 tempest-TestServerMultinode-1379495146-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:42:01.914310 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-95dfff32-4251-4c6b-be71-03fc85a5ad54 tempest-TestServerMultinode-1379495146 tempest-TestServerMultinode-1379495146-project-admin] Request method failure captured: Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 248 Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA7_pBtAlDKyXkdSohkRlWVznyck95tG8AvBEEkDZkKtlbutRMCDxQF3vtV931_OjTCKHJcoNOC51ekMS4vvDR2v_mgzKeX44B91At-k0shcRbbUBX5RsSrC8Kbd87JyjcA4I0b8E3wCH5XtyKR9VuxQgV-iN2cHzh6mWV-4osWczFxQ Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 7f0ba91b6aa143cca648a532b32d6d94 Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-TestServerMultinode-1379495146 Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7f0ba91b6aa143cca648a532b32d6d94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_7f0ba91b6aa143cca648a532b32d6d94", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/7f0ba91b6aa143cca648a532b32d6d94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/7f0ba91b6aa143cca648a532b32d6d94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-TestServerMultinode-1379495146 Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 7f0ba91b6aa143cca648a532b32d6d94 Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-TestServerMultinode-1379495146 Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-TestServerMultinode-1379495146-project-admin Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 335d9a471e4c4589b2c62be061100f7d Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-TestServerMultinode-1379495146-project-admin Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-TestServerMultinode-server-1620321742", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "availability_zone": "nova:n-h1-854030-1", "networks": [{"uuid": "2ea08b30-85b4-4888-9ea4-fb7e3b879f42"}]}} Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-TestServerMultinode-server-1620321742', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '2ea08b30-85b4-4888-9ea4-fb7e3b879f42'}]}}} Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:42:01.916859 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a36d13bc-4d68-4e30-945c-ebfa5f4fbd66) Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:42:01.921446 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:42:01.925363 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:42:01.925363 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:42:01.925363 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:42:01.925363 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:42:01.925363 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:42:01.925363 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:42:01.925363 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:42:01.925363 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:42:01.925363 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:42:01.925363 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:42:01.925363 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:42:01.925363 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:42:01.925363 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:42:01.929464 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-95dfff32-4251-4c6b-be71-03fc85a5ad54 tempest-TestServerMultinode-1379495146 tempest-TestServerMultinode-1379495146-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:42:01.929464 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:42:01.929778 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-95dfff32-4251-4c6b-be71-03fc85a5ad54 tempest-TestServerMultinode-1379495146 tempest-TestServerMultinode-1379495146-project-admin] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.449539 Aug 22 17:42:01.932828 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1002/2001] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:42:01 2022] POST /compute/v2.1/servers => generated 214 bytes in 454 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:42:21.530801 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:21.702520 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c0742994-ab66-4934-a7f4-a92d1717a311 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-925278954", "availability_zone": "foo_zone"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:42:21.706846 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:42:21.706846 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:42:21.708889 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.objects.aggregate [None req-c0742994-ab66-4934-a7f4-a92d1717a311 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Generated uuid f43da783-52a0-4c24-b7be-b816149a574e for aggregate {{(pid=123016) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 22 17:42:21.881398 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c0742994-ab66-4934-a7f4-a92d1717a311 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.356218 Aug 22 17:42:21.882963 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1000/2002] 10.222.0.96 () {60 vars in 1164 bytes} [Mon Aug 22 17:42:21 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:42:21.891610 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:21.895865 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-030e9a83-fc74-49c5-a666-923fd4a2f40b tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:42:21.900370 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:42:21.900370 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:42:22.053831 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-030e9a83-fc74-49c5-a666-923fd4a2f40b tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.162774 Aug 22 17:42:22.056007 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1003/2003] 10.222.0.96 () {60 vars in 1194 bytes} [Mon Aug 22 17:42:21 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:42:22.066988 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-ebcdb62e-fe46-4b1c-989d-cca3d400a086 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:22.069759 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:42:22.069759 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:42:22.071020 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ebcdb62e-fe46-4b1c-989d-cca3d400a086 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:22.071513 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ebcdb62e-fe46-4b1c-989d-cca3d400a086 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:22.071960 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ebcdb62e-fe46-4b1c-989d-cca3d400a086 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:22.072712 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ebcdb62e-fe46-4b1c-989d-cca3d400a086 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:22.073221 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ebcdb62e-fe46-4b1c-989d-cca3d400a086 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:22.073634 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-ebcdb62e-fe46-4b1c-989d-cca3d400a086 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:22.099711 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-ebcdb62e-fe46-4b1c-989d-cca3d400a086 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] 10.222.0.96 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036390 Aug 22 17:42:22.100338 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1001/2004] 10.222.0.96 () {58 vars in 1176 bytes} [Mon Aug 22 17:42:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:42:22.113613 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-59512110-c001-4a91-bc27-5fb9f5d747a3 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:22.114455 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:42:22.114455 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:42:22.129471 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-59512110-c001-4a91-bc27-5fb9f5d747a3 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] 10.222.0.96 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.019275 Aug 22 17:42:22.130528 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1004/2005] 10.222.0.96 () {58 vars in 1143 bytes} [Mon Aug 22 17:42:22 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:42:22.141375 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-c88db9ba-499c-4881-b004-b66cc47d3435 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854030-1"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:42:22.143979 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:42:22.143979 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:42:22.154550 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c88db9ba-499c-4881-b004-b66cc47d3435 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:22.155240 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c88db9ba-499c-4881-b004-b66cc47d3435 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:22.156348 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-c88db9ba-499c-4881-b004-b66cc47d3435 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:22.664720 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-c88db9ba-499c-4881-b004-b66cc47d3435 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.526416 Aug 22 17:42:22.665682 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1002/2006] 10.222.0.96 () {60 vars in 1194 bytes} [Mon Aug 22 17:42:22 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:42:22.677945 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b683171e-4a31-4ed1-b563-b391f3109a14 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:22.678695 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:42:22.678695 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:42:22.687935 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b683171e-4a31-4ed1-b563-b391f3109a14 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] 10.222.0.96 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.014700 Aug 22 17:42:22.688511 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1005/2007] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:42:22 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:42:22.701289 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b1042cdc-2082-4412-b8eb-92c804c67487 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-433478053", "availability_zone": "foo_zone"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:42:22.704062 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:42:22.704062 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:42:22.860571 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b1042cdc-2082-4412-b8eb-92c804c67487 tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] 10.222.0.96 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.162977 Aug 22 17:42:22.861462 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1003/2008] 10.222.0.96 () {60 vars in 1173 bytes} [Mon Aug 22 17:42:22 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:42:22.874257 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-65ef1b54-ec13-4e20-83b0-5019dd1b9b0b tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:42:22.876882 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:42:22.876882 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:42:22.974658 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-65ef1b54-ec13-4e20-83b0-5019dd1b9b0b tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.104386 Aug 22 17:42:22.977063 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1006/2009] 10.222.0.96 () {60 vars in 1194 bytes} [Mon Aug 22 17:42:22 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:42:22.989033 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-2b54ef6f-d0e3-4806-9546-3b0ef3639b5e tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:22.990179 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:42:22.990179 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:42:22.999812 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-2b54ef6f-d0e3-4806-9546-3b0ef3639b5e tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] 10.222.0.96 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.014614 Aug 22 17:42:23.000707 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1004/2010] 10.222.0.96 () {58 vars in 1152 bytes} [Mon Aug 22 17:42:22 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:42:23.012508 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-17340cba-bab8-4b45-a13c-355c3e59144a tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854030-1"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:42:23.015095 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:42:23.015095 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:42:23.024848 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-17340cba-bab8-4b45-a13c-355c3e59144a tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:23.025172 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-17340cba-bab8-4b45-a13c-355c3e59144a tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:23.025811 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-17340cba-bab8-4b45-a13c-355c3e59144a tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:23.568932 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-17340cba-bab8-4b45-a13c-355c3e59144a tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] 10.222.0.96 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.560491 Aug 22 17:42:23.576489 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1007/2011] 10.222.0.96 () {60 vars in 1194 bytes} [Mon Aug 22 17:42:23 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:42:23.581931 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e6cd29ff-d302-4218-9a57-c5f2a957d50e tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:23.582826 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:42:23.582826 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:42:23.669585 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e6cd29ff-d302-4218-9a57-c5f2a957d50e tempest-TestAggregatesBasicOps-1878847434 tempest-TestAggregatesBasicOps-1878847434-project-admin] 10.222.0.96 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.091697 Aug 22 17:42:23.689209 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1005/2012] 10.222.0.96 () {58 vars in 1155 bytes} [Mon Aug 22 17:42:23 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 22 17:44:32.563000 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:44:32.563000 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:44:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:44:32.760567 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:44:32.760729 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:44:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:44:45.705526 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:44:45.706089 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:44:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:46:44.060918 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:46:44.061575 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:46:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:47:35.214069 n-d-854030-1 devstack@n-api.service[123015]: ERROR oslo.messaging._drivers.impl_rabbit [-] [736bb371-7142-4c80-b6cf-ac87718b7b1e] AMQP server on 10.222.0.96:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 17:47:35.214763 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:47:35.215319 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:47:35.335939 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1104686191", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:47:35.502289 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] validate_networks() for None {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:47:35.792754 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Flavor limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:47:35.793208 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Image limits 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:47:35.793684 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Flavor pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:47:35.794090 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Image pref 0:0:0 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:47:35.794498 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.virt.hardware [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123015) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:47:35.804620 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:35.805116 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:35.805841 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:35.806276 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:35.806723 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:35.807139 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:35.824517 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Getting quotas for project 831d8741ec214235ab8c35a56345167a. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:47:35.830082 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Getting quotas for user 66540366b78f499984ae1071753f1ccc and project 831d8741ec214235ab8c35a56345167a. Resources: {'ram', 'instances', 'cores'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:47:35.843376 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Going to run 1 instances... {{(pid=123015) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:47:35.845699 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a48bbe-9c58-420e-95bf-5f8489a49f10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123015) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:47:35.970613 n-d-854030-1 devstack@n-api.service[123015]: ERROR oslo.messaging._drivers.impl_rabbit [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [626084df-3136-4395-8d2c-c322f61158b1] AMQP server on 10.222.0.96:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 17:47:36.221583 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] [736bb371-7142-4c80-b6cf-ac87718b7b1e] Reconnected to AMQP server on 10.222.0.96:5672 via [amqp] client with port 47810. Aug 22 17:47:36.978975 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [626084df-3136-4395-8d2c-c322f61158b1] Reconnected to AMQP server on 10.222.0.96:5672 via [amqp] client with port 47812. Aug 22 17:47:36.982823 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-51aba182-92a1-47ce-8f1b-056d4921b6bf tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.770646 Aug 22 17:47:36.983464 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1008/2013] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:47:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 17:47:36.994441 n-d-854030-1 devstack@n-api.service[123016]: ERROR oslo.messaging._drivers.impl_rabbit [-] [60bafe1f-ace8-482d-a7e4-e745b51a93e7] AMQP server on 10.222.0.96:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 17:47:36.995042 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:47:36.995640 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=8 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:47:36.996300 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:47:37.002358 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-68568913-7b07-4974-a7dd-d3040dbb9346 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:37.002967 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-68568913-7b07-4974-a7dd-d3040dbb9346 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:37.173243 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-68568913-7b07-4974-a7dd-d3040dbb9346 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66540366b78f499984ae1071753f1ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831d8741ec214235ab8c35a56345167a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:37.182453 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-68568913-7b07-4974-a7dd-d3040dbb9346 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c" status: 200 len: 1222 microversion: 2.1 time: 0.189705 Aug 22 17:47:37.183033 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1006/2014] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:36 2022] GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c => generated 1222 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:38.204415 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-bf5e5772-23ab-41cd-87e6-be16dab9253b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:38.205009 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-bf5e5772-23ab-41cd-87e6-be16dab9253b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:38.212158 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bf5e5772-23ab-41cd-87e6-be16dab9253b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:38.216449 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bf5e5772-23ab-41cd-87e6-be16dab9253b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:38.216449 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bf5e5772-23ab-41cd-87e6-be16dab9253b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:38.216449 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bf5e5772-23ab-41cd-87e6-be16dab9253b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:38.216449 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bf5e5772-23ab-41cd-87e6-be16dab9253b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:38.216449 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bf5e5772-23ab-41cd-87e6-be16dab9253b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:38.279995 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-bf5e5772-23ab-41cd-87e6-be16dab9253b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66540366b78f499984ae1071753f1ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831d8741ec214235ab8c35a56345167a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:38.288347 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-bf5e5772-23ab-41cd-87e6-be16dab9253b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c" status: 200 len: 1226 microversion: 2.1 time: 0.088482 Aug 22 17:47:38.288880 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1009/2015] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:38 2022] GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:39.310256 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a5dfe322-daaa-4cdf-aab9-9b99889277d9 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:39.310902 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-a5dfe322-daaa-4cdf-aab9-9b99889277d9 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:39.319327 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a5dfe322-daaa-4cdf-aab9-9b99889277d9 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:39.319824 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a5dfe322-daaa-4cdf-aab9-9b99889277d9 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:39.320269 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a5dfe322-daaa-4cdf-aab9-9b99889277d9 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:39.320964 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a5dfe322-daaa-4cdf-aab9-9b99889277d9 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:39.321443 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a5dfe322-daaa-4cdf-aab9-9b99889277d9 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:39.321868 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a5dfe322-daaa-4cdf-aab9-9b99889277d9 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:39.328374 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] [60bafe1f-ace8-482d-a7e4-e745b51a93e7] Reconnected to AMQP server on 10.222.0.96:5672 via [amqp] client with port 47834. Aug 22 17:47:39.391977 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-a5dfe322-daaa-4cdf-aab9-9b99889277d9 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66540366b78f499984ae1071753f1ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831d8741ec214235ab8c35a56345167a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:39.406777 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a5dfe322-daaa-4cdf-aab9-9b99889277d9 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c" status: 200 len: 1274 microversion: 2.1 time: 0.100294 Aug 22 17:47:39.407364 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1007/2016] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:39 2022] GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:40.429140 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e146a078-fb08-4f7e-936a-63883bfc66d5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:40.429894 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-e146a078-fb08-4f7e-936a-63883bfc66d5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:40.436804 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e146a078-fb08-4f7e-936a-63883bfc66d5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:40.437356 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e146a078-fb08-4f7e-936a-63883bfc66d5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:40.437788 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e146a078-fb08-4f7e-936a-63883bfc66d5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:40.438503 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e146a078-fb08-4f7e-936a-63883bfc66d5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:40.439005 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e146a078-fb08-4f7e-936a-63883bfc66d5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:40.448031 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-e146a078-fb08-4f7e-936a-63883bfc66d5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:40.592298 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-e146a078-fb08-4f7e-936a-63883bfc66d5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66540366b78f499984ae1071753f1ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831d8741ec214235ab8c35a56345167a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:40.600660 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e146a078-fb08-4f7e-936a-63883bfc66d5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c" status: 200 len: 1322 microversion: 2.1 time: 0.176234 Aug 22 17:47:40.601248 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1010/2017] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:40 2022] GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:41.471986 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-c380a8b7-d961-4995-89a6-aaba34a1fc48 req-94b0c41d-778c-446a-8963-57401d744bda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11e248f8-75d7-403a-8192-76e19e80f86c", "tag": "46b6507b-cbf4-4517-9278-b48cd5068679"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:47:41.483573 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-c380a8b7-d961-4995-89a6-aaba34a1fc48 req-94b0c41d-778c-446a-8963-57401d744bda service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:41.484047 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-c380a8b7-d961-4995-89a6-aaba34a1fc48 req-94b0c41d-778c-446a-8963-57401d744bda service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:41.484477 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-c380a8b7-d961-4995-89a6-aaba34a1fc48 req-94b0c41d-778c-446a-8963-57401d744bda service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:41.496742 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-c380a8b7-d961-4995-89a6-aaba34a1fc48 req-94b0c41d-778c-446a-8963-57401d744bda service nova] Creating event network-changed:46b6507b-cbf4-4517-9278-b48cd5068679 for instance 11e248f8-75d7-403a-8192-76e19e80f86c on n-h1-854030-1 Aug 22 17:47:41.503847 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-c380a8b7-d961-4995-89a6-aaba34a1fc48 req-94b0c41d-778c-446a-8963-57401d744bda service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120263 Aug 22 17:47:41.504652 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1008/2018] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:47:41.623523 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-518bed69-2714-4d73-9cc5-6586a3114879 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:41.624195 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-518bed69-2714-4d73-9cc5-6586a3114879 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:41.631816 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-518bed69-2714-4d73-9cc5-6586a3114879 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:41.632300 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-518bed69-2714-4d73-9cc5-6586a3114879 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:41.632732 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-518bed69-2714-4d73-9cc5-6586a3114879 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:41.633459 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-518bed69-2714-4d73-9cc5-6586a3114879 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:41.633912 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-518bed69-2714-4d73-9cc5-6586a3114879 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:41.634334 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-518bed69-2714-4d73-9cc5-6586a3114879 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:41.778283 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-518bed69-2714-4d73-9cc5-6586a3114879 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66540366b78f499984ae1071753f1ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831d8741ec214235ab8c35a56345167a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:41.787036 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-518bed69-2714-4d73-9cc5-6586a3114879 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c" status: 200 len: 1322 microversion: 2.1 time: 0.167378 Aug 22 17:47:41.788326 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1011/2019] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:41 2022] GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:42.809301 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-cc12a13b-824f-48fa-8f5e-1ceba64d7562 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:42.809918 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-cc12a13b-824f-48fa-8f5e-1ceba64d7562 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:42.816162 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cc12a13b-824f-48fa-8f5e-1ceba64d7562 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:42.816646 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cc12a13b-824f-48fa-8f5e-1ceba64d7562 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:42.817109 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cc12a13b-824f-48fa-8f5e-1ceba64d7562 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:42.817815 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cc12a13b-824f-48fa-8f5e-1ceba64d7562 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:42.818273 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cc12a13b-824f-48fa-8f5e-1ceba64d7562 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:42.818736 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-cc12a13b-824f-48fa-8f5e-1ceba64d7562 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:42.954176 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-cc12a13b-824f-48fa-8f5e-1ceba64d7562 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66540366b78f499984ae1071753f1ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831d8741ec214235ab8c35a56345167a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:42.962403 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-cc12a13b-824f-48fa-8f5e-1ceba64d7562 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c" status: 200 len: 1322 microversion: 2.1 time: 0.157974 Aug 22 17:47:42.962983 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1009/2020] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:42 2022] GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:43.984889 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-bc9a5581-73bb-4053-a5e8-107b75699bd8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:43.985701 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-bc9a5581-73bb-4053-a5e8-107b75699bd8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:43.993426 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bc9a5581-73bb-4053-a5e8-107b75699bd8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:43.993927 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bc9a5581-73bb-4053-a5e8-107b75699bd8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:43.994384 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bc9a5581-73bb-4053-a5e8-107b75699bd8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:43.995075 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bc9a5581-73bb-4053-a5e8-107b75699bd8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:43.995522 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bc9a5581-73bb-4053-a5e8-107b75699bd8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:43.995939 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-bc9a5581-73bb-4053-a5e8-107b75699bd8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:44.130705 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-bc9a5581-73bb-4053-a5e8-107b75699bd8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66540366b78f499984ae1071753f1ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831d8741ec214235ab8c35a56345167a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:44.138597 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-bc9a5581-73bb-4053-a5e8-107b75699bd8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c" status: 200 len: 1322 microversion: 2.1 time: 0.158421 Aug 22 17:47:44.139375 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1012/2021] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:43 2022] GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:45.159304 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4e37016d-752c-4224-9900-fc073c88a3af tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:45.159881 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-4e37016d-752c-4224-9900-fc073c88a3af tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:45.166433 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4e37016d-752c-4224-9900-fc073c88a3af tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:45.166912 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4e37016d-752c-4224-9900-fc073c88a3af tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:45.167348 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4e37016d-752c-4224-9900-fc073c88a3af tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:45.168046 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4e37016d-752c-4224-9900-fc073c88a3af tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:45.168499 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4e37016d-752c-4224-9900-fc073c88a3af tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:45.168923 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-4e37016d-752c-4224-9900-fc073c88a3af tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:45.306265 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-4e37016d-752c-4224-9900-fc073c88a3af tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66540366b78f499984ae1071753f1ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831d8741ec214235ab8c35a56345167a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:45.314054 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4e37016d-752c-4224-9900-fc073c88a3af tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c" status: 200 len: 1322 microversion: 2.1 time: 0.158675 Aug 22 17:47:45.314632 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1010/2022] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:45 2022] GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:46.335721 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-53ec6fc7-4c0a-4e46-91ef-786c935d9ba4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:46.336348 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-53ec6fc7-4c0a-4e46-91ef-786c935d9ba4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:46.338755 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:47:46.339427 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=6 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:47:46.344300 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-53ec6fc7-4c0a-4e46-91ef-786c935d9ba4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:46.344784 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-53ec6fc7-4c0a-4e46-91ef-786c935d9ba4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:46.345252 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-53ec6fc7-4c0a-4e46-91ef-786c935d9ba4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:46.354394 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-53ec6fc7-4c0a-4e46-91ef-786c935d9ba4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:46.354394 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-53ec6fc7-4c0a-4e46-91ef-786c935d9ba4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:46.354394 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-53ec6fc7-4c0a-4e46-91ef-786c935d9ba4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:46.478991 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-53ec6fc7-4c0a-4e46-91ef-786c935d9ba4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66540366b78f499984ae1071753f1ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831d8741ec214235ab8c35a56345167a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:46.486753 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-53ec6fc7-4c0a-4e46-91ef-786c935d9ba4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c" status: 200 len: 1322 microversion: 2.1 time: 0.155054 Aug 22 17:47:46.486753 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1013/2023] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:46 2022] GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:47.508901 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-68fe1a3e-6ab7-4529-800c-4905fe55c2fc tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:47.509507 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-68fe1a3e-6ab7-4529-800c-4905fe55c2fc tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:47.511980 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:47:47.516871 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-68fe1a3e-6ab7-4529-800c-4905fe55c2fc tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:47.517431 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-68fe1a3e-6ab7-4529-800c-4905fe55c2fc tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:47.517873 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-68fe1a3e-6ab7-4529-800c-4905fe55c2fc tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:47.523555 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-68fe1a3e-6ab7-4529-800c-4905fe55c2fc tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:47.523555 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-68fe1a3e-6ab7-4529-800c-4905fe55c2fc tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:47.523555 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-68fe1a3e-6ab7-4529-800c-4905fe55c2fc tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:47.671237 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-68fe1a3e-6ab7-4529-800c-4905fe55c2fc tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66540366b78f499984ae1071753f1ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831d8741ec214235ab8c35a56345167a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:47.680434 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-68fe1a3e-6ab7-4529-800c-4905fe55c2fc tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c" status: 200 len: 1322 microversion: 2.1 time: 0.176249 Aug 22 17:47:47.681060 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1011/2024] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:47 2022] GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:48.703704 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c04709d2-cb4a-49cb-b829-487ab7d71542 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:48.704570 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-c04709d2-cb4a-49cb-b829-487ab7d71542 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:48.712004 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c04709d2-cb4a-49cb-b829-487ab7d71542 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:48.712712 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c04709d2-cb4a-49cb-b829-487ab7d71542 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:48.713191 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c04709d2-cb4a-49cb-b829-487ab7d71542 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:48.713907 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c04709d2-cb4a-49cb-b829-487ab7d71542 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:48.714359 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c04709d2-cb4a-49cb-b829-487ab7d71542 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:48.714780 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c04709d2-cb4a-49cb-b829-487ab7d71542 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:48.855518 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-c04709d2-cb4a-49cb-b829-487ab7d71542 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66540366b78f499984ae1071753f1ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831d8741ec214235ab8c35a56345167a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:48.862349 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c04709d2-cb4a-49cb-b829-487ab7d71542 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c" status: 200 len: 1322 microversion: 2.1 time: 0.164465 Aug 22 17:47:48.862946 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1014/2025] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:48 2022] GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:48.971262 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [req-9b88dcf2-df09-47ec-a555-fa4ab69375c0 req-1b588d5c-8e13-4fb3-af13-10235af922d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e248f8-75d7-403a-8192-76e19e80f86c", "name": "network-vif-plugged", "status": "completed", "tag": "46b6507b-cbf4-4517-9278-b48cd5068679"}]} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:47:48.981569 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-9b88dcf2-df09-47ec-a555-fa4ab69375c0 req-1b588d5c-8e13-4fb3-af13-10235af922d6 service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:48.982057 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-9b88dcf2-df09-47ec-a555-fa4ab69375c0 req-1b588d5c-8e13-4fb3-af13-10235af922d6 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:48.982500 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [req-9b88dcf2-df09-47ec-a555-fa4ab69375c0 req-1b588d5c-8e13-4fb3-af13-10235af922d6 service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:48.995370 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.compute.server_external_events [req-9b88dcf2-df09-47ec-a555-fa4ab69375c0 req-1b588d5c-8e13-4fb3-af13-10235af922d6 service nova] Creating event network-vif-plugged:46b6507b-cbf4-4517-9278-b48cd5068679 for instance 11e248f8-75d7-403a-8192-76e19e80f86c on n-h1-854030-1 Aug 22 17:47:49.000465 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [req-9b88dcf2-df09-47ec-a555-fa4ab69375c0 req-1b588d5c-8e13-4fb3-af13-10235af922d6 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100603 Aug 22 17:47:49.001134 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1012/2026] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:47:49.884377 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cf5440e0-3605-4aa1-84cc-3a2c11485e8b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:49.884984 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-cf5440e0-3605-4aa1-84cc-3a2c11485e8b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:49.891649 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cf5440e0-3605-4aa1-84cc-3a2c11485e8b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:49.892556 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cf5440e0-3605-4aa1-84cc-3a2c11485e8b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:49.892556 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cf5440e0-3605-4aa1-84cc-3a2c11485e8b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:49.893269 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cf5440e0-3605-4aa1-84cc-3a2c11485e8b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:49.893721 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cf5440e0-3605-4aa1-84cc-3a2c11485e8b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:49.894144 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-cf5440e0-3605-4aa1-84cc-3a2c11485e8b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:50.029350 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-cf5440e0-3605-4aa1-84cc-3a2c11485e8b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66540366b78f499984ae1071753f1ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831d8741ec214235ab8c35a56345167a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:50.037425 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-cf5440e0-3605-4aa1-84cc-3a2c11485e8b tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c" status: 200 len: 1322 microversion: 2.1 time: 0.157322 Aug 22 17:47:50.038806 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1015/2027] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:49 2022] GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:51.060692 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-858d5d91-6932-4557-a9d3-962923dc06f6 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:51.061423 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-858d5d91-6932-4557-a9d3-962923dc06f6 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:51.067696 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-858d5d91-6932-4557-a9d3-962923dc06f6 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:51.068180 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-858d5d91-6932-4557-a9d3-962923dc06f6 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:51.068626 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-858d5d91-6932-4557-a9d3-962923dc06f6 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:51.070122 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-858d5d91-6932-4557-a9d3-962923dc06f6 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:51.070584 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-858d5d91-6932-4557-a9d3-962923dc06f6 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:51.071021 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-858d5d91-6932-4557-a9d3-962923dc06f6 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:51.214026 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-858d5d91-6932-4557-a9d3-962923dc06f6 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66540366b78f499984ae1071753f1ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831d8741ec214235ab8c35a56345167a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:51.221790 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-858d5d91-6932-4557-a9d3-962923dc06f6 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c" status: 200 len: 1471 microversion: 2.1 time: 0.165861 Aug 22 17:47:51.222365 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1013/2028] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:51 2022] GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:51.299253 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d6fcdbca-f6f1-4a5c-b93c-9395109723aa tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Calling method '.version_select at 0x7f8009059a60>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:51.369756 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d6fcdbca-f6f1-4a5c-b93c-9395109723aa tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/a06bb3e865bf4bf7b0f96842b05c2c37" status: 200 len: 371 microversion: 2.1 time: 0.127523 Aug 22 17:47:51.378514 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1016/2029] 10.222.0.96 () {58 vars in 1242 bytes} [Mon Aug 22 17:47:51 2022] GET /compute/v2.1/os-quota-sets/a06bb3e865bf4bf7b0f96842b05c2c37 => generated 371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:47:51.389538 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b07a6d40-3a71-43c2-a243-3ca5f88349a2 tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1945967205", "id": 227130553, "os-flavor-access:is_public": "True"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:47:51.392777 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:47:51.392777 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:47:51.500075 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b07a6d40-3a71-43c2-a243-3ca5f88349a2 tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.114652 Aug 22 17:47:51.501326 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1014/2030] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:47:51 2022] POST /compute/v2.1/flavors => generated 435 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:47:51.512552 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f83e6ad2-c087-4269-8afa-8caf2d9593bc tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "227130553"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:47:51.514757 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f83e6ad2-c087-4269-8afa-8caf2d9593bc tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:51.521709 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f83e6ad2-c087-4269-8afa-8caf2d9593bc tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:51.522367 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f83e6ad2-c087-4269-8afa-8caf2d9593bc tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:51.522814 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f83e6ad2-c087-4269-8afa-8caf2d9593bc tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:51.523504 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f83e6ad2-c087-4269-8afa-8caf2d9593bc tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:51.523957 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f83e6ad2-c087-4269-8afa-8caf2d9593bc tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:51.524384 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f83e6ad2-c087-4269-8afa-8caf2d9593bc tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-f83e6ad2-c087-4269-8afa-8caf2d9593bc tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f042f441-81ef-458c-bc9a-4e25da0f0df1) Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:47:51.616811 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f042f441-81ef-458c-bc9a-4e25da0f0df1) Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-f83e6ad2-c087-4269-8afa-8caf2d9593bc tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f83e6ad2-c087-4269-8afa-8caf2d9593bc tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Request method failure captured: Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c/action HTTP/1.1 Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 38 Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA8E3Kj5KmxkGxf5PDHfdUO_cmuNn-PO5CYemFn2HaP_PbbmWj3ZL8fbK2IHlWO8px6U8iqqolF4xlkINNiWEIeFuStsD6MofurkgJ2KNhY59cKtLLTpD1LlP6xitfmpORMoiKt2Z6vhQx7aYn91RoYjPuJlsCq_ZH_SYj7d4_Q3nNd0 Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: a06bb3e865bf4bf7b0f96842b05c2c37 Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1937546355 Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-Role: member,reader,admin Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: member,reader,admin Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a06bb3e865bf4bf7b0f96842b05c2c37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_a06bb3e865bf4bf7b0f96842b05c2c37", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a06bb3e865bf4bf7b0f96842b05c2c37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/a06bb3e865bf4bf7b0f96842b05c2c37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1937546355 Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: a06bb3e865bf4bf7b0f96842b05c2c37 Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1937546355 Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersAdminNegativeTestJSON-1937546355-project-admin Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: e14e6f9015db4480bdab8cf0d98fe260 Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1937546355-project-admin Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: {"resize": {"flavorRef": "227130553"}} Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'id': '11e248f8-75d7-403a-8192-76e19e80f86c', 'body': {'resize': {'flavorRef': '227130553'}}} Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 22 17:47:51.621029 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:47:51.625662 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f042f441-81ef-458c-bc9a-4e25da0f0df1) Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f83e6ad2-c087-4269-8afa-8caf2d9593bc tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f83e6ad2-c087-4269-8afa-8caf2d9593bc tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c/action" status: 500 len: 214 microversion: 2.1 time: 0.112252 Aug 22 17:47:51.629661 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1017/2031] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:47:51 2022] POST /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c/action => generated 214 bytes in 113 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:47:51.637048 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a0b7e235-53e8-4fea-900b-88421c234548 tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:51.637945 n-d-854030-1 devstack@n-api.service[123016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:47:51.637945 n-d-854030-1 devstack@n-api.service[123016]: warnings.warn(msg) Aug 22 17:47:51.750873 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a0b7e235-53e8-4fea-900b-88421c234548 tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/227130553" status: 202 len: 0 microversion: 2.1 time: 0.117648 Aug 22 17:47:51.751609 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1015/2032] 10.222.0.96 () {58 vars in 1158 bytes} [Mon Aug 22 17:47:51 2022] DELETE /compute/v2.1/flavors/227130553 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:47:51.759810 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-e869f3a1-7c95-40f8-9a42-bdb700ccc3dd tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:51.780115 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-e869f3a1-7c95-40f8-9a42-bdb700ccc3dd tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024040 Aug 22 17:47:51.780684 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1018/2033] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:47:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:51.802487 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e924c02d-65ff-430f-8a63-8be6229cd9fa tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Calling method '.version_select at 0x7f8009fbdd30>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:51.877006 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e924c02d-65ff-430f-8a63-8be6229cd9fa tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] 10.222.0.96 "GET /compute/v2.1/os-quota-sets/a06bb3e865bf4bf7b0f96842b05c2c37" status: 200 len: 371 microversion: 2.1 time: 0.078289 Aug 22 17:47:51.877624 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1016/2034] 10.222.0.96 () {58 vars in 1242 bytes} [Mon Aug 22 17:47:51 2022] GET /compute/v2.1/os-quota-sets/a06bb3e865bf4bf7b0f96842b05c2c37 => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:47:51.889464 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1800458a-f9ed-43a5-a1d4-2927cea1ec9c tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-115801301", "id": 466364575, "os-flavor-access:is_public": "True"}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:47:51.892260 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:47:51.892260 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:47:51.985061 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1800458a-f9ed-43a5-a1d4-2927cea1ec9c tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.099266 Aug 22 17:47:51.985667 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1019/2035] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:47:51 2022] POST /compute/v2.1/flavors => generated 433 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:47:51.997833 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fd9d8cc9-5c5c-4c23-a72f-ded057d588b1 tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "466364575"}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:47:52.000205 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-fd9d8cc9-5c5c-4c23-a72f-ded057d588b1 tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:52.006177 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fd9d8cc9-5c5c-4c23-a72f-ded057d588b1 tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:52.007589 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fd9d8cc9-5c5c-4c23-a72f-ded057d588b1 tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:52.008084 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fd9d8cc9-5c5c-4c23-a72f-ded057d588b1 tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:52.008785 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fd9d8cc9-5c5c-4c23-a72f-ded057d588b1 tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:52.009293 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fd9d8cc9-5c5c-4c23-a72f-ded057d588b1 tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:52.009716 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fd9d8cc9-5c5c-4c23-a72f-ded057d588b1 tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-fd9d8cc9-5c5c-4c23-a72f-ded057d588b1 tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c220a1a3-0c12-49ec-acdb-e31dfa4adddc) Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:47:52.096258 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c220a1a3-0c12-49ec-acdb-e31dfa4adddc) Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-fd9d8cc9-5c5c-4c23-a72f-ded057d588b1 tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fd9d8cc9-5c5c-4c23-a72f-ded057d588b1 tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Request method failure captured: Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c/action HTTP/1.1 Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 38 Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA8E3Kj5KmxkGxf5PDHfdUO_cmuNn-PO5CYemFn2HaP_PbbmWj3ZL8fbK2IHlWO8px6U8iqqolF4xlkINNiWEIeFuStsD6MofurkgJ2KNhY59cKtLLTpD1LlP6xitfmpORMoiKt2Z6vhQx7aYn91RoYjPuJlsCq_ZH_SYj7d4_Q3nNd0 Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: a06bb3e865bf4bf7b0f96842b05c2c37 Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1937546355 Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-Role: member,reader,admin Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: member,reader,admin Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a06bb3e865bf4bf7b0f96842b05c2c37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_a06bb3e865bf4bf7b0f96842b05c2c37", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a06bb3e865bf4bf7b0f96842b05c2c37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/a06bb3e865bf4bf7b0f96842b05c2c37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1937546355 Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: a06bb3e865bf4bf7b0f96842b05c2c37 Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1937546355 Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServersAdminNegativeTestJSON-1937546355-project-admin Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: e14e6f9015db4480bdab8cf0d98fe260 Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1937546355-project-admin Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: {"resize": {"flavorRef": "466364575"}} Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '11e248f8-75d7-403a-8192-76e19e80f86c', 'body': {'resize': {'flavorRef': '466364575'}}} Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 22 17:47:52.101645 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 368, in inner Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1035, in instance_has_extended_resource_request Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:47:52.106396 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c220a1a3-0c12-49ec-acdb-e31dfa4adddc) Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fd9d8cc9-5c5c-4c23-a72f-ded057d588b1 tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-fd9d8cc9-5c5c-4c23-a72f-ded057d588b1 tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] 10.222.0.96 "POST /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c/action" status: 500 len: 214 microversion: 2.1 time: 0.107488 Aug 22 17:47:52.110577 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1017/2036] 10.222.0.96 () {60 vars in 1278 bytes} [Mon Aug 22 17:47:51 2022] POST /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c/action => generated 214 bytes in 109 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:47:52.112733 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-79a9d935-2016-4dc1-aaf6-d64bd3ba95e9 tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:52.112733 n-d-854030-1 devstack@n-api.service[123015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:47:52.112733 n-d-854030-1 devstack@n-api.service[123015]: warnings.warn(msg) Aug 22 17:47:52.180282 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-79a9d935-2016-4dc1-aaf6-d64bd3ba95e9 tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] 10.222.0.96 "DELETE /compute/v2.1/flavors/466364575" status: 202 len: 0 microversion: 2.1 time: 0.072744 Aug 22 17:47:52.180973 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1020/2037] 10.222.0.96 () {58 vars in 1158 bytes} [Mon Aug 22 17:47:52 2022] DELETE /compute/v2.1/flavors/466364575 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:47:52.188787 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-6cc8902a-7a79-4e9b-a376-c8c4921eda9b tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:52.208702 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-6cc8902a-7a79-4e9b-a376-c8c4921eda9b tempest-ServersAdminNegativeTestJSON-1937546355 tempest-ServersAdminNegativeTestJSON-1937546355-project-admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023551 Aug 22 17:47:52.209330 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1018/2038] 10.222.0.96 () {58 vars in 1146 bytes} [Mon Aug 22 17:47:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:52.234464 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c653aa54-e5bb-49c1-8f30-b89383f581e5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:52.234970 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-c653aa54-e5bb-49c1-8f30-b89383f581e5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:52.241646 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c653aa54-e5bb-49c1-8f30-b89383f581e5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:52.242144 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c653aa54-e5bb-49c1-8f30-b89383f581e5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:52.242584 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c653aa54-e5bb-49c1-8f30-b89383f581e5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:52.243284 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c653aa54-e5bb-49c1-8f30-b89383f581e5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:52.243743 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c653aa54-e5bb-49c1-8f30-b89383f581e5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:52.244167 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-c653aa54-e5bb-49c1-8f30-b89383f581e5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:52.268848 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-c653aa54-e5bb-49c1-8f30-b89383f581e5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Going to try to terminate instance {{(pid=123015) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:47:52.555398 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c653aa54-e5bb-49c1-8f30-b89383f581e5 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "DELETE /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c" status: 204 len: 0 microversion: 2.1 time: 0.324664 Aug 22 17:47:52.556092 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1021/2039] 10.222.0.96 () {58 vars in 1239 bytes} [Mon Aug 22 17:47:52 2022] DELETE /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 17:47:52.564287 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-fb028177-849a-4981-8e5d-444807fe84a0 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:52.565000 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-fb028177-849a-4981-8e5d-444807fe84a0 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:52.571246 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fb028177-849a-4981-8e5d-444807fe84a0 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:52.574435 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fb028177-849a-4981-8e5d-444807fe84a0 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:52.574435 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fb028177-849a-4981-8e5d-444807fe84a0 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:52.574435 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fb028177-849a-4981-8e5d-444807fe84a0 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:52.574435 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fb028177-849a-4981-8e5d-444807fe84a0 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:52.574435 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-fb028177-849a-4981-8e5d-444807fe84a0 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:52.576127 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:47:52.576480 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:47:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:47:52.713799 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-fb028177-849a-4981-8e5d-444807fe84a0 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66540366b78f499984ae1071753f1ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831d8741ec214235ab8c35a56345167a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:52.721779 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-fb028177-849a-4981-8e5d-444807fe84a0 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c" status: 200 len: 1477 microversion: 2.1 time: 0.161355 Aug 22 17:47:52.722584 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1019/2040] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:52 2022] GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c => generated 1477 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:53.744810 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-8faba6fb-44af-4db7-8320-2e5e75c1adc4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:53.745539 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-8faba6fb-44af-4db7-8320-2e5e75c1adc4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:53.752043 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8faba6fb-44af-4db7-8320-2e5e75c1adc4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:53.752524 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8faba6fb-44af-4db7-8320-2e5e75c1adc4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:53.752959 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8faba6fb-44af-4db7-8320-2e5e75c1adc4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:53.753685 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8faba6fb-44af-4db7-8320-2e5e75c1adc4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:53.754137 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8faba6fb-44af-4db7-8320-2e5e75c1adc4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:53.754558 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-8faba6fb-44af-4db7-8320-2e5e75c1adc4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:53.841321 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:47:53.842476 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:47:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:47:53.892476 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-8faba6fb-44af-4db7-8320-2e5e75c1adc4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66540366b78f499984ae1071753f1ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831d8741ec214235ab8c35a56345167a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:53.900711 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-8faba6fb-44af-4db7-8320-2e5e75c1adc4 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c" status: 200 len: 1477 microversion: 2.1 time: 0.160710 Aug 22 17:47:53.901311 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1022/2041] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:53 2022] GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c => generated 1477 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:54.367555 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:47:54.367788 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:47:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:47:54.925185 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-f6372a03-63ee-4329-9fee-84b720dafd57 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:54.926382 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-f6372a03-63ee-4329-9fee-84b720dafd57 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:54.933245 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6372a03-63ee-4329-9fee-84b720dafd57 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:54.933793 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6372a03-63ee-4329-9fee-84b720dafd57 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:54.934229 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6372a03-63ee-4329-9fee-84b720dafd57 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:54.934948 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6372a03-63ee-4329-9fee-84b720dafd57 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:54.935414 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6372a03-63ee-4329-9fee-84b720dafd57 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:54.935854 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-f6372a03-63ee-4329-9fee-84b720dafd57 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:54.989744 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [req-c6d74f66-af4b-4150-a482-ffd8f867efcb req-1fc47e9a-ba71-4c1f-a6a0-eaa7e2068f7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e248f8-75d7-403a-8192-76e19e80f86c", "name": "network-vif-deleted", "tag": "46b6507b-cbf4-4517-9278-b48cd5068679"}]} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:47:55.000926 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-c6d74f66-af4b-4150-a482-ffd8f867efcb req-1fc47e9a-ba71-4c1f-a6a0-eaa7e2068f7f service nova] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:55.001766 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-c6d74f66-af4b-4150-a482-ffd8f867efcb req-1fc47e9a-ba71-4c1f-a6a0-eaa7e2068f7f service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:55.007511 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [req-c6d74f66-af4b-4150-a482-ffd8f867efcb req-1fc47e9a-ba71-4c1f-a6a0-eaa7e2068f7f service nova] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:55.015804 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.compute.server_external_events [req-c6d74f66-af4b-4150-a482-ffd8f867efcb req-1fc47e9a-ba71-4c1f-a6a0-eaa7e2068f7f service nova] Creating event network-vif-deleted:46b6507b-cbf4-4517-9278-b48cd5068679 for instance 11e248f8-75d7-403a-8192-76e19e80f86c on n-h1-854030-1 Aug 22 17:47:55.022470 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [req-c6d74f66-af4b-4150-a482-ffd8f867efcb req-1fc47e9a-ba71-4c1f-a6a0-eaa7e2068f7f service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036360 Aug 22 17:47:55.023856 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1023/2042] 10.222.0.96 () {64 vars in 1317 bytes} [Mon Aug 22 17:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:47:55.032550 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.policy [None req-f6372a03-63ee-4329-9fee-84b720dafd57 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66540366b78f499984ae1071753f1ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831d8741ec214235ab8c35a56345167a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123016) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:55.043557 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-f6372a03-63ee-4329-9fee-84b720dafd57 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c" status: 200 len: 1435 microversion: 2.1 time: 0.123985 Aug 22 17:47:55.044215 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1020/2043] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:54 2022] GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c => generated 1435 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:56.069067 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-f693fe0d-d76b-42ee-af07-718997a8e68a tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Calling method '>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:56.069804 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.compute.api [None req-f693fe0d-d76b-42ee-af07-718997a8e68a tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123015) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:56.076540 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f693fe0d-d76b-42ee-af07-718997a8e68a tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:56.077026 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f693fe0d-d76b-42ee-af07-718997a8e68a tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:56.077499 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f693fe0d-d76b-42ee-af07-718997a8e68a tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:56.078228 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f693fe0d-d76b-42ee-af07-718997a8e68a tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:56.078685 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f693fe0d-d76b-42ee-af07-718997a8e68a tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:56.079108 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f693fe0d-d76b-42ee-af07-718997a8e68a tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:56.120921 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f693fe0d-d76b-42ee-af07-718997a8e68a tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:56.121453 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f693fe0d-d76b-42ee-af07-718997a8e68a tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:56.121892 n-d-854030-1 devstack@n-api.service[123015]: DEBUG oslo_concurrency.lockutils [None req-f693fe0d-d76b-42ee-af07-718997a8e68a tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:56.122357 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.objects.instance [None req-f693fe0d-d76b-42ee-af07-718997a8e68a tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lazy-loading 'fault' on Instance uuid 11e248f8-75d7-403a-8192-76e19e80f86c {{(pid=123015) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:47:56.170379 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.policy [None req-f693fe0d-d76b-42ee-af07-718997a8e68a tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66540366b78f499984ae1071753f1ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '831d8741ec214235ab8c35a56345167a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123015) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:56.177858 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-f693fe0d-d76b-42ee-af07-718997a8e68a tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c" status: 200 len: 1312 microversion: 2.1 time: 0.113531 Aug 22 17:47:56.178364 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1024/2044] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:56 2022] GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:57.200828 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a87811de-3d34-4aa1-8cdc-f18ae5b341a8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Calling method '>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:57.201469 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.compute.api [None req-a87811de-3d34-4aa1-8cdc-f18ae5b341a8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] [instance: 11e248f8-75d7-403a-8192-76e19e80f86c] Fetching instance by UUID {{(pid=123016) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:57.208078 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a87811de-3d34-4aa1-8cdc-f18ae5b341a8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:57.208572 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a87811de-3d34-4aa1-8cdc-f18ae5b341a8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:57.209008 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a87811de-3d34-4aa1-8cdc-f18ae5b341a8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:57.209753 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a87811de-3d34-4aa1-8cdc-f18ae5b341a8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Acquiring lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:57.210207 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a87811de-3d34-4aa1-8cdc-f18ae5b341a8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:57.210632 n-d-854030-1 devstack@n-api.service[123016]: DEBUG oslo_concurrency.lockutils [None req-a87811de-3d34-4aa1-8cdc-f18ae5b341a8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Lock "0e788ee0-d5b8-44d6-b202-c201e1b338b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:57.225345 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-a87811de-3d34-4aa1-8cdc-f18ae5b341a8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] HTTP exception thrown: Instance 11e248f8-75d7-403a-8192-76e19e80f86c could not be found. Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a87811de-3d34-4aa1-8cdc-f18ae5b341a8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Request method failure captured: Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: request: GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c HTTP/1.1 Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 0 Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA8E2i4JxONsug3MH7ZiyNlCprLPI5iCxujP-7Q0tv9C73kIy5J8A6iDR1vWri_ptuZSsd3nV51Ivb46Q6f7nGpY1c4ncHAO9JOZcyDY1VX0VCVKT37Y2V5DuaDqtAImJ2bMDDo6DHdq11qOGsH6jzugTL2OfVGxlpNrtih2zm53fORA Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 831d8741ec214235ab8c35a56345167a Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1777646265 Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/831d8741ec214235ab8c35a56345167a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_831d8741ec214235ab8c35a56345167a", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/831d8741ec214235ab8c35a56345167a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/831d8741ec214235ab8c35a56345167a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1777646265 Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 831d8741ec214235ab8c35a56345167a Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1777646265 Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServersAdminNegativeTestJSON-1777646265-project Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 66540366b78f499984ae1071753f1ccc Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1777646265-project Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: exception: Instance 11e248f8-75d7-403a-8192-76e19e80f86c could not be found. Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'id': '11e248f8-75d7-403a-8192-76e19e80f86c'} Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e248f8-75d7-403a-8192-76e19e80f86c could not be found. Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e248f8-75d7-403a-8192-76e19e80f86c could not be found. Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:47:57.227166 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:57.231727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:47:57.231727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:57.231727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:47:57.231727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:47:57.231727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:47:57.231727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:47:57.231727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e248f8-75d7-403a-8192-76e19e80f86c could not be found. Aug 22 17:47:57.231727 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:47:57.231727 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a87811de-3d34-4aa1-8cdc-f18ae5b341a8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] Returning 404 to user: Instance 11e248f8-75d7-403a-8192-76e19e80f86c could not be found. {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:47:57.231727 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a87811de-3d34-4aa1-8cdc-f18ae5b341a8 tempest-ServersAdminNegativeTestJSON-1777646265 tempest-ServersAdminNegativeTestJSON-1777646265-project] 10.222.0.96 "GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c" status: 404 len: 111 microversion: 2.1 time: 0.031877 Aug 22 17:47:57.231727 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1021/2045] 10.222.0.96 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:57 2022] GET /compute/v2.1/servers/11e248f8-75d7-403a-8192-76e19e80f86c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:48:05.975463 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:48:06.090957 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-73d5889b-93c1-4505-8f72-d12685bce077 tempest-DeleteServersTestJSON-1122198372 tempest-DeleteServersTestJSON-1122198372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1876801276", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "53449ce1-8091-42c6-969e-f0fd93ee7b2a"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:48:06.098989 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:48:06.145177 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-73d5889b-93c1-4505-8f72-d12685bce077 tempest-DeleteServersTestJSON-1122198372 tempest-DeleteServersTestJSON-1122198372-project] validate_networks() for [('53449ce1-8091-42c6-969e-f0fd93ee7b2a', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:48:06.174412 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-73d5889b-93c1-4505-8f72-d12685bce077 tempest-DeleteServersTestJSON-1122198372 tempest-DeleteServersTestJSON-1122198372-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-907b0f32-7638-455d-bfaa-0e5dbe45432b) Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:48:06.347751 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-907b0f32-7638-455d-bfaa-0e5dbe45432b) Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-73d5889b-93c1-4505-8f72-d12685bce077 tempest-DeleteServersTestJSON-1122198372 tempest-DeleteServersTestJSON-1122198372-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-73d5889b-93c1-4505-8f72-d12685bce077 tempest-DeleteServersTestJSON-1122198372 tempest-DeleteServersTestJSON-1122198372-project] Request method failure captured: Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 207 Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA8FV9-Op1CUVioRKNW653jD0FZjUWDyEGJ44TAOOk3OMc1HU9UGlTneUDnNouU-0mL4X07usF28aE_CadSsJ8fvP_fYIM-qBze4oq-j2Cdh8iMBkh_h0njfjMcSKSXuVNhgsW4iyA0V6jKsiyCv5EFh-QTYOaLSTP2Fnaxth-2ZE4C0 Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 759241734aee4caea9546885fdfca007 Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-DeleteServersTestJSON-1122198372 Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/759241734aee4caea9546885fdfca007"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_759241734aee4caea9546885fdfca007", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/759241734aee4caea9546885fdfca007"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/759241734aee4caea9546885fdfca007"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-DeleteServersTestJSON-1122198372 Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 759241734aee4caea9546885fdfca007 Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-DeleteServersTestJSON-1122198372 Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-DeleteServersTestJSON-1122198372-project Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 1e37000894024a509011f856d67703b5 Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-DeleteServersTestJSON-1122198372-project Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-DeleteServersTestJSON-server-1876801276", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "53449ce1-8091-42c6-969e-f0fd93ee7b2a"}]}} Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-1876801276', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '53449ce1-8091-42c6-969e-f0fd93ee7b2a'}]}}} Aug 22 17:48:06.353652 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:48:06.361537 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-907b0f32-7638-455d-bfaa-0e5dbe45432b) Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-73d5889b-93c1-4505-8f72-d12685bce077 tempest-DeleteServersTestJSON-1122198372 tempest-DeleteServersTestJSON-1122198372-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-73d5889b-93c1-4505-8f72-d12685bce077 tempest-DeleteServersTestJSON-1122198372 tempest-DeleteServersTestJSON-1122198372-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.382626 Aug 22 17:48:06.365341 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1025/2046] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:48:05 2022] POST /compute/v2.1/servers => generated 214 bytes in 384 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:48:18.095566 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:48:18.096388 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:48:18.097013 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell1:SELECT=52 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:48:18.219898 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-88f1a90a-f613-4fd4-98c7-4d087fb14e1f tempest-ServerDiskConfigTestJSON-1699135407 tempest-ServerDiskConfigTestJSON-1699135407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2133395049", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "7bc46ebe-7c6d-4593-832a-f5ab864ee661"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:48:18.275191 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-88f1a90a-f613-4fd4-98c7-4d087fb14e1f tempest-ServerDiskConfigTestJSON-1699135407 tempest-ServerDiskConfigTestJSON-1699135407-project] validate_networks() for [('7bc46ebe-7c6d-4593-832a-f5ab864ee661', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-88f1a90a-f613-4fd4-98c7-4d087fb14e1f tempest-ServerDiskConfigTestJSON-1699135407 tempest-ServerDiskConfigTestJSON-1699135407-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-95d16928-eff3-4be9-9364-d6586e4d9e51) Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:48:18.496700 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-95d16928-eff3-4be9-9364-d6586e4d9e51) Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-88f1a90a-f613-4fd4-98c7-4d087fb14e1f tempest-ServerDiskConfigTestJSON-1699135407 tempest-ServerDiskConfigTestJSON-1699135407-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-88f1a90a-f613-4fd4-98c7-4d087fb14e1f tempest-ServerDiskConfigTestJSON-1699135407 tempest-ServerDiskConfigTestJSON-1699135407-project] Request method failure captured: Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 210 Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA8FhtNMT4T4YRaauw0Bg71uPyMWtMhfr7ZCcbidqZ5VGr_NMAYSi0eBecKrnb3CPQi3W8O_hXN0UXRUlYjvRjcpGHKUf1alW8_z0V4pQCeGxc1agUwwJbMfwfomE6_kFVoEwGdqPDMSmol3EeIhEC9B9n_4LlPTrBSLreglwoF0rL5k Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 6e69e18b597b43eba4763e14ca201334 Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1699135407 Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/6e69e18b597b43eba4763e14ca201334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_6e69e18b597b43eba4763e14ca201334", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/6e69e18b597b43eba4763e14ca201334"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/6e69e18b597b43eba4763e14ca201334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-ServerDiskConfigTestJSON-1699135407 Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 6e69e18b597b43eba4763e14ca201334 Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1699135407 Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-ServerDiskConfigTestJSON-1699135407-project Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: f5a988c194c347e5b368cae7195f2f92 Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-ServerDiskConfigTestJSON-1699135407-project Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2133395049", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "7bc46ebe-7c6d-4593-832a-f5ab864ee661"}]}} Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:48:18.507614 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-2133395049', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '7bc46ebe-7c6d-4593-832a-f5ab864ee661'}]}}} Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:48:18.514339 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-95d16928-eff3-4be9-9364-d6586e4d9e51) Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-88f1a90a-f613-4fd4-98c7-4d087fb14e1f tempest-ServerDiskConfigTestJSON-1699135407 tempest-ServerDiskConfigTestJSON-1699135407-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-88f1a90a-f613-4fd4-98c7-4d087fb14e1f tempest-ServerDiskConfigTestJSON-1699135407 tempest-ServerDiskConfigTestJSON-1699135407-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.410174 Aug 22 17:48:18.518698 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1022/2047] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:48:18 2022] POST /compute/v2.1/servers => generated 214 bytes in 411 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:48:18.560417 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:48:18.565326 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d6f27305-9e61-498d-a068-19259838b71a tempest-ServerDiskConfigTestJSON-1699135407 tempest-ServerDiskConfigTestJSON-1699135407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1109876726", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "7bc46ebe-7c6d-4593-832a-f5ab864ee661"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:48:18.620619 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-d6f27305-9e61-498d-a068-19259838b71a tempest-ServerDiskConfigTestJSON-1699135407 tempest-ServerDiskConfigTestJSON-1699135407-project] validate_networks() for [('7bc46ebe-7c6d-4593-832a-f5ab864ee661', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-d6f27305-9e61-498d-a068-19259838b71a tempest-ServerDiskConfigTestJSON-1699135407 tempest-ServerDiskConfigTestJSON-1699135407-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-23379cb9-ccfe-45ac-81e3-9748681c1a6e) Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:48:18.848740 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-23379cb9-ccfe-45ac-81e3-9748681c1a6e) Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-d6f27305-9e61-498d-a068-19259838b71a tempest-ServerDiskConfigTestJSON-1699135407 tempest-ServerDiskConfigTestJSON-1699135407-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d6f27305-9e61-498d-a068-19259838b71a tempest-ServerDiskConfigTestJSON-1699135407 tempest-ServerDiskConfigTestJSON-1699135407-project] Request method failure captured: Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 210 Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA8FhtNMT4T4YRaauw0Bg71uPyMWtMhfr7ZCcbidqZ5VGr_NMAYSi0eBecKrnb3CPQi3W8O_hXN0UXRUlYjvRjcpGHKUf1alW8_z0V4pQCeGxc1agUwwJbMfwfomE6_kFVoEwGdqPDMSmol3EeIhEC9B9n_4LlPTrBSLreglwoF0rL5k Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 6e69e18b597b43eba4763e14ca201334 Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1699135407 Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/6e69e18b597b43eba4763e14ca201334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_6e69e18b597b43eba4763e14ca201334", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/6e69e18b597b43eba4763e14ca201334"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/6e69e18b597b43eba4763e14ca201334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServerDiskConfigTestJSON-1699135407 Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 6e69e18b597b43eba4763e14ca201334 Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1699135407 Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServerDiskConfigTestJSON-1699135407-project Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: f5a988c194c347e5b368cae7195f2f92 Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServerDiskConfigTestJSON-1699135407-project Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1109876726", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "7bc46ebe-7c6d-4593-832a-f5ab864ee661"}]}} Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:48:18.853802 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-1109876726', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '7bc46ebe-7c6d-4593-832a-f5ab864ee661'}]}}} Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:48:18.858637 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-23379cb9-ccfe-45ac-81e3-9748681c1a6e) Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d6f27305-9e61-498d-a068-19259838b71a tempest-ServerDiskConfigTestJSON-1699135407 tempest-ServerDiskConfigTestJSON-1699135407-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d6f27305-9e61-498d-a068-19259838b71a tempest-ServerDiskConfigTestJSON-1699135407 tempest-ServerDiskConfigTestJSON-1699135407-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.296107 Aug 22 17:48:18.862973 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1026/2048] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:48:18 2022] POST /compute/v2.1/servers => generated 214 bytes in 297 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 22 17:48:29.619219 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:48:29.748730 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-42e340cf-96f4-4d93-9f33-c0227ed5ded8 tempest-ServerActionsTestJSON-709065398 tempest-ServerActionsTestJSON-709065398-project] Action: 'create', calling method: .version_select at 0x7f8009775dc0>, body: {"keypair": {"name": "tempest-keypair-1560020951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7enud8/i1NAYPDvtvrdTKcI0VYtojFAStPLaOnI9dWa1BZp7WQLKTdqb8YiHdfGVwjrJzFXrlcPA6RMNm1we/mKxfioL1e0HXWnBZFNdCikEpctSa+VcSMe8WjRytPcw=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:48:29.766753 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-42e340cf-96f4-4d93-9f33-c0227ed5ded8 tempest-ServerActionsTestJSON-709065398 tempest-ServerActionsTestJSON-709065398-project] Getting quotas for project 221b68158e5d4cb5a482a2e30d002812. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:48:29.772168 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-42e340cf-96f4-4d93-9f33-c0227ed5ded8 tempest-ServerActionsTestJSON-709065398 tempest-ServerActionsTestJSON-709065398-project] Getting quotas for user 7012559fbba042979a3706421d56a519 and project 221b68158e5d4cb5a482a2e30d002812. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:48:29.861958 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-42e340cf-96f4-4d93-9f33-c0227ed5ded8 tempest-ServerActionsTestJSON-709065398 tempest-ServerActionsTestJSON-709065398-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.244656 Aug 22 17:48:29.864923 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1023/2049] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:48:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:48:32.244975 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9719e570-a60f-4658-8055-4a17955ce74d tempest-ServerActionsTestJSON-709065398 tempest-ServerActionsTestJSON-709065398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-800754155", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab616d54-af1d-43ef-bc3b-71d375c143c1"}], "security_groups": [{"name": "tempest-securitygroup--1372811775"}], "key_name": "tempest-keypair-1560020951", "user_data": "}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:48:32.253990 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:48:32.376585 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-9719e570-a60f-4658-8055-4a17955ce74d tempest-ServerActionsTestJSON-709065398 tempest-ServerActionsTestJSON-709065398-project] validate_networks() for [('ab616d54-af1d-43ef-bc3b-71d375c143c1', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-9719e570-a60f-4658-8055-4a17955ce74d tempest-ServerActionsTestJSON-709065398 tempest-ServerActionsTestJSON-709065398-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5d473fc0-e205-41cf-abb9-69363a078cfb) Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:48:32.668981 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5d473fc0-e205-41cf-abb9-69363a078cfb) Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-9719e570-a60f-4658-8055-4a17955ce74d tempest-ServerActionsTestJSON-709065398 tempest-ServerActionsTestJSON-709065398-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9719e570-a60f-4658-8055-4a17955ce74d tempest-ServerActionsTestJSON-709065398 tempest-ServerActionsTestJSON-709065398-project] Request method failure captured: Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 493 Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA8FtVOsjyPrR03zERoZ6saSt1ybCvlKGgsONSJsfur0XuQZgTQlETSkF7xdLDl-mxPf-erzmhrsv6SPCrsRyrm3LOGcjjKTWnmyvLUBqAGFkGhyQ92yWWa3hopyjolhSJ2S6sxct3eDXe18XKSC5QYdHnsxFWSh91WYYwLPd4MKqfrg Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 221b68158e5d4cb5a482a2e30d002812 Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServerActionsTestJSON-709065398 Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/221b68158e5d4cb5a482a2e30d002812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_221b68158e5d4cb5a482a2e30d002812", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/221b68158e5d4cb5a482a2e30d002812"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/221b68158e5d4cb5a482a2e30d002812"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServerActionsTestJSON-709065398 Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 221b68158e5d4cb5a482a2e30d002812 Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServerActionsTestJSON-709065398 Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServerActionsTestJSON-709065398-project Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 7012559fbba042979a3706421d56a519 Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServerActionsTestJSON-709065398-project Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ServerActionsTestJSON-server-800754155", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "adminPass": "W9^+I9R=Pe=Bf!q", "networks": [{"uuid": "ab616d54-af1d-43ef-bc3b-71d375c143c1"}], "security_groups": [{"name": "tempest-securitygroup--1372811775"}], "key_name": "tempest-keypair-1560020951", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:32.672902 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ServerActionsTestJSON-server-800754155', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'adminPass': 'W9^+I9R=Pe=Bf!q', 'networks': [{'uuid': 'ab616d54-af1d-43ef-bc3b-71d375c143c1'}], 'security_groups': [{'name': 'tempest-securitygroup--1372811775'}], 'key_name': 'tempest-keypair-1560020951', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:48:32.685105 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5d473fc0-e205-41cf-abb9-69363a078cfb) Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-9719e570-a60f-4658-8055-4a17955ce74d tempest-ServerActionsTestJSON-709065398 tempest-ServerActionsTestJSON-709065398-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-9719e570-a60f-4658-8055-4a17955ce74d tempest-ServerActionsTestJSON-709065398 tempest-ServerActionsTestJSON-709065398-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.435395 Aug 22 17:48:32.689824 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1027/2050] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:48:32 2022] POST /compute/v2.1/servers => generated 214 bytes in 439 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:48:32.694178 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-38fe6a00-a62e-4203-841e-1092b6e2cfe6 tempest-ServerActionsTestJSON-709065398 tempest-ServerActionsTestJSON-709065398-project] Calling method '.version_select at 0x7f8009775c10>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:48:32.785648 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-38fe6a00-a62e-4203-841e-1092b6e2cfe6 tempest-ServerActionsTestJSON-709065398 tempest-ServerActionsTestJSON-709065398-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1560020951" status: 202 len: 0 microversion: 2.1 time: 0.105208 Aug 22 17:48:32.789380 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1024/2051] 10.222.0.96 () {58 vars in 1221 bytes} [Mon Aug 22 17:48:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1560020951 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:48:44.726455 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:48:44.904899 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-41467efd-ef73-40bc-9cbe-00423a07d722 tempest-ServersNegativeTestJSON-258053525 tempest-ServersNegativeTestJSON-258053525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-370936261", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "26f51d7f-515b-4583-811e-f7ac665e06e4"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:48:44.960565 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-41467efd-ef73-40bc-9cbe-00423a07d722 tempest-ServersNegativeTestJSON-258053525 tempest-ServersNegativeTestJSON-258053525-project] validate_networks() for [('26f51d7f-515b-4583-811e-f7ac665e06e4', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-41467efd-ef73-40bc-9cbe-00423a07d722 tempest-ServersNegativeTestJSON-258053525 tempest-ServersNegativeTestJSON-258053525-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-87ee0046-9e2d-4824-8969-fc78743e66cc) Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:48:45.174486 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-87ee0046-9e2d-4824-8969-fc78743e66cc) Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-41467efd-ef73-40bc-9cbe-00423a07d722 tempest-ServersNegativeTestJSON-258053525 tempest-ServersNegativeTestJSON-258053525-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-41467efd-ef73-40bc-9cbe-00423a07d722 tempest-ServersNegativeTestJSON-258053525 tempest-ServersNegativeTestJSON-258053525-project] Request method failure captured: Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 208 Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA8F85zzDEuIB7t7UYrWrxhBs24VIwJ-9pzX_Fzo86Z2Q3ac6lZ0xumvj-OZd6u8osS924sTsyaTLR3Mm2XQ0yx18qC3bALLTWOmwMpYHDeu6xBNvdTIp6U9qsgw5zCLJ0DQkZWP-1ggwq5vRXAC91712wMSIeLpWZZWFKRisctw4Rfw Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 012e44f0518e4bdca8916f9b084d886e Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-ServersNegativeTestJSON-258053525 Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/012e44f0518e4bdca8916f9b084d886e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_012e44f0518e4bdca8916f9b084d886e", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/012e44f0518e4bdca8916f9b084d886e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/012e44f0518e4bdca8916f9b084d886e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-ServersNegativeTestJSON-258053525 Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 012e44f0518e4bdca8916f9b084d886e Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-ServersNegativeTestJSON-258053525 Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-ServersNegativeTestJSON-258053525-project Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: c9a616d5ee654988963793ca409dbb1f Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-ServersNegativeTestJSON-258053525-project Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-370936261", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "26f51d7f-515b-4583-811e-f7ac665e06e4"}]}} Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-370936261', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '26f51d7f-515b-4583-811e-f7ac665e06e4'}]}}} Aug 22 17:48:45.179170 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:48:45.184504 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-87ee0046-9e2d-4824-8969-fc78743e66cc) Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-41467efd-ef73-40bc-9cbe-00423a07d722 tempest-ServersNegativeTestJSON-258053525 tempest-ServersNegativeTestJSON-258053525-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-41467efd-ef73-40bc-9cbe-00423a07d722 tempest-ServersNegativeTestJSON-258053525 tempest-ServersNegativeTestJSON-258053525-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.455261 Aug 22 17:48:45.195092 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1028/2052] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:48:44 2022] POST /compute/v2.1/servers => generated 214 bytes in 456 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:49:32.693403 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:32.694182 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:32.922836 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a1097649-214b-409f-841a-60254beda75f tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Action: 'create', calling method: .version_select at 0x7f80093a0700>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1606028854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrrLrjUHExWISRev3U0XoTtG72Q7LjVD2vEpQR18b47ehzn8CbW795PO7DSmTzLaNsj7hQa/T5xvNifE45EuE2/382Ad1ekFC4x7xFiTCzEoDCFxwg6arkNY6rS0yh5MA=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:49:32.941268 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-a1097649-214b-409f-841a-60254beda75f tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Getting quotas for project a1686a86d1a743a59a2cca88845b9a51. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:49:32.946506 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-a1097649-214b-409f-841a-60254beda75f tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Getting quotas for user 525ed235b6b6426db9a521248755b0fd and project a1686a86d1a743a59a2cca88845b9a51. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:49:33.035783 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a1097649-214b-409f-841a-60254beda75f tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.344427 Aug 22 17:49:33.036510 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1025/2053] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:49:32 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:49:33.088203 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=2 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:33.092772 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c54bd253-2378-4fbd-9551-85276aa386e2 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2063862996", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1606028854", "networks": [{"uuid": "a7f072bb-a83a-45b7-be65-4a2007508711"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:49:33.147330 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-c54bd253-2378-4fbd-9551-85276aa386e2 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] validate_networks() for [('a7f072bb-a83a-45b7-be65-4a2007508711', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-c54bd253-2378-4fbd-9551-85276aa386e2 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1a3abdca-6fd3-4743-ae98-89a367b6d8fc) Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:49:33.362052 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1a3abdca-6fd3-4743-ae98-89a367b6d8fc) Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-c54bd253-2378-4fbd-9551-85276aa386e2 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c54bd253-2378-4fbd-9551-85276aa386e2 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Request method failure captured: Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 273 Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA8GlcXvq_BzKVuznbWewrzB4U3cmDL1sPsnjLsw7aUExmOXgyTDu-Ks6AHUyn0d5Vvo_Z1CBagZlTsyhlbQc4rhkNSyzr5jduTRMocjq8gO-UyK951-zfFlq3KluGonMsQWnyu0j8AnKSgpUCJOU7Mcw0pAVFPrRojoodeQAPdL8sxA Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: a1686a86d1a743a59a2cca88845b9a51 Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-TestEncryptedCinderVolumes-339501940 Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a1686a86d1a743a59a2cca88845b9a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_a1686a86d1a743a59a2cca88845b9a51", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a1686a86d1a743a59a2cca88845b9a51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/a1686a86d1a743a59a2cca88845b9a51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-TestEncryptedCinderVolumes-339501940 Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: a1686a86d1a743a59a2cca88845b9a51 Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-339501940 Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-TestEncryptedCinderVolumes-339501940-project Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 525ed235b6b6426db9a521248755b0fd Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-TestEncryptedCinderVolumes-339501940-project Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2063862996", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1606028854", "networks": [{"uuid": "a7f072bb-a83a-45b7-be65-4a2007508711"}]}} Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:49:33.366485 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-TestEncryptedCinderVolumes-server-2063862996', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'key_name': 'tempest-TestEncryptedCinderVolumes-1606028854', 'networks': [{'uuid': 'a7f072bb-a83a-45b7-be65-4a2007508711'}]}}} Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:49:33.371210 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1a3abdca-6fd3-4743-ae98-89a367b6d8fc) Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c54bd253-2378-4fbd-9551-85276aa386e2 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c54bd253-2378-4fbd-9551-85276aa386e2 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.279465 Aug 22 17:49:33.375508 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1029/2054] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:49:33 2022] POST /compute/v2.1/servers => generated 214 bytes in 282 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 22 17:49:33.388066 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-28182a66-75b2-4484-a4ea-f5bd270dba62 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Calling method '.version_select at 0x7f80093a0dc0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:33.462747 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-28182a66-75b2-4484-a4ea-f5bd270dba62 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1606028854" status: 202 len: 0 microversion: 2.1 time: 0.078923 Aug 22 17:49:33.463360 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1026/2055] 10.222.0.96 () {58 vars in 1278 bytes} [Mon Aug 22 17:49:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1606028854 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:49:33.477496 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b24b0205-5ab2-43cc-93d2-8083f486824d tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Action: 'create', calling method: .version_select at 0x7f8008fa7dc0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1676697438", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGu22Q+ObZVTXlTCZCjEHsIjLL5FzIj25KmY1LXfLidxvdnjf3IDeqsFZL2ui5lJcBEUjsfZoG6iLV/l+ZtGTNkQjVbRy67iMn5QE/5nRt8UDz6eRu2NR/MPmHHwpr3GGA=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:49:33.495860 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-b24b0205-5ab2-43cc-93d2-8083f486824d tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Getting quotas for project a1686a86d1a743a59a2cca88845b9a51. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:49:33.501999 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-b24b0205-5ab2-43cc-93d2-8083f486824d tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Getting quotas for user 525ed235b6b6426db9a521248755b0fd and project a1686a86d1a743a59a2cca88845b9a51. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:49:33.595325 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b24b0205-5ab2-43cc-93d2-8083f486824d tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.121995 Aug 22 17:49:33.595922 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1030/2056] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:49:33 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:49:33.648361 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5320cca6-9be5-4b35-bbe3-e5ab23c383e9 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1169709670", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1676697438", "networks": [{"uuid": "a7f072bb-a83a-45b7-be65-4a2007508711"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:49:33.717931 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-5320cca6-9be5-4b35-bbe3-e5ab23c383e9 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] validate_networks() for [('a7f072bb-a83a-45b7-be65-4a2007508711', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-5320cca6-9be5-4b35-bbe3-e5ab23c383e9 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2cac9bca-4166-449f-b44e-10ad8b366625) Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:49:33.933562 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2cac9bca-4166-449f-b44e-10ad8b366625) Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-5320cca6-9be5-4b35-bbe3-e5ab23c383e9 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5320cca6-9be5-4b35-bbe3-e5ab23c383e9 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Request method failure captured: Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 273 Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA8GlcXvq_BzKVuznbWewrzB4U3cmDL1sPsnjLsw7aUExmOXgyTDu-Ks6AHUyn0d5Vvo_Z1CBagZlTsyhlbQc4rhkNSyzr5jduTRMocjq8gO-UyK951-zfFlq3KluGonMsQWnyu0j8AnKSgpUCJOU7Mcw0pAVFPrRojoodeQAPdL8sxA Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: a1686a86d1a743a59a2cca88845b9a51 Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-TestEncryptedCinderVolumes-339501940 Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a1686a86d1a743a59a2cca88845b9a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_a1686a86d1a743a59a2cca88845b9a51", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a1686a86d1a743a59a2cca88845b9a51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/a1686a86d1a743a59a2cca88845b9a51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-TestEncryptedCinderVolumes-339501940 Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: a1686a86d1a743a59a2cca88845b9a51 Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-339501940 Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-TestEncryptedCinderVolumes-339501940-project Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 525ed235b6b6426db9a521248755b0fd Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-TestEncryptedCinderVolumes-339501940-project Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1169709670", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1676697438", "networks": [{"uuid": "a7f072bb-a83a-45b7-be65-4a2007508711"}]}} Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:49:33.938357 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-TestEncryptedCinderVolumes-server-1169709670', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'key_name': 'tempest-TestEncryptedCinderVolumes-1676697438', 'networks': [{'uuid': 'a7f072bb-a83a-45b7-be65-4a2007508711'}]}}} Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:49:33.946519 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2cac9bca-4166-449f-b44e-10ad8b366625) Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-5320cca6-9be5-4b35-bbe3-e5ab23c383e9 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-5320cca6-9be5-4b35-bbe3-e5ab23c383e9 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.294582 Aug 22 17:49:33.950779 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1027/2057] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:49:33 2022] POST /compute/v2.1/servers => generated 214 bytes in 296 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:49:33.961939 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-48926863-3556-4c11-a921-081a44780e78 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Calling method '.version_select at 0x7f8008fa7c10>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:34.057370 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-48926863-3556-4c11-a921-081a44780e78 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1676697438" status: 202 len: 0 microversion: 2.1 time: 0.101542 Aug 22 17:49:34.057951 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1031/2058] 10.222.0.96 () {58 vars in 1278 bytes} [Mon Aug 22 17:49:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1676697438 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:49:34.072111 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1eaed899-b1d2-4cb1-9ec3-6a4a36af3390 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Action: 'create', calling method: .version_select at 0x7f80094af430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1374884914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFn6IZPi/I8o6lYuPpb1ayXCJOlYnRY+iOQ0GU366/+tn6iziikfaoKWXyW2owkossCf6GVSzJ3lxP0Aed39vt9se6ExrLUPAHcfqnK49LSW81j8KCqbOCwvjHS+ZitMbg=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:49:34.099698 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-1eaed899-b1d2-4cb1-9ec3-6a4a36af3390 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Getting quotas for project a1686a86d1a743a59a2cca88845b9a51. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:49:34.099698 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-1eaed899-b1d2-4cb1-9ec3-6a4a36af3390 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Getting quotas for user 525ed235b6b6426db9a521248755b0fd and project a1686a86d1a743a59a2cca88845b9a51. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:49:34.189543 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1eaed899-b1d2-4cb1-9ec3-6a4a36af3390 tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.121439 Aug 22 17:49:34.190163 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1028/2059] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:49:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:49:34.251328 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0c0126bb-dd56-4a87-9f2f-3d29afe17c4e tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1387967118", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1374884914", "networks": [{"uuid": "a7f072bb-a83a-45b7-be65-4a2007508711"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:49:34.304246 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-0c0126bb-dd56-4a87-9f2f-3d29afe17c4e tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] validate_networks() for [('a7f072bb-a83a-45b7-be65-4a2007508711', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-0c0126bb-dd56-4a87-9f2f-3d29afe17c4e tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-05965c80-96f6-4ff6-b668-44ec8ae3eea8) Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:49:34.548015 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-05965c80-96f6-4ff6-b668-44ec8ae3eea8) Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-0c0126bb-dd56-4a87-9f2f-3d29afe17c4e tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0c0126bb-dd56-4a87-9f2f-3d29afe17c4e tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Request method failure captured: Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 273 Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA8GlcXvq_BzKVuznbWewrzB4U3cmDL1sPsnjLsw7aUExmOXgyTDu-Ks6AHUyn0d5Vvo_Z1CBagZlTsyhlbQc4rhkNSyzr5jduTRMocjq8gO-UyK951-zfFlq3KluGonMsQWnyu0j8AnKSgpUCJOU7Mcw0pAVFPrRojoodeQAPdL8sxA Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: a1686a86d1a743a59a2cca88845b9a51 Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-TestEncryptedCinderVolumes-339501940 Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a1686a86d1a743a59a2cca88845b9a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_a1686a86d1a743a59a2cca88845b9a51", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a1686a86d1a743a59a2cca88845b9a51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/a1686a86d1a743a59a2cca88845b9a51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-TestEncryptedCinderVolumes-339501940 Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: a1686a86d1a743a59a2cca88845b9a51 Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-339501940 Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-TestEncryptedCinderVolumes-339501940-project Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 525ed235b6b6426db9a521248755b0fd Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-TestEncryptedCinderVolumes-339501940-project Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1387967118", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1374884914", "networks": [{"uuid": "a7f072bb-a83a-45b7-be65-4a2007508711"}]}} Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:49:34.552497 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-TestEncryptedCinderVolumes-server-1387967118', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'key_name': 'tempest-TestEncryptedCinderVolumes-1374884914', 'networks': [{'uuid': 'a7f072bb-a83a-45b7-be65-4a2007508711'}]}}} Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:49:34.556841 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-05965c80-96f6-4ff6-b668-44ec8ae3eea8) Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-0c0126bb-dd56-4a87-9f2f-3d29afe17c4e tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-0c0126bb-dd56-4a87-9f2f-3d29afe17c4e tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.306779 Aug 22 17:49:34.566839 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1032/2060] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:49:34 2022] POST /compute/v2.1/servers => generated 214 bytes in 314 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:49:34.572271 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-4352de9e-6ee1-455f-8ef7-1d91f771199c tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] Calling method '.version_select at 0x7f80093a7d30>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:34.645949 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-4352de9e-6ee1-455f-8ef7-1d91f771199c tempest-TestEncryptedCinderVolumes-339501940 tempest-TestEncryptedCinderVolumes-339501940-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1374884914" status: 202 len: 0 microversion: 2.1 time: 0.087819 Aug 22 17:49:34.652087 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1029/2061] 10.222.0.96 () {58 vars in 1278 bytes} [Mon Aug 22 17:49:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1374884914 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:50:08.776134 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:50:08.776904 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:50:08.781521 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-87bf00b0-3ea2-4947-bda1-2cac43299123 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] Action: 'create', calling method: .version_select at 0x7f8008f74700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2001423118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzQDhkD1k9hnFjquTwIONYK7G0tw50zTJk0mUh31r0xxwR+qouQesGCdkCJbSWLk1VNL71o0XsUCErYq4hGNlje1FZr65QvOk6LUhrd0pzEeGxPBT16Dc9Ox3f2TznZBw=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:50:08.798082 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-87bf00b0-3ea2-4947-bda1-2cac43299123 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] Getting quotas for project 4535aae351d7426cbd405ca27e30950c. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:50:08.803087 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-87bf00b0-3ea2-4947-bda1-2cac43299123 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] Getting quotas for user d0a7bce6324e41c3bee09e2b0d06285e and project 4535aae351d7426cbd405ca27e30950c. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:50:08.880672 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-87bf00b0-3ea2-4947-bda1-2cac43299123 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.105784 Aug 22 17:50:08.881213 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1033/2062] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:50:08 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:50:08.930997 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a68691a7-6e16-4eae-9ca5-552f13fc3e64 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-946644605", "imageRef": "5f5fb0fe-56ad-443d-a496-56a61b6afbdd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2001423118", "networks": [{"uuid": "2aa82ea0-39b5-4099-8a07-1ca6ecaf52bb"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:50:08.939674 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=8 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:50:08.940339 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:50:08.984748 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-a68691a7-6e16-4eae-9ca5-552f13fc3e64 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] validate_networks() for [('2aa82ea0-39b5-4099-8a07-1ca6ecaf52bb', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-a68691a7-6e16-4eae-9ca5-552f13fc3e64 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6a9ae995-e8af-4289-992c-69c2aa8d3127) Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:50:09.188374 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6a9ae995-e8af-4289-992c-69c2aa8d3127) Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-a68691a7-6e16-4eae-9ca5-552f13fc3e64 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a68691a7-6e16-4eae-9ca5-552f13fc3e64 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] Request method failure captured: Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 268 Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA8G-D6VwDv_OW2_lVQQ9gx_WTXX6HVLrqL051QieLmJPVgqkGXyDkGnProtIij36q3CgL1p11hog74waZo8ubusGsNtTVzMp5MWdwWlWjk9BNFC80H7KvxT0NgyiGIBaHNUhy0U68eEIC4HBB4lSUjfzai5J7ewILhMfj2Xgy4c6r6E Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 4535aae351d7426cbd405ca27e30950c Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-TestMinimumBasicScenario-1218042584 Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4535aae351d7426cbd405ca27e30950c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_4535aae351d7426cbd405ca27e30950c", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4535aae351d7426cbd405ca27e30950c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/4535aae351d7426cbd405ca27e30950c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-TestMinimumBasicScenario-1218042584 Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 4535aae351d7426cbd405ca27e30950c Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1218042584 Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-TestMinimumBasicScenario-1218042584-project Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: d0a7bce6324e41c3bee09e2b0d06285e Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-TestMinimumBasicScenario-1218042584-project Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-TestMinimumBasicScenario-server-946644605", "imageRef": "5f5fb0fe-56ad-443d-a496-56a61b6afbdd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2001423118", "networks": [{"uuid": "2aa82ea0-39b5-4099-8a07-1ca6ecaf52bb"}]}} Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:09.196314 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-TestMinimumBasicScenario-server-946644605', 'imageRef': '5f5fb0fe-56ad-443d-a496-56a61b6afbdd', 'flavorRef': '452', 'key_name': 'tempest-TestMinimumBasicScenario-2001423118', 'networks': [{'uuid': '2aa82ea0-39b5-4099-8a07-1ca6ecaf52bb'}]}}} Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:50:09.201353 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6a9ae995-e8af-4289-992c-69c2aa8d3127) Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-a68691a7-6e16-4eae-9ca5-552f13fc3e64 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-a68691a7-6e16-4eae-9ca5-552f13fc3e64 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.265597 Aug 22 17:50:09.205752 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1030/2063] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:50:08 2022] POST /compute/v2.1/servers => generated 214 bytes in 267 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:50:09.209214 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cc47c475-c7a0-40f6-81b0-821117d92b06 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] Calling method '.version_select at 0x7f8008f9c790>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:50:09.292488 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-cc47c475-c7a0-40f6-81b0-821117d92b06 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2001423118" status: 202 len: 0 microversion: 2.1 time: 0.091311 Aug 22 17:50:09.293066 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1034/2064] 10.222.0.96 () {58 vars in 1272 bytes} [Mon Aug 22 17:50:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2001423118 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:50:20.632316 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:50:20.636491 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-19e21867-0492-4a63-88e6-4eb4b5c7980c tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] Action: 'create', calling method: .version_select at 0x7f80093e0280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-176286372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL32N1V1K2TNjc2+Mvwu4BTn8RlUmucicdkIhSGhHqLSzx76K5SUwx/9+W3roBF6AniXo0Z/3/QmMK1feQaujw1EMYBWWLAoLJozlPR1/anQGBQpVr/I2l1ACwDT8diY/g=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:50:20.652980 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-19e21867-0492-4a63-88e6-4eb4b5c7980c tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] Getting quotas for project 4535aae351d7426cbd405ca27e30950c. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:50:20.658764 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-19e21867-0492-4a63-88e6-4eb4b5c7980c tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] Getting quotas for user d0a7bce6324e41c3bee09e2b0d06285e and project 4535aae351d7426cbd405ca27e30950c. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:50:20.758790 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-19e21867-0492-4a63-88e6-4eb4b5c7980c tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.127833 Aug 22 17:50:20.759542 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1031/2065] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:50:20 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:50:20.808271 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:50:20.808999 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:50:20.813888 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d13bf3bd-12c2-45dc-b7fe-03053e8e44b2 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-811304480", "imageRef": "30dacd1a-da17-4ed0-840d-c5b1da19aae0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-176286372", "networks": [{"uuid": "2aa82ea0-39b5-4099-8a07-1ca6ecaf52bb"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:50:20.868316 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-d13bf3bd-12c2-45dc-b7fe-03053e8e44b2 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] validate_networks() for [('2aa82ea0-39b5-4099-8a07-1ca6ecaf52bb', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-d13bf3bd-12c2-45dc-b7fe-03053e8e44b2 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b90a1756-70e4-4fef-8b7d-44ad860f72e6) Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:50:21.414790 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b90a1756-70e4-4fef-8b7d-44ad860f72e6) Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-d13bf3bd-12c2-45dc-b7fe-03053e8e44b2 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d13bf3bd-12c2-45dc-b7fe-03053e8e44b2 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] Request method failure captured: Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 267 Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA8G-D6VwDv_OW2_lVQQ9gx_WTXX6HVLrqL051QieLmJPVgqkGXyDkGnProtIij36q3CgL1p11hog74waZo8ubusGsNtTVzMp5MWdwWlWjk9BNFC80H7KvxT0NgyiGIBaHNUhy0U68eEIC4HBB4lSUjfzai5J7ewILhMfj2Xgy4c6r6E Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 4535aae351d7426cbd405ca27e30950c Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-TestMinimumBasicScenario-1218042584 Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4535aae351d7426cbd405ca27e30950c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_4535aae351d7426cbd405ca27e30950c", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/4535aae351d7426cbd405ca27e30950c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/4535aae351d7426cbd405ca27e30950c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-TestMinimumBasicScenario-1218042584 Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 4535aae351d7426cbd405ca27e30950c Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1218042584 Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-TestMinimumBasicScenario-1218042584-project Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: d0a7bce6324e41c3bee09e2b0d06285e Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-TestMinimumBasicScenario-1218042584-project Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-TestMinimumBasicScenario-server-811304480", "imageRef": "30dacd1a-da17-4ed0-840d-c5b1da19aae0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-176286372", "networks": [{"uuid": "2aa82ea0-39b5-4099-8a07-1ca6ecaf52bb"}]}} Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:21.419281 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-TestMinimumBasicScenario-server-811304480', 'imageRef': '30dacd1a-da17-4ed0-840d-c5b1da19aae0', 'flavorRef': '452', 'key_name': 'tempest-TestMinimumBasicScenario-176286372', 'networks': [{'uuid': '2aa82ea0-39b5-4099-8a07-1ca6ecaf52bb'}]}}} Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:50:21.425432 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b90a1756-70e4-4fef-8b7d-44ad860f72e6) Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-d13bf3bd-12c2-45dc-b7fe-03053e8e44b2 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-d13bf3bd-12c2-45dc-b7fe-03053e8e44b2 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.605968 Aug 22 17:50:21.430408 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1035/2066] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:50:20 2022] POST /compute/v2.1/servers => generated 214 bytes in 607 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 22 17:50:21.434213 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1397c45f-4a9e-4081-ba64-9f78b50eecf3 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] Calling method '.version_select at 0x7f80093b6e50>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:50:21.504731 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1397c45f-4a9e-4081-ba64-9f78b50eecf3 tempest-TestMinimumBasicScenario-1218042584 tempest-TestMinimumBasicScenario-1218042584-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-176286372" status: 202 len: 0 microversion: 2.1 time: 0.086461 Aug 22 17:50:21.505550 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1032/2067] 10.222.0.96 () {58 vars in 1269 bytes} [Mon Aug 22 17:50:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-176286372 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:50:33.636229 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:50:33.811385 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-56afd199-0ad2-4894-abf5-7a153b2d27a9 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Action: 'create', calling method: .version_select at 0x7f8008ee6700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1988371689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG78HPm8GaC+s8Llc8MlW+rm6hzwKlzjK1AGGAZciP7VkdRyL+ZiJQnci7GmBeW/TrkVWE2oiUnsGnP0q7EovWJ3smpY/fZvKcvotrJsDtPISLZtDCftRG/FaimxrQxLiw=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:50:33.829043 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-56afd199-0ad2-4894-abf5-7a153b2d27a9 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Getting quotas for project a89f2a978b004d16bf867ef955c44ce7. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:50:33.834630 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-56afd199-0ad2-4894-abf5-7a153b2d27a9 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Getting quotas for user f03d602c255c4acba76efbc6faf8cd74 and project a89f2a978b004d16bf867ef955c44ce7. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:50:33.933157 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-56afd199-0ad2-4894-abf5-7a153b2d27a9 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.298167 Aug 22 17:50:33.933670 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1036/2068] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:50:33 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:50:42.531949 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:50:42.532784 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:50:42.538263 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-11d3b722-90ac-4468-8772-eb48488f78e3 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1536419897", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "0acf8cb9-ebf9-4aa4-9447-35cc96f51dd6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1988371689", "security_groups": [{"name": "tempest-secgroup-smoke-1106799580"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:50:42.669760 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-11d3b722-90ac-4468-8772-eb48488f78e3 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] validate_networks() for [('0acf8cb9-ebf9-4aa4-9447-35cc96f51dd6', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-11d3b722-90ac-4468-8772-eb48488f78e3 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5ed77b01-4ab7-4588-9573-ba9b4bcdb2f8) Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:50:42.906457 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5ed77b01-4ab7-4588-9573-ba9b4bcdb2f8) Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-11d3b722-90ac-4468-8772-eb48488f78e3 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-11d3b722-90ac-4468-8772-eb48488f78e3 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Request method failure captured: Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 345 Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA8HoYNNnirVnwalhvdCgyVtALddqjy6W4jfWsnjdJ860zsKyLpWBR-oss_5JqxBdQETtwk3ko-JRzhnCu65MJWIVWN6r1hXdEQxqA8f2zbmILp3Q4CES5THOUfhBfvYO5rD9bP5NhP_PyHgXRwKjcEjCS650duYgy-mct6A98OlZ9fQ Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: a89f2a978b004d16bf867ef955c44ce7 Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-641456243 Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a89f2a978b004d16bf867ef955c44ce7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_a89f2a978b004d16bf867ef955c44ce7", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a89f2a978b004d16bf867ef955c44ce7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/a89f2a978b004d16bf867ef955c44ce7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-TestNetworkAdvancedServerOps-641456243 Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: a89f2a978b004d16bf867ef955c44ce7 Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-641456243 Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-TestNetworkAdvancedServerOps-641456243-project Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: f03d602c255c4acba76efbc6faf8cd74 Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-TestNetworkAdvancedServerOps-641456243-project Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1536419897", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "0acf8cb9-ebf9-4aa4-9447-35cc96f51dd6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1988371689", "security_groups": [{"name": "tempest-secgroup-smoke-1106799580"}]}} Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:42.911760 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1536419897', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '0acf8cb9-ebf9-4aa4-9447-35cc96f51dd6'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1988371689', 'security_groups': [{'name': 'tempest-secgroup-smoke-1106799580'}]}}} Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:50:42.920917 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5ed77b01-4ab7-4588-9573-ba9b4bcdb2f8) Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-11d3b722-90ac-4468-8772-eb48488f78e3 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-11d3b722-90ac-4468-8772-eb48488f78e3 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.381474 Aug 22 17:50:42.927759 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1033/2069] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:50:42 2022] POST /compute/v2.1/servers => generated 214 bytes in 383 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:50:47.043497 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-175554bf-b4de-4e1b-bb17-33563ae851df tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Calling method '.version_select at 0x7f8008fa7a60>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:50:47.048863 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:50:47.050127 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:50:47.133154 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-175554bf-b4de-4e1b-bb17-33563ae851df tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1988371689" status: 202 len: 0 microversion: 2.1 time: 0.093412 Aug 22 17:50:47.133729 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1037/2070] 10.222.0.96 () {58 vars in 1284 bytes} [Mon Aug 22 17:50:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1988371689 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:50:47.149591 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-01bceb37-603c-4c40-8c96-358941ba7ce0 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Action: 'create', calling method: .version_select at 0x7f80099dc040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-16828917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDL4DLig/soLyiHNoWsdGrZxo8zJ5wq37EtOZuDxQexYm7c2DsymzV/5MRpf7DHXNA6x9z57bwSyIUD5HXZppjkvI+aJTcSmD3f94o7gaRDdCUghG79oSzG74nw96acQkw=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:50:47.169795 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-01bceb37-603c-4c40-8c96-358941ba7ce0 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Getting quotas for project a89f2a978b004d16bf867ef955c44ce7. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:50:47.177177 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-01bceb37-603c-4c40-8c96-358941ba7ce0 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Getting quotas for user f03d602c255c4acba76efbc6faf8cd74 and project a89f2a978b004d16bf867ef955c44ce7. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:50:47.275994 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-01bceb37-603c-4c40-8c96-358941ba7ce0 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.130822 Aug 22 17:50:47.276559 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1034/2071] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:50:47 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:50:55.440404 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5f7cc772-3e38-4e87-8c3a-6988fbc354f1 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1977485964", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "b5e4aef7-4c94-4207-89b1-f7d36ba4c657"}], "key_name": "tempest-TestNetworkAdvancedServerOps-16828917", "security_groups": [{"name": "tempest-secgroup-smoke-352107446"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:50:55.562876 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-5f7cc772-3e38-4e87-8c3a-6988fbc354f1 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] validate_networks() for [('b5e4aef7-4c94-4207-89b1-f7d36ba4c657', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-5f7cc772-3e38-4e87-8c3a-6988fbc354f1 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1a1d68e8-172a-4b06-b892-5af343360327) Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:50:55.806739 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:50:55.811150 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:50:55.811150 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:50:55.811150 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:50:55.811150 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:50:55.811150 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:50:55.811150 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:50:55.811150 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:50:55.811150 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:50:55.811150 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:50:55.811150 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:50:55.811150 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:50:55.811150 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:50:55.811150 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:50:55.811150 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:50:55.811150 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:50:55.811150 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1a1d68e8-172a-4b06-b892-5af343360327) Aug 22 17:50:55.811150 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:50:55.813709 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-5f7cc772-3e38-4e87-8c3a-6988fbc354f1 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:55.813709 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5f7cc772-3e38-4e87-8c3a-6988fbc354f1 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Request method failure captured: Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 342 Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA8HoYNNnirVnwalhvdCgyVtALddqjy6W4jfWsnjdJ860zsKyLpWBR-oss_5JqxBdQETtwk3ko-JRzhnCu65MJWIVWN6r1hXdEQxqA8f2zbmILp3Q4CES5THOUfhBfvYO5rD9bP5NhP_PyHgXRwKjcEjCS650duYgy-mct6A98OlZ9fQ Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: a89f2a978b004d16bf867ef955c44ce7 Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-641456243 Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a89f2a978b004d16bf867ef955c44ce7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_a89f2a978b004d16bf867ef955c44ce7", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a89f2a978b004d16bf867ef955c44ce7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/a89f2a978b004d16bf867ef955c44ce7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-TestNetworkAdvancedServerOps-641456243 Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: a89f2a978b004d16bf867ef955c44ce7 Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-641456243 Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-TestNetworkAdvancedServerOps-641456243-project Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: f03d602c255c4acba76efbc6faf8cd74 Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-TestNetworkAdvancedServerOps-641456243-project Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1977485964", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "b5e4aef7-4c94-4207-89b1-f7d36ba4c657"}], "key_name": "tempest-TestNetworkAdvancedServerOps-16828917", "security_groups": [{"name": "tempest-secgroup-smoke-352107446"}]}} Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1977485964', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'b5e4aef7-4c94-4207-89b1-f7d36ba4c657'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-16828917', 'security_groups': [{'name': 'tempest-secgroup-smoke-352107446'}]}}} Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:50:55.816070 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-1a1d68e8-172a-4b06-b892-5af343360327) Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:50:55.821494 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-5f7cc772-3e38-4e87-8c3a-6988fbc354f1 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-5f7cc772-3e38-4e87-8c3a-6988fbc354f1 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.381272 Aug 22 17:50:55.826175 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1038/2072] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:50:55 2022] POST /compute/v2.1/servers => generated 214 bytes in 383 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:50:59.707086 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:50:59.708466 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:50:59.712414 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-bb99850e-c526-4e63-987d-2148082582b6 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Calling method '.version_select at 0x7f800a3beca0>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:50:59.793642 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-bb99850e-c526-4e63-987d-2148082582b6 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-16828917" status: 202 len: 0 microversion: 2.1 time: 0.087722 Aug 22 17:50:59.794241 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1035/2073] 10.222.0.96 () {58 vars in 1278 bytes} [Mon Aug 22 17:50:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-16828917 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:50:59.808343 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-af186d6c-d6e8-4075-baa4-6915130e4c8c tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Action: 'create', calling method: .version_select at 0x7f8008ecb700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-832699538", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKebsXdiaewj7vhxQjoIkC3oUqgThV8I/ftl/K7HRKfl64yNIl0+telwe5lzOtxe6Cx8Nh+y8ZtPOP+bYA5A6pOXpOyHeqHG7MvuJ+aqy9tiZllgU+0zoBnvw+AVrSDsIg=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:50:59.826414 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-af186d6c-d6e8-4075-baa4-6915130e4c8c tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Getting quotas for project a89f2a978b004d16bf867ef955c44ce7. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:50:59.831669 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-af186d6c-d6e8-4075-baa4-6915130e4c8c tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Getting quotas for user f03d602c255c4acba76efbc6faf8cd74 and project a89f2a978b004d16bf867ef955c44ce7. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:50:59.919431 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-af186d6c-d6e8-4075-baa4-6915130e4c8c tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.115637 Aug 22 17:50:59.919963 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1039/2074] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:50:59 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:51:08.058275 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-13c99933-4cb2-46a8-94a3-f85373272ed1 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-964122108", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "99c0192e-b91f-4564-81be-a564e84601c1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-832699538", "security_groups": [{"name": "tempest-secgroup-smoke-1952671324"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:51:08.179794 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-13c99933-4cb2-46a8-94a3-f85373272ed1 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] validate_networks() for [('99c0192e-b91f-4564-81be-a564e84601c1', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-13c99933-4cb2-46a8-94a3-f85373272ed1 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-12d8d5a6-d7b4-4b34-9d20-205f0a337d7a) Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:51:08.402385 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-12d8d5a6-d7b4-4b34-9d20-205f0a337d7a) Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-13c99933-4cb2-46a8-94a3-f85373272ed1 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-13c99933-4cb2-46a8-94a3-f85373272ed1 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Request method failure captured: Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 343 Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA8HoYNNnirVnwalhvdCgyVtALddqjy6W4jfWsnjdJ860zsKyLpWBR-oss_5JqxBdQETtwk3ko-JRzhnCu65MJWIVWN6r1hXdEQxqA8f2zbmILp3Q4CES5THOUfhBfvYO5rD9bP5NhP_PyHgXRwKjcEjCS650duYgy-mct6A98OlZ9fQ Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: a89f2a978b004d16bf867ef955c44ce7 Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-641456243 Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a89f2a978b004d16bf867ef955c44ce7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_a89f2a978b004d16bf867ef955c44ce7", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a89f2a978b004d16bf867ef955c44ce7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/a89f2a978b004d16bf867ef955c44ce7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-TestNetworkAdvancedServerOps-641456243 Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: a89f2a978b004d16bf867ef955c44ce7 Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-641456243 Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-TestNetworkAdvancedServerOps-641456243-project Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: f03d602c255c4acba76efbc6faf8cd74 Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-TestNetworkAdvancedServerOps-641456243-project Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-964122108", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "99c0192e-b91f-4564-81be-a564e84601c1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-832699538", "security_groups": [{"name": "tempest-secgroup-smoke-1952671324"}]}} Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:08.406529 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-964122108', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '99c0192e-b91f-4564-81be-a564e84601c1'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-832699538', 'security_groups': [{'name': 'tempest-secgroup-smoke-1952671324'}]}}} Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:51:08.410637 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-12d8d5a6-d7b4-4b34-9d20-205f0a337d7a) Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-13c99933-4cb2-46a8-94a3-f85373272ed1 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-13c99933-4cb2-46a8-94a3-f85373272ed1 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.352805 Aug 22 17:51:08.414564 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1036/2075] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:51:08 2022] POST /compute/v2.1/servers => generated 214 bytes in 358 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:51:12.191128 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:51:12.191957 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:51:12.196195 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-12c773d1-27ad-4b70-88fb-b76d48453fb2 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Calling method '.version_select at 0x7f8008f74ee0>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:51:12.298820 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-12c773d1-27ad-4b70-88fb-b76d48453fb2 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-832699538" status: 202 len: 0 microversion: 2.1 time: 0.108885 Aug 22 17:51:12.299332 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1040/2076] 10.222.0.96 () {58 vars in 1281 bytes} [Mon Aug 22 17:51:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-832699538 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:51:12.315076 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e6aa3118-21b4-4342-9b27-262d2560eb1e tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Action: 'create', calling method: .version_select at 0x7f80094af0d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1295963137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImiPnzbj8Y7zIBPhe4lgceT0Ek/dTyvFIWEQAjqcO3z9uOLSVfTF8hzrX0JT8LcMW7qZ8n1DddI3kJceCZY3rPEinfk4V71TrR3Jw0GS9gu2ZLGlBL/rH+n/D4E1FhF8g=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:51:12.331296 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-e6aa3118-21b4-4342-9b27-262d2560eb1e tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Getting quotas for project a89f2a978b004d16bf867ef955c44ce7. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:51:12.336586 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-e6aa3118-21b4-4342-9b27-262d2560eb1e tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Getting quotas for user f03d602c255c4acba76efbc6faf8cd74 and project a89f2a978b004d16bf867ef955c44ce7. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:51:12.436527 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e6aa3118-21b4-4342-9b27-262d2560eb1e tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.126990 Aug 22 17:51:12.437363 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1037/2077] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:51:12 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:51:13.851739 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:51:13.852667 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:51:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:51:21.081916 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-50b6f266-2705-4765-9e87-5a6c42baab62 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1872586497", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "118db9c3-90da-4180-827b-02d1ae3af84c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1295963137", "security_groups": [{"name": "tempest-secgroup-smoke-246918739"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:51:21.238188 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-50b6f266-2705-4765-9e87-5a6c42baab62 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] validate_networks() for [('118db9c3-90da-4180-827b-02d1ae3af84c', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-50b6f266-2705-4765-9e87-5a6c42baab62 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d1912cd0-3511-4864-a6bb-ae032cf5a318) Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:51:21.513582 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d1912cd0-3511-4864-a6bb-ae032cf5a318) Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-50b6f266-2705-4765-9e87-5a6c42baab62 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-50b6f266-2705-4765-9e87-5a6c42baab62 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Request method failure captured: Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 344 Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA8HoYNNnirVnwalhvdCgyVtALddqjy6W4jfWsnjdJ860zsKyLpWBR-oss_5JqxBdQETtwk3ko-JRzhnCu65MJWIVWN6r1hXdEQxqA8f2zbmILp3Q4CES5THOUfhBfvYO5rD9bP5NhP_PyHgXRwKjcEjCS650duYgy-mct6A98OlZ9fQ Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: a89f2a978b004d16bf867ef955c44ce7 Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-641456243 Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a89f2a978b004d16bf867ef955c44ce7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_a89f2a978b004d16bf867ef955c44ce7", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a89f2a978b004d16bf867ef955c44ce7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/a89f2a978b004d16bf867ef955c44ce7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-TestNetworkAdvancedServerOps-641456243 Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: a89f2a978b004d16bf867ef955c44ce7 Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-641456243 Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-TestNetworkAdvancedServerOps-641456243-project Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: f03d602c255c4acba76efbc6faf8cd74 Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-TestNetworkAdvancedServerOps-641456243-project Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1872586497", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "118db9c3-90da-4180-827b-02d1ae3af84c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1295963137", "security_groups": [{"name": "tempest-secgroup-smoke-246918739"}]}} Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:21.518139 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1872586497', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': '118db9c3-90da-4180-827b-02d1ae3af84c'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1295963137', 'security_groups': [{'name': 'tempest-secgroup-smoke-246918739'}]}}} Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:51:21.525810 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d1912cd0-3511-4864-a6bb-ae032cf5a318) Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-50b6f266-2705-4765-9e87-5a6c42baab62 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-50b6f266-2705-4765-9e87-5a6c42baab62 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.440594 Aug 22 17:51:21.538464 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1041/2078] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:51:21 2022] POST /compute/v2.1/servers => generated 214 bytes in 454 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:51:25.360043 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:51:25.360922 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:51:25.365034 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-9092d021-b1ab-41fd-93cf-a2587371ea15 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Calling method '.version_select at 0x7f8009b11b80>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:51:25.439574 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-9092d021-b1ab-41fd-93cf-a2587371ea15 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1295963137" status: 202 len: 0 microversion: 2.1 time: 0.080736 Aug 22 17:51:25.440151 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1038/2079] 10.222.0.96 () {58 vars in 1284 bytes} [Mon Aug 22 17:51:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1295963137 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:51:25.453612 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-b2562c35-7f78-4fc7-8edb-ab8a85c7bd82 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Action: 'create', calling method: .version_select at 0x7f8009087940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1817862984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7SFZ+kXCFphb65UW0crVGYdJg20ZinTFBDbpxRpJ3QNA4Ee7+xg8J9wv16KjHjBBzsIRB+NsGXjT9Szd62qFqZbSL9C2ScKgG6QIgCrraR6NH48kW59Knrkbhi6c6o5Q=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:51:25.471024 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-b2562c35-7f78-4fc7-8edb-ab8a85c7bd82 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Getting quotas for project a89f2a978b004d16bf867ef955c44ce7. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:51:25.475969 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-b2562c35-7f78-4fc7-8edb-ab8a85c7bd82 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Getting quotas for user f03d602c255c4acba76efbc6faf8cd74 and project a89f2a978b004d16bf867ef955c44ce7. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:51:25.556643 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-b2562c35-7f78-4fc7-8edb-ab8a85c7bd82 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.106793 Aug 22 17:51:25.557323 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1042/2080] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:51:25 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:51:34.007518 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0ec72998-e95a-489e-ada3-d26144babaa7 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1065841475", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "cd766fb5-97c2-4417-a06c-8142c0637d7e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1817862984", "security_groups": [{"name": "tempest-secgroup-smoke-1091646388"}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:51:34.137501 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-0ec72998-e95a-489e-ada3-d26144babaa7 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] validate_networks() for [('cd766fb5-97c2-4417-a06c-8142c0637d7e', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-0ec72998-e95a-489e-ada3-d26144babaa7 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9a1f250e-8ed4-4fcc-987e-02d384d844f3) Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:51:34.379580 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9a1f250e-8ed4-4fcc-987e-02d384d844f3) Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-0ec72998-e95a-489e-ada3-d26144babaa7 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0ec72998-e95a-489e-ada3-d26144babaa7 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Request method failure captured: Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 345 Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA8HoYNNnirVnwalhvdCgyVtALddqjy6W4jfWsnjdJ860zsKyLpWBR-oss_5JqxBdQETtwk3ko-JRzhnCu65MJWIVWN6r1hXdEQxqA8f2zbmILp3Q4CES5THOUfhBfvYO5rD9bP5NhP_PyHgXRwKjcEjCS650duYgy-mct6A98OlZ9fQ Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: a89f2a978b004d16bf867ef955c44ce7 Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-641456243 Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a89f2a978b004d16bf867ef955c44ce7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_a89f2a978b004d16bf867ef955c44ce7", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/a89f2a978b004d16bf867ef955c44ce7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/a89f2a978b004d16bf867ef955c44ce7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-TestNetworkAdvancedServerOps-641456243 Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: a89f2a978b004d16bf867ef955c44ce7 Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-641456243 Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-TestNetworkAdvancedServerOps-641456243-project Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: f03d602c255c4acba76efbc6faf8cd74 Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-TestNetworkAdvancedServerOps-641456243-project Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1065841475", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "networks": [{"uuid": "cd766fb5-97c2-4417-a06c-8142c0637d7e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1817862984", "security_groups": [{"name": "tempest-secgroup-smoke-1091646388"}]}} Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:34.383603 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1065841475', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'networks': [{'uuid': 'cd766fb5-97c2-4417-a06c-8142c0637d7e'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1817862984', 'security_groups': [{'name': 'tempest-secgroup-smoke-1091646388'}]}}} Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:51:34.389720 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9a1f250e-8ed4-4fcc-987e-02d384d844f3) Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-0ec72998-e95a-489e-ada3-d26144babaa7 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:51:34.394541 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-0ec72998-e95a-489e-ada3-d26144babaa7 tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.380716 Aug 22 17:51:34.399237 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1039/2081] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:51:34 2022] POST /compute/v2.1/servers => generated 214 bytes in 396 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Aug 22 17:51:38.018946 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:51:38.020055 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:51:38.024049 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-6c8533eb-2b91-42dd-b4cb-1a6552a0b9dc tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] Calling method '.version_select at 0x7f8008fb3280>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:51:38.127830 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-6c8533eb-2b91-42dd-b4cb-1a6552a0b9dc tempest-TestNetworkAdvancedServerOps-641456243 tempest-TestNetworkAdvancedServerOps-641456243-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1817862984" status: 202 len: 0 microversion: 2.1 time: 0.110150 Aug 22 17:51:38.128407 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1043/2082] 10.222.0.96 () {58 vars in 1284 bytes} [Mon Aug 22 17:51:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1817862984 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:51:53.358367 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:51:53.552233 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-3ab36dc1-9225-49a0-8b13-cfe3722bd389 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] Action: 'create', calling method: .version_select at 0x7f8009493160>, body: {"keypair": {"name": "tempest-TestShelveInstance-2031153626", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXOa6sXhCPLM0Keyu4cW0sK+qyeNyl7XtC2pGxaVCIoRKey8tQM5/VPuTrPFQJWY8zZGmQ6Hfa1iqTlDQKlWjOHTsuXkJ6ARFhBiDORwGfq32pVPRZLUKVprt/wd8J2Vw=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:51:53.569536 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-3ab36dc1-9225-49a0-8b13-cfe3722bd389 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] Getting quotas for project 5edd8a2166c545048199a1ca09d2b4e0. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:51:53.575614 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-3ab36dc1-9225-49a0-8b13-cfe3722bd389 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] Getting quotas for user 0993234fc58049a99a1a1c1d7fbde418 and project 5edd8a2166c545048199a1ca09d2b4e0. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:51:53.652477 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-3ab36dc1-9225-49a0-8b13-cfe3722bd389 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.295353 Aug 22 17:51:53.653269 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1040/2083] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:51:53 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:51:56.296917 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cf0abe18-3a3d-433e-9bf7-2ad02e71dc32 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-940957450", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2031153626", "security_groups": [{"name": "tempest-secgroup-smoke-838118387"}], "networks": [{"uuid": "123aa93c-b930-47e9-a124-f3735d6bb867"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:51:56.416671 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-cf0abe18-3a3d-433e-9bf7-2ad02e71dc32 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] validate_networks() for [('123aa93c-b930-47e9-a124-f3735d6bb867', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-cf0abe18-3a3d-433e-9bf7-2ad02e71dc32 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-59f2d6a3-e466-4300-b665-8c6ed473bc23) Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:51:56.646027 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-59f2d6a3-e466-4300-b665-8c6ed473bc23) Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-cf0abe18-3a3d-433e-9bf7-2ad02e71dc32 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cf0abe18-3a3d-433e-9bf7-2ad02e71dc32 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] Request method failure captured: Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 323 Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA8Iy4lZdkc6ZFObGM8Pl7TG_GjfkJTOm72kC4AmMjh2Y7IKR-m8kLg-u8z46qygnVt-ZO9oENJZS-t-TQFZNRdXVHwUJ-XgoK3-z-YhZlTsd_FBnerpKMTluFQvavjx1TXp4dcQrCSezFTXDAwYIoh84Oj-ezZteIqUcOhmQQhoxopE Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: 5edd8a2166c545048199a1ca09d2b4e0 Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-TestShelveInstance-450004932 Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/5edd8a2166c545048199a1ca09d2b4e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_5edd8a2166c545048199a1ca09d2b4e0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/5edd8a2166c545048199a1ca09d2b4e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/5edd8a2166c545048199a1ca09d2b4e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-TestShelveInstance-450004932 Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: 5edd8a2166c545048199a1ca09d2b4e0 Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-TestShelveInstance-450004932 Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-TestShelveInstance-450004932-project Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 0993234fc58049a99a1a1c1d7fbde418 Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-TestShelveInstance-450004932-project Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-TestShelveInstance-server-940957450", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2031153626", "security_groups": [{"name": "tempest-secgroup-smoke-838118387"}], "networks": [{"uuid": "123aa93c-b930-47e9-a124-f3735d6bb867"}]}} Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:56.650753 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-TestShelveInstance-server-940957450', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'key_name': 'tempest-TestShelveInstance-2031153626', 'security_groups': [{'name': 'tempest-secgroup-smoke-838118387'}], 'networks': [{'uuid': '123aa93c-b930-47e9-a124-f3735d6bb867'}]}}} Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:51:56.656333 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-59f2d6a3-e466-4300-b665-8c6ed473bc23) Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-cf0abe18-3a3d-433e-9bf7-2ad02e71dc32 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-cf0abe18-3a3d-433e-9bf7-2ad02e71dc32 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.358722 Aug 22 17:51:56.660743 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1044/2084] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:51:56 2022] POST /compute/v2.1/servers => generated 214 bytes in 360 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:51:56.896200 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-b59bf2d0-6ca0-496b-9a0c-1ed9d9f69856 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] Calling method '.version_select at 0x7f8009775790>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:51:56.988679 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-b59bf2d0-6ca0-496b-9a0c-1ed9d9f69856 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2031153626" status: 202 len: 0 microversion: 2.1 time: 0.097824 Aug 22 17:51:56.997420 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1041/2085] 10.222.0.96 () {58 vars in 1254 bytes} [Mon Aug 22 17:51:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2031153626 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:51:57.003370 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-df17c2a9-b691-49f5-87e6-a91fddc85c7f tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] Action: 'create', calling method: .version_select at 0x7f8008fa79d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-941361243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5LnbNDDrt19APNcw4z87UB47p/8X+PCmsmgv/UWDSxwJX8nzm9UKItC+hkYQkY3Wf/mZpjEDZe4LBlQAppeeoBOR2l0c16dVJ5X5LpPupn5U2IaLsrrzXFJqWnaofPgw=="}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:51:57.020633 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-df17c2a9-b691-49f5-87e6-a91fddc85c7f tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] Getting quotas for project 5edd8a2166c545048199a1ca09d2b4e0. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:51:57.026440 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.quota [None req-df17c2a9-b691-49f5-87e6-a91fddc85c7f tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] Getting quotas for user 0993234fc58049a99a1a1c1d7fbde418 and project 5edd8a2166c545048199a1ca09d2b4e0. Resources: {'key_pairs'} {{(pid=123015) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:51:57.103754 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-df17c2a9-b691-49f5-87e6-a91fddc85c7f tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.104245 Aug 22 17:51:57.105022 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1045/2086] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:51:56 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:52:21.536123 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_cell0:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:52:21.540203 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:52:21.541220 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-dfee74fd-9b8b-4065-8bd7-9afb85649d92 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1204642181", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-941361243", "security_groups": [{"name": "tempest-secgroup-smoke-1552227989"}], "networks": [{"uuid": "123aa93c-b930-47e9-a124-f3735d6bb867"}], "block_device_mapping_v2": [{"uuid": "444c486c-3325-468f-8871-e6695814fd75", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:52:21.657464 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.network.neutron [None req-dfee74fd-9b8b-4065-8bd7-9afb85649d92 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] validate_networks() for [('123aa93c-b930-47e9-a124-f3735d6bb867', None, None, None, None, None)] {{(pid=123016) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [None req-dfee74fd-9b8b-4065-8bd7-9afb85649d92 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-865e063a-d8fd-4855-859b-408df80327ba) Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:52:21.862077 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-865e063a-d8fd-4855-859b-408df80327ba) Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.wsgi [None req-dfee74fd-9b8b-4065-8bd7-9afb85649d92 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-dfee74fd-9b8b-4065-8bd7-9afb85649d92 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] Request method failure captured: Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: Accept: application/json Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: Accept-Encoding: identity Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: Connection: close Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: Content-Length: 470 Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: Content-Type: application/json Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: Host: 10.222.0.96 Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: Openstack-System-Scope: None Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: User-Agent: python-urllib3/1.26.11 Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-Auth-Token: gAAAAABjA8Iy4lZdkc6ZFObGM8Pl7TG_GjfkJTOm72kC4AmMjh2Y7IKR-m8kLg-u8z46qygnVt-ZO9oENJZS-t-TQFZNRdXVHwUJ-XgoK3-z-YhZlTsd_FBnerpKMTluFQvavjx1TXp4dcQrCSezFTXDAwYIoh84Oj-ezZteIqUcOhmQQhoxopE Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Id: None Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-Domain-Name: None Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-Identity-Status: Confirmed Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-Is-Admin-Project: True Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Id: default Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Domain-Name: Default Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Id: 5edd8a2166c545048199a1ca09d2b4e0 Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-Project-Name: tempest-TestShelveInstance-450004932 Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-Role: reader,member Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-Roles: reader,member Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/5edd8a2166c545048199a1ca09d2b4e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_5edd8a2166c545048199a1ca09d2b4e0", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/5edd8a2166c545048199a1ca09d2b4e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/5edd8a2166c545048199a1ca09d2b4e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant: tempest-TestShelveInstance-450004932 Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Id: 5edd8a2166c545048199a1ca09d2b4e0 Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-Tenant-Name: tempest-TestShelveInstance-450004932 Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-User: tempest-TestShelveInstance-450004932-project Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Id: default Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-User-Domain-Name: Default Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-User-Id: 0993234fc58049a99a1a1c1d7fbde418 Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: X-User-Name: tempest-TestShelveInstance-450004932-project Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: {"server": {"name": "tempest-TestShelveInstance-server-1204642181", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-941361243", "security_groups": [{"name": "tempest-secgroup-smoke-1552227989"}], "networks": [{"uuid": "123aa93c-b930-47e9-a124-f3735d6bb867"}], "block_device_mapping_v2": [{"uuid": "444c486c-3325-468f-8871-e6695814fd75", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: method: > Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:52:21.866643 n-d-854030-1 devstack@n-api.service[123016]: Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: action_args: {'body': {'server': {'name': 'tempest-TestShelveInstance-server-1204642181', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestShelveInstance-941361243', 'security_groups': [{'name': 'tempest-secgroup-smoke-1552227989'}], 'networks': [{'uuid': '123aa93c-b930-47e9-a124-f3735d6bb867'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': '444c486c-3325-468f-8871-e6695814fd75'}]}}} Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:52:21.871331 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-865e063a-d8fd-4855-859b-408df80327ba) Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: ERROR nova.api.openstack.wsgi Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-dfee74fd-9b8b-4065-8bd7-9afb85649d92 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: {{(pid=123016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-dfee74fd-9b8b-4065-8bd7-9afb85649d92 tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.331479 Aug 22 17:52:21.876774 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1042/2087] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:52:21 2022] POST /compute/v2.1/servers => generated 214 bytes in 333 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:52:22.133586 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_cell0:SELECT=4 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:52:22.134372 n-d-854030-1 devstack@n-api.service[123015]: DEBUG dbcounter [-] [123015] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=123015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:52:22.138518 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-1ec88e99-841a-4fb1-8059-403aa1a40b8a tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] Calling method '.version_select at 0x7f8008fa7280>' {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:52:22.226517 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-1ec88e99-841a-4fb1-8059-403aa1a40b8a tempest-TestShelveInstance-450004932 tempest-TestShelveInstance-450004932-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-941361243" status: 202 len: 0 microversion: 2.1 time: 0.094208 Aug 22 17:52:22.227260 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1046/2088] 10.222.0.96 () {58 vars in 1251 bytes} [Mon Aug 22 17:52:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-941361243 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:52:44.070753 n-d-854030-1 devstack@n-api.service[123016]: DEBUG dbcounter [-] [123016] Writing DB stats nova_api:SELECT=4 {{(pid=123016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:52:44.273306 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-1182b9b5-8aee-4fdb-be1b-84c05329c995 tempest-TestSnapshotPattern-2119226439 tempest-TestSnapshotPattern-2119226439-project] Action: 'create', calling method: .version_select at 0x7f80093e0310>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1173079455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHwnlGm/ur7nBKwaKmZbJlIOeKp2YP8OEOpOodX/XRFJ/fEYGDKB+G15xfYWuM8JSBYK1mEU+Xt0VkbXlI8a/pu0MF2/SOr9dOTLHQmuwW8gYn5GuTp3fanevLWNZQOzw=="}} {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:52:44.294313 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-1182b9b5-8aee-4fdb-be1b-84c05329c995 tempest-TestSnapshotPattern-2119226439 tempest-TestSnapshotPattern-2119226439-project] Getting quotas for project bd409b2ca1124562b3b07e158ac91928. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:52:44.301231 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.quota [None req-1182b9b5-8aee-4fdb-be1b-84c05329c995 tempest-TestSnapshotPattern-2119226439 tempest-TestSnapshotPattern-2119226439-project] Getting quotas for user 04b4562e9771466d9fcb12238ef4d36b and project bd409b2ca1124562b3b07e158ac91928. Resources: {'key_pairs'} {{(pid=123016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:52:44.404427 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-1182b9b5-8aee-4fdb-be1b-84c05329c995 tempest-TestSnapshotPattern-2119226439 tempest-TestSnapshotPattern-2119226439-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.335138 Aug 22 17:52:44.405875 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1043/2089] 10.222.0.96 () {60 vars in 1159 bytes} [Mon Aug 22 17:52:44 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:52:46.885163 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c89390f0-4573-44de-8113-7774aa549669 tempest-TestSnapshotPattern-2119226439 tempest-TestSnapshotPattern-2119226439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1950076579", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1173079455", "security_groups": [{"name": "tempest-secgroup-smoke-1649385603"}], "networks": [{"uuid": "6bff89e4-bc5d-46d9-9314-0a2cdec013fc"}]}} {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:52:47.144152 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.network.neutron [None req-c89390f0-4573-44de-8113-7774aa549669 tempest-TestSnapshotPattern-2119226439 tempest-TestSnapshotPattern-2119226439-project] validate_networks() for [('6bff89e4-bc5d-46d9-9314-0a2cdec013fc', None, None, None, None, None)] {{(pid=123015) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [None req-c89390f0-4573-44de-8113-7774aa549669 tempest-TestSnapshotPattern-2119226439 tempest-TestSnapshotPattern-2119226439-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c266a7d5-bc1f-4bfc-a900-886add1347c9) Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:52:47.358306 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c266a7d5-bc1f-4bfc-a900-886add1347c9) Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.wsgi [None req-c89390f0-4573-44de-8113-7774aa549669 tempest-TestSnapshotPattern-2119226439 tempest-TestSnapshotPattern-2119226439-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c89390f0-4573-44de-8113-7774aa549669 tempest-TestSnapshotPattern-2119226439 tempest-TestSnapshotPattern-2119226439-project] Request method failure captured: Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: Accept: application/json Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: Accept-Encoding: identity Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: Connection: close Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: Content-Length: 327 Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: Content-Type: application/json Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: Host: 10.222.0.96 Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: Openstack-System-Scope: None Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: User-Agent: python-urllib3/1.26.11 Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-Auth-Token: gAAAAABjA8Jlx_wN7Kcs_h8ovOBwUuolPLTUZEygdJ-_GVehQ19pCci3uVLM2iRNhMMKOBX-Lr24PbUwQl8ccA7bSASPquDmdOIIWRiR-UOTALyjUlUNbbrOUw38oN-LL3QmPtM6cbowDVjT0MSK2_w9umXyr6mWEM6YqVv32DapBMJPiTZMD28 Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Id: None Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-Domain-Name: None Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-Identity-Status: Confirmed Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-Is-Admin-Project: True Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Id: default Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Domain-Name: Default Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Id: bd409b2ca1124562b3b07e158ac91928 Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-Project-Name: tempest-TestSnapshotPattern-2119226439 Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-Role: reader,member Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-Roles: reader,member Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/bd409b2ca1124562b3b07e158ac91928"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96:8080/v1/AUTH_bd409b2ca1124562b3b07e158ac91928", "adminURL": "http://10.222.0.96:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/volume/v3/bd409b2ca1124562b3b07e158ac91928"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/compute/v2/bd409b2ca1124562b3b07e158ac91928"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.96/identity"}]}] Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant: tempest-TestSnapshotPattern-2119226439 Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Id: bd409b2ca1124562b3b07e158ac91928 Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-Tenant-Name: tempest-TestSnapshotPattern-2119226439 Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-User: tempest-TestSnapshotPattern-2119226439-project Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Id: default Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-User-Domain-Name: Default Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-User-Id: 04b4562e9771466d9fcb12238ef4d36b Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: X-User-Name: tempest-TestSnapshotPattern-2119226439-project Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: {"server": {"name": "tempest-TestSnapshotPattern-server-1950076579", "imageRef": "11a48bbe-9c58-420e-95bf-5f8489a49f10", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1173079455", "security_groups": [{"name": "tempest-secgroup-smoke-1649385603"}], "networks": [{"uuid": "6bff89e4-bc5d-46d9-9314-0a2cdec013fc"}]}} Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: method: > Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:52:47.363404 n-d-854030-1 devstack@n-api.service[123015]: Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: action_args: {'body': {'server': {'name': 'tempest-TestSnapshotPattern-server-1950076579', 'imageRef': '11a48bbe-9c58-420e-95bf-5f8489a49f10', 'flavorRef': '452', 'key_name': 'tempest-TestSnapshotPattern-1173079455', 'security_groups': [{'name': 'tempest-secgroup-smoke-1649385603'}], 'networks': [{'uuid': '6bff89e4-bc5d-46d9-9314-0a2cdec013fc'}]}}} Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1103, in _validate_and_build_base_options Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2276, in create_resource_requests Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1409, in has_extended_resource_request_extension Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._has_extension( Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1383, in _has_extension Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1367, in _refresh_neutron_extensions_cache Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 804, in list_extensions Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Aug 22 17:52:47.367396 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c266a7d5-bc1f-4bfc-a900-886add1347c9) Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: ERROR nova.api.openstack.wsgi Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: DEBUG nova.api.openstack.wsgi [None req-c89390f0-4573-44de-8113-7774aa549669 tempest-TestSnapshotPattern-2119226439 tempest-TestSnapshotPattern-2119226439-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: {{(pid=123015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: INFO nova.api.openstack.requestlog [None req-c89390f0-4573-44de-8113-7774aa549669 tempest-TestSnapshotPattern-2119226439 tempest-TestSnapshotPattern-2119226439-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.482589 Aug 22 17:52:47.371923 n-d-854030-1 devstack@n-api.service[123015]: [pid: 123015|app: 0|req: 1047/2090] 10.222.0.96 () {60 vars in 1147 bytes} [Mon Aug 22 17:52:46 2022] POST /compute/v2.1/servers => generated 214 bytes in 486 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Aug 22 17:52:47.707746 n-d-854030-1 devstack@n-api.service[123016]: DEBUG nova.api.openstack.wsgi [None req-e9e6054d-2c3e-4996-8232-090f44de54c8 tempest-TestSnapshotPattern-2119226439 tempest-TestSnapshotPattern-2119226439-project] Calling method '.version_select at 0x7f80093e0f70>' {{(pid=123016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:52:47.827501 n-d-854030-1 devstack@n-api.service[123016]: INFO nova.api.openstack.requestlog [None req-e9e6054d-2c3e-4996-8232-090f44de54c8 tempest-TestSnapshotPattern-2119226439 tempest-TestSnapshotPattern-2119226439-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1173079455" status: 202 len: 0 microversion: 2.1 time: 0.125701 Aug 22 17:52:47.828266 n-d-854030-1 devstack@n-api.service[123016]: [pid: 123016|app: 0|req: 1044/2091] 10.222.0.96 () {58 vars in 1257 bytes} [Mon Aug 22 17:52:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1173079455 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:52:52.775628 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:52:52.776167 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:52:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:53:05.719681 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:53:05.720230 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:53:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:53:24.077446 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:53:24.077949 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:53:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:54:33.861814 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:54:33.862347 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:54:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:56:12.784174 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:56:12.784767 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:56:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:56:25.728623 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:56:25.729191 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:56:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:56:44.086415 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:56:44.087027 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:56:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:57:52.595156 n-d-854030-1 devstack@n-api.service[123015]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:57:52.595850 n-d-854030-1 devstack@n-api.service[123015]: Mon Aug 22 17:57:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:57:53.870548 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:57:53.870954 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:57:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:57:54.384750 n-d-854030-1 devstack@n-api.service[123016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:57:54.384979 n-d-854030-1 devstack@n-api.service[123016]: Mon Aug 22 17:57:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!